Webdock - Notice history

The maintenance for today is complete. All customer VPS servers are up and running. Unfortunately we saw another outage in the rack but that helped us diagnose the issue, which was a faulty power transfer switch as we had surmised. The switch has been replaced and thus the issue has been solved. This means that in case of an unplanned power outage, all our emergency power systems in that rack will behave properly. After the initial crash we did repeated tests and everything was nominal for all racks and equipment in the DC.

We apologize for any inconvenience caused here this morning.

The maintenance has been rescheduled for thursday January 30th

The maintenance is complete and we have connectivity again.

Update: this maintenance window has been rescheduled to January 23rd. The new information from our DC provider is as follows:

Time Frame:
Start Time: 6:00AM EST
End Time: 8:00AM EST
Expected Downtime: 30 minutes

As before, we are expecting only a brief loss of network connectivity. Thank you for your patience.

Maintenance complete and all customer servers operational

After slow methodical work over the past two weeks we have completed all the network changes to our entire fleet in Denmark with no disruption to customers. Everything has been checked, double checked and triple checked :D We are happy to close this maintenance at last.

We have been slowly pecking away at this in the safest manner possible, and for that reason only a small portion of our fleet in Denmark has been converted to the new configuration. We have decided to let this portion run until monday before doing the remainder and finally completing this maintenance. As stated before: This maintenance should have no impact on your server whatsoever.

We will be performing a rolling update of network configuration across our entire fleet in Denmark today and tomorrow. This update is to ensure the stability of our network and solve a long-standing issue whereby some customers have experienced sudden loss of connectivity due to routes beind dropped on our hosts. This update will eliminate this long-standing issue.

Unfortunately, a subset of our customer instances need to be touched whereby our team adjust the network configuration inside your instance. This will typically only impact customers who have created servers with us recently - older instances and instances created within the last couple of weeks are unaffected and will not be touched.

The operations usually just mean a reload of network configuration whereby - at worst - you will see a few packets lost and that's it. Only in rare cases where network configuration was already non-standard or bad beforehand in a customer instance will scenarios come up where you may see some disruption. We expect this to be minimal.

Since this is a large task, we expect this maintenance to last throughout the day today and all day tomorrow, possibly longer depending on progress, in which case we will update here.

Thank you for your patience and understanding.

Everything is up and looks good. Maintenance completed. Thank you for your patience this evening.!

We literally hit some cable snags which we had to work through when pulling the system from the rack. The system is back up and all instances are starting. We are watching and doing final touches.

We need to add in some RAM sticks to a system which has been unstable for many weeks now, due to OOM events. By adding more RAM we hope to resolve the issues on that host. The procedure means we will need to shut down the host completely, pull it out of the rack and add in the new RAM modules and start it up again. Ideally the procedure should take no more than 20 minutes (so 20 minutes of downtime) but we are reserving a full hour for this sunday evening in case of issues. If you are affected by this maintenance you will receive a seperate email informing you of this.