Keenan

20200904 Server Outage Postmortem

Recommended Posts

Hi all,

 

At approximately 13:25 server time we experienced an outage with the Independence and Serenity servers. The issue was fully resolved roughly an hour later with both servers back online.

 

These two servers share the same hardware, and it was that hardware which sustained a failure causing both servers to experience downtime. There was no data loss in this incident, with the normal exception of creature and player position data that was unsaved at the time of the outage.

 

We also had a secondary outage of our brand new status page, which I had hoped to use for communication during the primary server outage. That page is available here: https://status.wurmonline.com/ and is a real time monitor of our system status across the board. This secondary outage was related to a database issue with our vendor for this feature and was unrelated to the primary outage.

 

All systems are now operational again.

  • Like 12

Share this post


Link to post
Share on other sites

I always appreciate how concise and professional your postmortem accounts are, Keenan. Thanks for being on the ball for us - it is appreciated!

  • Like 4

Share this post


Link to post
Share on other sites

That's because Keenan is the best unlike that rizi guy! 🦊

Thanks for always providing us with info as it happens and communicating with the community. 

 

(no offense Enki, love you too) 

Share this post


Link to post
Share on other sites
7 hours ago, Keenan said:

These two servers share the same hardware, and it was that hardware which sustained a failure causing both servers to experience downtime. There was no data loss in this incident, with the normal exception of creature and player position data that was unsaved at the time of the outage.

 

Weren't hardware issues almost the only reason why Wurm Online was moved away from Hetzner? Not sure if that provider is any better than selfhosting is if they are only managing VMs on hardware servers without failover systems in place.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now