Better late than never

[alierak]

Since mark gave me access to post here, I might as well say something...

You may have seen an interruption in service earlier today. We received a notice from Slicehost about emergency maintenance on a server that became unresponsive (so they were rebooting it). Our global master database was on that server, so most things on Dreamwidth did not work during the outage. The site returned to normal a few minutes later when the server came back up. We're prepared for a longer downtime or larger server failure with a second global database server and offsite backups, but fortunately none of that proved necessary today.

Ideally there wouldn't be a next time, but just in case, matthew and I will also get access to update Twitter (@dreamwidth).

database failover completed

[mark]

We just completed a database failover. Let me know if you see any trouble with the site.

I'll post more details about today's issues in a bit.