On April 24 at 8:00am PDT, a shared database server crashed affecting a few hundred apps. Our ops team was automatically paged and immediately began the process of bringing up a new database. In this case, the RAID array took an unusually long time to come back online due to an issue in the underl…
Resolved
All apps are now fully restored with no data loss.
We will follow-up with a detailed postmortem after we've assessed the situation.
Update
We are in the process of restoring the affected databases. No data has been lost. We will be turning applications on over the next hour.
Update
We are continuing to work on resolving the database outage. We have identified the failed server and are working to bring the affected applications back up.
Issue
A database issue is currently affecting a small percentage of apps. We are aware of the issue and working towards a resolution.