This is the kind of thing that could happen to Bluesky as well. A decentralized network can become over-reliant on the services provided by the core protocol provider. Looks like the backups works and they’re going to restore everything, but it is a warning sign for all of these protocols.
So: the matrix.org database secondary lost its FS due to a RAID failure earlier today (11:17 UTC). Then, we lost the primary at 17:26. We're trying to restore the primary DB FS (which could be fastish), while also doing a point-in-time backup restore from last night (which takes >10h).
Matrix.org
View quoted note →