Data center incident not affecting production 

There was a fire on one OVH data centers (Strasbourg) travaux.ovh.net/?do=details&id and from what I could understand the building is lost.

In case you don't know. I use OVH to host all of Masto.host but thankfully everything is hosted on a different data center in France, with the exception of backups. The backups were in the building that burned.

So, everything is working in production, just not sure if the backups from the last days were lost.

Data center incident not affecting production 

The reason to locate backups in a different data center is exactly to allow for a situation like the mentioned fire to be recovered from.

Will see if I can get a confirmation if the backup data was lost or not. The backup data was hosted on their Object Storage so hopefully it was not but can't be sure right now.

I will keep you posted when I have more information.

Data center incident not affecting production 

Replies from OVH about restoring their Object Storage from the data center have been vague. So, I can't be sure of a recovery of the backup data.

To try and be proactive in case of non recovery, I have started the backup from zero to another OVH data center in Warsaw.

The database backups from the past 2 days are currently being copied there and will start backing up media files later today.

Follow

Data center incident not affecting production 

All going as expected, the backups for database, configuration files, SSL certificates and other config files will be fully copied today and will start the usual daily copy to the new data center tomorrow.

The media files it will take some days (or a couple of weeks) to be fully copied and doing the daily rotation that I had in place.

Still, hopefully the old backups will be retrieved but if not the new backup is already going.

· · Web · 4 · 2 · 11

Data center incident not affecting production 

Finally the new media backups have been copied to the new data center and the daily rotation is starting now. In the next couple of days it should be running daily for every account.

The old Object Storage (PCS) is still "Under investigation" by OVH to see if the data is recoverable: ovhcloud.com/en/lp/status-serv - still, even if it's recovered I will end up deleting it as the new backups are up to date.

Any questions please let me know.

Data center incident not affecting production 

@mastohost Good work 👍🏻👍🏻

Data center incident not affecting production 

@archos Thanks :)

Data center incident not affecting production 

@mastohost nice work.

Data center incident not affecting production 

@thewismit Thanks :)

Data center incident not affecting production 

@mastohost thank you so much for your hard work and being transparent! Much appreciated!

Data center incident not affecting production 

@jwildeboer Thanks :)

Data center incident not affecting production 

@mastohost Thank you for keeping us in the loop!

Data center incident not affecting production 

@mastohost Fantastic job! Thank you so much!

Sign in to participate in the conversation
Mastodon

Server run by the main developers of the project 🐘 It is not focused on any particular niche interest - everyone is welcome as long as you follow our code of conduct!