[fdo] Mail outage last night

Daniel Stone daniel at fooishbar.org
Thu Mar 21 07:00:08 UTC 2019


Hi all,
Last night, around 6pm UK, the machine hosting gabe.fd.o, our main
SMTP and list transit, suffered a hard physical disk failure.

This resulted in us failing safely - bouncing all incoming mail with
SMTP errors, ensuring it should have been redelivered, albeit very
noisily as everyone got a lot of bounce messages.

We have migrated gabe to another physical host to keep email moving
whilst we come up with a long-term fix. We have ordered a couple of
replacement disks, which will require some downtime for the following
hosts when it arrives and we can replace it:
  - annarchy.fd.o (www.fd.o, www.x.org, all project web pages apart
from GitLab Pages)
  - culpepper.fd.o (bugs.fd.o)
  - ray.fd.o (database for bugs.fd.o)
  - emeril.fd.o (patchwork.fd.o, members.x.org)
  - fruit.fd.o (LDAP accounts)
  - patrick.fd.o (misc admin utilities)
  - roastbeef.fd.o (decommissioned: was phab.fd.o and jenkins.fd.o)

We'll notify closer to the time when we're having this downtime.

Huge thanks to Tollef for dealing with this so far.

Cheers,
Daniel


More information about the freedesktop mailing list