We are aware of issues with the RAID storage unit attached to web-11 and our engineers are investigating further
At this time it appears that 2 drives in the array have failed leaving the storage unit “at risk”
We are working to replace the failed drives at this time and also taking the precaution of running a hot backup to clone the data to a standby server in case of any further failures
We will update this post with more information as we have it
We have had a fairly long-standing project in the pipeline to replace/upgrade the hardware hosting web-11 … at this stage, we think it might be prudent to complete that project (something we had been planning to do in May anyway). The replacement server has been live for some time and has been syncing data
This is an OS upgrade which is why we’ve delayed, however the old OS (CentOS 5) has already reached end of life, so it would be prudent to continue the upgrade process and migrate all data onto the new server. We intend to do that this afternoon as part of this emergency maintenance
Customers should notice a brief period (up to 5 minutes) where their websites and POP/IMAP mailboxes are unavailable as we perform the reboot and swap IP addresses / etc onto the new server.
The new web-11 is now live and customers should not actually notice any difference. If you do spot any issues, please contact Fido Support and raise a ticket at https://help.fido.net/en/new-ticket
Unfortunately, the migration/upgrade/rebuild has hit a snag within the Plesk configuration module that is randomly generating an invalid configuration and causing the web server to fail
We are working on addressing this conflict and hope to have the problem fixed shortly
Final Update
Following several hours of monitoring, and after addressing a few additional teething problems I think we have now managed to address all issues following the server rebuild
We will continue to monitor web-11 for the next few days and will, of course, deal quickly with any further issues which are discovered
As we have had to install new SSL certificates on the server, you may need to accept any “hostname mismatch” SSL warnings – or change your settings to specifically use web-11.server.fido.net if you want to force SSL on with your mail client