System Status Report
This page allows our customers to keep informed about any issues currently affecting our network.
If an issue is listed here, you can rest assured that we are working to resolve it. If you have a problem not listed here please contact us, as we may not be aware of the issue, or it may only affect your site.
You may want to bookmark this page for future reference.
We shall be performing a number of updates to a number of our servers this evening. During the course of the updates, the control panel will be unavailable. All other services will continue to run normally.
This work may also result in 5 minutes of downtime per server. However, this will be performed outside of normal working hours.
A few customers are unable to access their websites at present. We are currently investigating this and will attempt to rectify it as soon as possible. We would like to express our apologies for the inconvenience caused.
We are performing a file system check on the server duple, which should be online within 15 minutes.
UPDATE: Completed and rebooting.
Please note that the intention of this entry is to alert customers to a potential issue. The issue may well be resolved without any customer affecting problems, however in these circumstances, we issue a notification that redundancy is impacted as soon as possible so customers are kept up to date.
Earlier this evening, the power infrastructure at the data centre detected that the utility supply was outside of the acceptable tolerances, so automatically started up the diesel backup generators. The UPS systems on each floor of the LHC briefly went to battery power to assume the load whilst the backup generators started.
The redundant UPS equipment on the 2nd floor detected an internal failure, and as such did not allow incoming power to be transferred from the generators to the mains power. At the moment, the UPS systems are in "bypass" mode, with power being supplied by the standby diesel generators.
Update 21:45: It has now been confirmed that we are back on mains high voltage utility power, but the UPS systems are still in bypass mode. Engineers are analysing the data from the management controllers and are deciding on a course of action. The engineers hope to restore battery backup protection shortly.
Update 26th June: Replacement parts for the two faulty units (filters and choke) have been installed and the change over to full UPS protection for the 2nd floor of the LHC went ahead without incident.
Engineers are still carefully monitoring the situation, however we now consider this issue closed unless we issue a further update.
This issue was resolved without affecting any customer services.
