At approximately 21:30 BST this evening we experienced a fairly major disruption to part of our core network, which appears to have been the result of a loopback within the core network.
To protect itself the network in TeleHouse (London 3) shut down the affected ports, however this had the side effect of isolating itself from the rest of the network. This impacted other parts of the network as traffic was sent to ports which were not accepting traffic.
The break was isolated and normal service restored approximately 30 minutes later.
We can only apologise for this disruption to service. Engineers are currently working to restore the redundant link / replace the faulty module.
As of 22:40 tonight this has also been restored, we will be monitoring closely over the next 24-48 hours
Further update – 22:50 the fiber uplink to l3-g7-sw1 is reporting errors. We are replacing and rebooting this switch also as a precautionary measure. Customers connected via l3-g7-sw1 will notice a further brief outage. Customers with dual uplinks should not be affected by this emergency maintenance.