Following on from yesterday’s DDoS attack on one of our clients, we have been working to further minimise the impact of any further attacks
During this mitigation process we identified an optimisation which could be quickly applied to the network and it was decided to implement this earlier this evening
Unfortunately this caused a line card to fail (we believe this is a firmware bug and are continuing to investigate this issue in the lab. We attempted a firmware update however this exacerbated the initial problem and caused a segment failure on the network causing customers connected via thn-edge-1 to lose connectivity for an extended period of time.
We rolled the changes out as quickly as was possible after an initial attempt to normalise the problem which failed.
We can only apologise for any inconvenience caused while customer connections were affected.
We have now (we believe) stabilised the network and addressed the immediate capacity issues introduced when the DDoS struck.
We do however intend to look at further upgrades over the Bank Holiday weekend (which is traditionally a very quiet time for us as a B2B supplier)
More information will be posted in due course