Engineers will be completing essential Maintenance on our Network
Maintenance Reference: ITYNERAFU001
Date - 22/01/2025 00:00 - 06:00
Classification - Affected
Expected Downtime: 30 Minutes
Classification meanings:
Affected
This means that service is expected to be hard-down between the planned start and end times specified and full service impacting. Please note that a lot of the time service is restored much faster than the specified window.
Degraded
This means that service is not expected to be hard down, however, during the planned start and end times specified service may be slower than normal or you may experience performance issues.
At Risk
This means that service is not expected to be hard-down however due to the infrastructure that is being worked on, outage risk is increased.
Description Of Works:
Works are required to complete vital changes to Core Network Equipment in our primary data centre Telehouse North. This critical operation is essential to ensure the continued reliability, security, and optimal performance of our internet services.
Customers are advised not to reset their equipment during the window and to leave all equipment powered on. Services should be restored following completion however if they do not customers are advised to power off all InternetTY equipment at the wall for at least 2 minutes and then power it back on again and services should then be restored. If your service doesn't restore then please contact our support team for further assistance.
All impacted customers have been contacted via email.
Intermittent link Failure overnight. We have been working to move traffic via alternate routes to avoid this instability and despite best efforts we have been unable to make these transitions seamless. Services are currently routed via Wootton and are now showing as stable. We are leaving traffic via this route to ensure stability.
We have been notified that works have concluded and that the hardware has been replaced successfully
Emergency Maintenance Hardware Telehouse North Data Centre - Emergency ALERT.
Please view the details of this emergency maintenance window as this may impact speed performance and network access while networks converge. This is deeply regretful for the late notice of these works and the time remaining within what we deem to be peak time traffic. We have requested works are delayed until after 00:00:00 but our request has been rejected.
Details:
Following an extensive investigation by Telehouse North Edge0 there will be an emergency maintenance window this evening at 11pm so hardware can be replaced. The equipment is being prepared in advance but due to access constraints, this has to be completed at 11pm this evening. Service downtime and/or disruption experienced is expected to be less than 30 minutes for customers directly connected to this equipment. All other customers may experience a brief disruption as the network re-converges, although we will minimise this by routing traffic away from the device in advance.
We remain on backup and are also monitoring the Main link which appears to have stabilised. Once we are happy that this has remained stable for an extensive period traffic will be moved back to the Main link and normal operations restored.
No incidents reported
No incidents reported
No incidents reported
No incidents reported
No incidents reported
No incidents reported
We have been notified by monitoring of connection issues with certain services.
Our support Networks are impacted at present.
This incident is now marked as resolved. Anyone still experiencing connection issues is advised to contact our customer services team.
100% of the traffic is now working as expected. We continue to monitor this very closely.
95% of traffic is now reaching its destination. We continue to work to restore the remaining links.
We are moving affected traffic via an alternate transit route as quickly as possible. More sites will become reachable as traffic is moved but this is a manual process so does take time. Updates to follow
Access to certain sites continues to be sporadic. Updates to follow
Reminder: Our customer services team are doing all they can to keep customers informed and we understand frustrations at this time however we will not tolerate offensive language or abuse towards our team. Any further updates will be posted via this page
We have been notified that Issues have reoccurred elsewhere. We are now back to Performance issues network-wide at present.
We are now seeing normal traffic levels in areas other than Liverpool which remains an issue. We are currently investigating why this is the case
Customer services are now back in full operation. There will continue to be extended hold times whilst our team work through calls as quickly as possible.
Customers are advised NOT to Factory reset their routers. This will lead to longer periods of downtime. Please leave all equipment on at power for quicker restoration times.
A transit peer issue means that customers are unable to access certain parts of the internet. This internet issue is impacting our customer services team leading to long call hold times and slower responses to chats and emails. We are currently activating backup services to bring customer services back to full operation however this issue is expected to be resolved very quickly as this is impacting a large number of ISP's in Telehouse North
We have been informed of an issue with a major edge router in Telehouse North. This is impacting a wide range of services for a range of ISPs stationed within Telehouse North