Past Incidents

• Event : Cable Relocation

• Schedule : February 12, 2023 (Sunday) | 6:00 AM to 01:00 PM (PHT)

• Activity Details : We received a confirmation from our internet service provider that this maintenance activity has been successfully completed. The affected circuit has been and proven to be operation as usual.

• Service Impact : Partial Impact on NCP IPLC Connectivity

• Summary Completion : Completed

• Event : Cable Relocation

• Schedule : February 12, 2023 (Sunday) | 6:00 AM to 01:00 PM (PHT)

• Activity Details : The 3rd party provider from one of our internet service provider will be relocating their cable due to a bridge construction at London. During the maintenance window, there will be a 7-hour downtime on the affected circuit. However due to our network is setup the traffic will be automatically failover to the VPN connection.

• Service Impact : Partial Impact on NCP IPLC Connectivity

[February 11, 2023 | 8:30PM] •• Event : Unplanned |Internet Service Provider Network Outage

• Unscheduled :February 11, 2023 (Saturday) |8:30 PM – Ongoing

• Activity Details : The affected internet circuit uplink is now up and under stability monitoring. We are also following up our ISP for the root cause of the incident. We will update you accordingly.

• Service Impact : Partial Impact on Network and Internet Connectivity

• Status: Restored, For stability monitoring.

• Event : Unplanned |Internet Service Provider Network Outage

• Unscheduled :February 10, 2023 (Friday) | 5:05 PM – 5:48 PM (PHT) - Restored and under stability monitoring

• Activity Details : The affected internet circuit uplink is now up and under stability monitoring. We are also following up our ISP for the root cause of the incident. We will update you accordingly.

• Service Impact : Partial Impact on Network and Internet Connectivity

• Event : Unplanned |Internet Service Provider Network Outage

• Unscheduled : February 10, 2023 (Friday) | 5:05 PM – Ongoing (PHT)

• Activity Details : One of our internet service provider circuit uplink has been monitored down. We already coordinating this incident to our ISP and waiting for the response. But due to the way of our network is setup just a minimal to no impact on network and internet connectivity will be experience as we have another available circuit uplink to carry over the load traffic

• Service Impact : Partial Impact on Network and Internet Connectivity

• Event : Emergency Hardware Replacement

• Schedule : February 09, 2023 (Thursday) | 6:00 PM to 8:30 PM (PHT)

• Activity Details : One of our internet service provider will be conducting an emergency hardware replacement on one of their devices due to identified unstable variable gain optics amplifier component and to prevent a potential breakdown of hardware anytime that could potentially affects our circuit and cause outage. During the maintenance window, a latency increase of 50ms switch hits plus loss of protection is expected.

• Service Impact : Latency Increase and Loss of Protection on Network and Internet Connectivity – All Sites

• Status: Completed Successfully

• Event : Unplanned | Microsoft Teams Service Degradation

• Schedule : February 8, 2023 - 4:25 AM (PHT) - 4:00 PM (PHT)

• Activity Details : Your organization is affected by this event, and some new users attempting to access the Microsoft Teams desktop and web clients, as well as current users attempting to send messages and create or update meetings in all clients, are affected. A portion of infrastructure supporting users' ability to access and send messages in Microsoft Teams is operating below acceptable performance thresholds, resulting in impact.

• Service Impact : Users may be unable to send messages and create or update meetings in all Microsoft Teams connection methods. Additionally, new Microsoft Teams users may be unable to access the Microsoft Teams client in the desktop and web clients.

• Status: Service Restored.

• Final status: Our telemetry indicates that our service has fully recovered after applying various mitigations, such as rerouting affected traffic, and balancing the load. We will continue to monitor the service for an extended period of time to ensure there is no reoccurrence of impact.

• Event : IPLC Connectivity Outage

• Unscheduled : February 04, 2023 (Saturday) | 2:56 AM – 6:28 AM (PHT)

• Activity Details : IPLC has now been monitored up and running for nearly 4 hours. Our internet service provider informed us that the incident was caused by a fiber cable outage on their end. We will continue to monitor circuit stability.

Service Impact : NCP IPLC Connectivity

• Event : IPLC Connectivity Outage

• Unscheduled : February 04, 2023 (Saturday) | 2:56 AM – Ongoing (PHT)

• Activity Details : The NCP IPLC is currently monitored down, and we are working with our internet service provider to further investigate this incident.

Service Impact : NCP IPLC Connectivity

• Event : Server Maintenance Upgrade

• Schedule : February 03, 2023 (Friday) | 4:30 PM to 5:30 PM (PHT) - Cancelled

• Activity Details : Our AWS Domain Controller maintenance activity upgrade has been cancelled due to some technical concern that needs to review and further evaluate to avoid such major risk on our IT Infrastructure.

Service Impact : Empower, ETAP/ATS , Cheer Portal , IPAM Web Portal