Past Incidents

• Event: Internet Service Provider Router Software Upgrade

• Schedule: November 20, 2022 (Sunday) | 5:00 AM to 10:00 AM (PHT)

• Activity Details: Our internet service provider has been upgraded the software of their networking device successfully. We have tested the affected circuit and has been proven operational.

• Result: Completed.

• Event: Internet Service Provider Router Software Upgrade

• Schedule: November 20, 2022 (Sunday) | 5:00 AM to 10:00 AM (PHT)

• Activity Details: One of our internet service providers will be updating the networking device software to the most recent version.

• Service Impact: During this window time a 1-hour downtime on their circuits is expected. But due to the way our network is setup, there should be partial to NO impact during their maintenance.

• Event: BCP Failover Testing Activity

• Schedule: November 13, 2022 - November 14, 2022 - 10:00 PM - 12:00 AM (PHT)

• Impact: Intermittent LAN and Internet connectivity

• Activity Result: Successfully Completed

[09/11/2022 | 7:13 AM] • Our Internet Service Provider confirmed that the activity had been completed successfully.

[07/11/2022 | 11:30AM] • Third-party circuit provider at IBM office will be performing emergency network maintenance due to software end-of-life. A maximum of 60 minutes downtime is expected during the window between November 8 - 9, 10:00PM to 6:00AM (PHT). Partial to no impact is expected due to having another internet uplink present at the site.

[09/11/2022 | 4:38 PM] • Our internet service provider already completed the restoration of the circuit uplink. We have monitored that the uplink connection is stable. We will request for a RCA from our service provider and will provide it upon your request.

[07/11/2022 | 9:18 PM] • Please be advised that we have monitored one of our circuit uplinks to the Data Center at The Ignacia Place as down. We have raised this to our internet service provider for further investigation.

• Further updates will be provided as soon as they are available.

[05/11/2022 | 10:56 AM] • Please be advised that the Access Point firmware upgrade was completed successfully. During the activity, no problems or alerts were encountered.

[04/11/2022 | 9:51 AM] • Please be advised that on November 5, 2022, we will be performing a firmware upgrade on the wireless devices across the mentioned sites from 10:00 AM to 1:00 PM (PHT). This upgrade is being performed to address the current vulnerability on our access points. During the maintenance, there may be intermittent wireless connectivity.

[3/11/2022 | 5:53 AM PHT] • Please be advised that maintenance was restored around 11:51 PM PHT on November 2, 2022, and that the affected circuit has been checked and found to be operational. The latency of IPLC and VPC is within the normal range. We continue to monitor the circuit stability and are pursuing our ISP for the Reason for Outage (RFO) of this incident.

[2/11/2022 | 8:42 PM] •Please be advised that we have observed that the NCP IPLC Circuit is currently down around 8:42 PM PHT, and we are coordinating with our Service Provider to resolve the issue. Due to the way the network is set up, traffic will automatically failover to the VPN connection and will experience an increase in latency with the NCP VPCs. Will provide updates accordingly.

[2/11/2022 | 11:00 PM] •Please be aware that our provider has detected a major outage in Europe that is affecting your circuit. They have also confirmed that this is a protected service and that the alternate path may have already been impacted by an existing/or ongoing network subsea cable fault, resulting in the protected service being completely unavailable. Our provider team has handled this with the utmost care. An update will be sent once available.

[31/10/2022| 3:20 PM] •Please be advised that the main power supply at Neutrinos building is now back on the main power at exactly 2:57 PM (PHT) . No outstanding issues have been observed related to the maintenance. [31/10/2022| 10:24 AM] •Please be advised that there is an ongoing power outage at Neutrinos Building that occurred at around 10:14 AM (PHT). We’re still in coordination with the building admin to know the details of the power outage. Currently, the building supply is running on genset. We will keep you posted.

[6/11/2022 | 11:56 AM] • Activity: BCP Duration: 10:00 AM to 12:00 PM Status: Successfully Completed

[1/11/2022 | 11:04 AM] • Please be advised for the new schedule of the Infrastructure Risk Analysis and Mitigation Plan at GELDC Building to be conducted on November 06, 2022, from 10:00 am to 12:00 PM as part of our ongoing effort to provide service reliability. The activity’s goal is to simulate BCP failover testing on our site. [30/10/2022 | 6:48 AM] • Due to the current weather conditions and other additional factors, we have decided to postpone this activity to next week. [26/10/2022 | 9:55 AM] • We filed a change request to conduct an Infrastructure Risk Analysis and Mitigation Plan at GELDC Building Pampanga on October 30, 2022 (Sunday) from 10:00 AM to 12:00 PM as part of our ongoing effort to provide service reliability. The activity's goal is to simulate BCP failover testing on our site. The whole site will be experiencing intermittent LAN and internet connectivity during the maintenance period.