Past Incidents

Thursday 4th May 2023

No incidents reported

Wednesday 3rd May 2023

No incidents reported

Tuesday 2nd May 2023

No incidents reported

Monday 1st May 2023

Web Isolation Some domains may be miscategorized

May 2 2023 03:10 UTC: We are investigating the miscategorization of some URLs, particularly in EMEA/APAC regions. We are working with our partners to implement a fix

Update 03:25 UTC: We are beginning to see initial signs of recovery as we work with our partner to mitigate the issue. We will continue to monitor and ensure full recovery.

Update 03:45 UTC: We are continuing to see recovery of the impacted URL categorizations.

Update 04:00 UTC: We have mitigated the URL categorization issues with our partner.

Sunday 30th April 2023

No incidents reported

Saturday 29th April 2023

Web Isolation Investigating performance issues in us-east-1

We received reports from customers of potential performance issues in us-east-1 and we are actively investigating

Update 2023-04-30 22:20 UTC: we applied configuration updates to our egress nodes in all regions and we also refreshed our isolation containers in the US to remove any unhealthy nodes. Metrics indicate the performance issues are resolved and service is back to operational.

Update 2023-04-30 08:55 UTC: we identified a set of configuration that weren't correctly applied in a few of our egress clusters. We are actively working to correctly apply the configuration, prioritizing the clusters that are seeing timeouts.

Update 23:32 UTC: We did identify a change that corresponds with the initial timeline of events. We reverted the change but this did not resolve the issue. We've continuing to investigate the issue.

Update 22:31:00 UTC: We've determined isolation in us-west-1 and us-east-1 are getting page timeouts. Investigation is still ongoing.

Web Isolation Some websites may be misclassified

We have received reports that some web sites may be misclassified. We are investigating.

Update 14:45:23 UTC: We are still investigating the root cause of the classification errors for some sites.

Update 16:15 UTC: We have identified the root cause and are working with our partners to resolve the url categorization issues.

Update 16:23 UTC: We have confirmed that this issue is only impacting a subset of URLs for categorization in EMEA and APAC regions. We are continuing to work with our partners to resolve the issue.

Update 18:00 UTC: We continue working with our partners to resolve the URL classification issue in EMEA and APAC regions. In the meantime, Menlo is working on a temporary override to mitigate the issue.

Update: 18:20 UTC: The mitigation is now in place, and we've worked with our partners to resolve the original issue. The issue is now considered resolved.

Friday 28th April 2023

No incidents reported