Logging ingestion delays in US regions Tuesday 14th February 2023 08:16:00

We are currently experiencing a service disruption impacting the Menlo Security logging service that started at 14:09 UTC.

Customers may experience delays in new logs being available.

Update 1800 UTC TechOps has added additional capacity to address an increase in log ingest volume. The log ingest delay backlog is shrinking.

Update 1900 UTC TechOps has added additional capacity to address an increase in log volume. TechOps and Engineering continue to monitor the delayed log volume. Only a subset of customers will be impacted by the delay.

Update 2000 UTC The log ingest backlog is being processed and the backlog is decreasing. Engineering is investigating some failed ingest tasks. Next update to be provided in an hour.

Update 2100 UTC The log ingest backlog is being processed and the backlog is decreasing. Next update to be provided in an hour.

Update 2300 UTC The log ingest backlog has been processed. Engineering is performing a data consistency check across our log storage platform.

Update 2359 UTC The log ingest backlog has been cleared in both US log regions. Incident is closed.