Northflank - Metrics ingestion and query outage – Incident details

Metrics ingestion and query outage

ResolvedPartial outage 50%2 hours 16 minutes

Affected

Northflank Platform

Operational from 10:00 PM to 11:16 PM, Partial outage from 11:16 PM to 12:16 AM

Logs and Metrics

Operational from 10:00 PM to 11:16 PM, Partial outage from 11:16 PM to 12:16 AM

  • ResolvedUTC

    The ingestion rate has been stable for 30 minutes and historic writes have caught up.

    We sincerely apologise for the service disruption you may have experienced. We are investigating the root cause to prevent similar issues in the future.

  • MonitoringUTC

    The fix has been rolled out and we are currently monitoring the ingestion rate and catch-up.

  • IdentifiedUTC

    Metrics query and ingestion are currently affected. Logs are unaffected.

    We are currently applying a fix for the issue and monitoring the results.