Incident Overview

Open incidents

5+2

Error rate

4.7%+3.1%

p99 latency

842ms+210ms

Uptime (30d)

99.94%-0.02%

Request volume

requests / min · last 40 min

OKErrors
-40m-30m-20m-10mnow

Active incidents

6 total
  • INC-4821

    Elevated 5xx on checkout API

    payments-gateway

  • INC-4820

    Redis connection pool exhaustion

    session-store

  • INC-4818

    p99 latency regression after deploy

    search-indexer

  • INC-4815

    Kafka consumer lag above threshold

    events-pipeline

  • INC-4809

    Intermittent DNS resolution failures

    edge-proxy

  • INC-4802

    Disk usage approaching capacity

    metrics-db

AI log recommendations

beta
  • payments-gateway

    Downstream timeout to Stripe cascading into 5xx

    94%confidence

    Error signature spiked immediately after the 14:02 deploy. 87% of failing requests share the same upstream timeout to api.stripe.com.

    ERROR upstream_timeout dur=30011ms host=api.stripe.com trace=9f2a…c1
  • session-store

    Connection pool saturated — raise max clients

    81%confidence

    Redis client waits exceed pool size (50/50 in use). Correlated with a 3x traffic increase from the marketing campaign.

    WARN pool_exhausted waiting=128 max=50 acquired=50
  • search-indexer

    GC pauses driving p99 latency regression

    68%confidence

    Full GC frequency doubled after the heap size change. Suggest reverting -Xmx or enabling G1GC.

    INFO gc pause=612ms type=full heap=7.8G/8G