Incidents

Active incidents, recent post-mortems, and the runbook index. Pages on-call, surfaces to the public status page automatically.

1 active

Active1SEV-1 — investigating

Last 30 days3all resolved

MTTR (30d)28 m↓ from 47 m

Uptime99.97%SLO 99.9% · within

Active page on-call · auto-updated

SEV-1 Investigating

status.blun.ai upstream returning 502

Started: 2026-05-06 19:24 CEST · Affected: public status-page only · BLUN portals unaffected · Owner: dieter@blun.ai · Page-out: 19:25

Latest update (19:27): nginx upstream block to status-svc returning 502. Status-svc container restarted. Verifying response now.

Runbook reminder: SEV-1 → page on-call within 5 min · public status update within 15 min · post-mortem within 24 h. Read full runbook →

Recent incidents View archive →

SEV-2

Mailing — delayed delivery to Outlook recipients

Microsoft incoming-mail queue rate-limited a batch from one shared IP. Affected ~1.2% of recipients between 14:08 and 15:42 CET. Migrated affected campaigns to a secondary pool.

Component
Mailing May 294 min Resolved

SEV-3

Reach — ad-set rebalancer paused for 22 minutes

Background worker hit a memory leak after a malformed Google Ads response. Manual budgets continued to work; auto-rebalances were skipped. Hotfix shipped, queued rebalances replayed.

Component
Reach Apr 2422 min Resolved

SEV-3

Listings — ImmoScout sync delay

Upstream ImmoScout API returned 503 for ~40 minutes. New listings queued and replayed once their API recovered. No data loss; no public communication beyond status-page note.

Component
Listings Apr 1139 min Resolved

SEV-3

Auth — sporadic 5xx on /api/auth/forgot

Stale DB connection pool after a routine restart caused ~2.4% of forgot-password requests to 502. Pool size + idle-recycle tuned. No accounts compromised.

Component
Auth & Billing Mar 1814 min Resolved

Post-mortems last 90 days

SEV-2

PM-2026-05-02 · Outlook deliverability deferral

Root cause: shared-pool reputation drop after a customer's high-volume send. Action items: (1) per-customer rate-limit on shared pool · (2) auto-migration to dedicated IP at threshold · (3) inbox-rotation for Microsoft. Read PM →

Owner
otto May 3 Action items

SEV-3

PM-2026-04-24 · Reach worker OOM

Root cause: unbounded buffer when Google Ads response was malformed. Action items: (1) bounded buffer · (2) malformed-input fallback · (3) memory budget alerts. All shipped. Read PM →

Owner
frida Apr 25 Closed