ALL
POSTS
41 posts so far.
Our AI Rate Limiter Decided 0 Requests Per Second Was the Correct Limit at 2 AM
We built an AI-powered adaptive rate limiter that monitored traffic patterns and adjusted limits automatically. At 2:07 AM on a Saturday, it analyzed an anomalous traffic spike, classified it as a DDoS attack, and set our public API rate limit to 0 requests per second. It was our own mobile app doing a scheduled sync.
We Let Claude Write Our Database Migrations — Here's What It Silently Deleted
We used Claude to clean up deprecated columns from our users table. The migration ran in 180ms. What we didn't know: a billing service in a separate repo was still reading those columns. 3,200 invoices went out with blank shipping addresses before anyone noticed. Recovery took 14 hours.
We Asked GPT-4 to Review Our Pull Requests for 30 Days — It Approved the Bug That Took Down Prod
We integrated GPT-4 as an automated code reviewer into our GitHub Actions pipeline. Over 30 days it caught 61 real issues. Then it approved a subtle auth bypass that left 23 admin routes unprotected for 11 days — because the bug lived across three files that were never in the diff.
Our Next.js Middleware Silently Bypassed Auth on 23 Admin Routes for 11 Days
After migrating to Next.js 15 App Router, our JWT verification middleware silently failed on Edge Runtime — leaving 23 admin API routes accessible without a valid token for 11 days before a security audit caught it.
One kafka-consumer-groups.sh Command Sent $180k in Duplicate Payments
A single Kafka offset reset to --to-earliest replayed 3 hours of payment events on a live consumer group. Here is exactly what happened and how we fixed it.
The CodePush Update That Silently Bricked 40,000 React Native Users for 72 Hours
We pushed a JavaScript bundle via CodePush — no app store review, instant delivery, zero validation. By the time Sentry caught it, 40,000 users had a white screen and no clean rollback path existed.
We Set temperature=0 and GPT-4 Still Gave Different Answers — Our Entire CI Pipeline Broke
We built an automated code review pipeline that used GPT-4 with temperature=0 to enforce consistent output. After OpenAI silently updated the model behind the same API endpoint, our determinism assumption collapsed — tests started flipping between pass and fail on identical inputs, and we couldn't reproduce failures locally.
Our Blue-Green Deploy Corrupted 3,200 Records in 11 Minutes
We had blue-green deployments, health checks, and automatic rollbacks. Then a single column rename executed during the deploy window and our old containers spent 11 minutes writing to a column that no longer existed.
PAGE 2 / 6 · 41 POSTS