Cutting Our P99 Latency in Half with Connection Pooling
We were opening a fresh Postgres connection per request. Here is how a pooler took our P99 from 340ms to 160ms.
Tag
#backend
5 posts tagged "backend".
Why We Migrated from REST to gRPC (and What Broke)
Service-to-service JSON over HTTP was costing us in latency and schema drift. gRPC fixed two problems and created one.
Designing an Idempotent Job Queue
At-least-once delivery means your jobs will run twice. Design for it instead of hoping it won't happen.
Rate Limiting with a Token Bucket
A token bucket gives you smooth rate limits with burst tolerance in about a dozen lines. Here is the whole thing.
Securing Our API with Short-Lived JWTs
Long-lived tokens are a liability. We moved to 10-minute access tokens with rotating refresh tokens — here is the tradeoff.