Cutting Our P99 Latency in Half with Connection Pooling
We were opening a fresh Postgres connection per request. Here is how a pooler took our P99 from 340ms to 160ms.
Tag
5 posts tagged "backend".
We were opening a fresh Postgres connection per request. Here is how a pooler took our P99 from 340ms to 160ms.
Service-to-service JSON over HTTP was costing us in latency and schema drift. gRPC fixed two problems and created one.
At-least-once delivery means your jobs will run twice. Design for it instead of hoping it won't happen.
A token bucket gives you smooth rate limits with burst tolerance in about a dozen lines. Here is the whole thing.
Long-lived tokens are a liability. We moved to 10-minute access tokens with rotating refresh tokens — here is the tradeoff.