PgBouncer is single-threaded. A single process uses one CPU core, no matter how many the machine has. On a 16-vCPU box that means one core does all the connection pooling while the other fifteen sit idle, and the pooler starts capping throughput long before Postgres runs out of room. In ClickHouse Managed Postgres we run a fleet of PgBouncer processes, sized proportional to the available cores. Every process in the fleet binds the same port with so_reuseport enabled. The kernel load-balances incoming connections across the processes, so clients still connect to a single endpoint and never know there is more than one PgBouncer behind it. This is the mechanism PgBouncer’s own docs point to for using more than one core: it is single-threaded per process, and so_reuseport is how you put every…
We scaled PgBouncer to 4x throughput
Advertisement