How to achieve high throughput in KONG Gateway?

We are trying to setup kong gateway on AWS, and while perf testing maximum throughput we could achieve was 11k for 1000 concurrency. We did increase the concurrency till 3000 but don’t see any increase in the throughput further.

What are the things we should look at or configure in KONG to achieve high throughput(30k reqs/sec).

Generally, higher throughput is achieved by placing some sort of low-latency load balancer in front of a set of kong data plane servers, ideally with separation of the data plane and control planes. That load balancer can be anything from a cloud load balancer like an AWS ALB, to a Palo Alto or F5 device on-premise.

1 Like