Just to close the loop, this setting works but my specific problem here was the timeout server directive on the load balancer being set to 600s. So the load balancer kept the connection open for 10 mins, whether it is used or not.
Solution? Scrap the cloud managed load balancer and deploy your own instance of HA proxy, and everything looks much better now.