Waiting-for-db stuck in infinite loop

Installation/Setup
1

Hi
I am trying to setup KONG Control Plane using official helm chart. The wait-for-db init container is getting stuck in infinite loop with the following error repeating.

2023/08/16 20:35:09 [notice] 10307#0: start worker process 10309
Run with --v (verbose) or --vv (debug) for more details
waiting for db
**Error: /usr/local/share/lua/5.1/kong/cmd/start.lua:101: nginx: [warn] the "user" directive makes sense only if the master process runs with super-user privileges, ignored in /tmp/tmp.pGeK9a6zlm/nginx.conf:6**
**Killed**
/16 20:35:21 [debug] 10337#0: [lua] globalpatches.lua:10: installing the globalpatches
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:465: init(): [dns-client] (re)configuring dns client
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:470: init(): [dns-client] staleTtl = 4
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:474: init(): [dns-client] noSynchronisation = nil
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:493: init(): [dns-client] query order = LAST, SRV, A, AAAA, CNAME
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:533: init(): [dns-client] adding A-record from 'hosts' file: localhost = 127.0.0.1
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: localhost = [::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:533: init(): [dns-client] adding A-record from 'hosts' file: kong-helm-release-kong-7cf984f79f-mrtgv = 10.1.4.171
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-allnodes = [fe00::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-allrouters = [fe00::2]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-mcastprefix = [fe00::0]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-localhost = [::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-loopback = [::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-localnet = [fe00::0]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:557: init(): [dns-client] validTtl = nil
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:598: init(): [dns-client] nameserver 10.0.0.10
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:603: init(): [dns-client] attempts = 5
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:610: init(): [dns-client] no_random = true
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:619: init(): [dns-client] timeout = 2000 ms
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:623: init(): [dns-client] ndots = 5
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:638: init(): [dns-client] badTtl = 1 s
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:640: init(): [dns-client] emptyTtl = 30 s
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:465: init(): [dns-client] (re)configuring dns client
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:470: init(): [dns-client] staleTtl = 4
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:474: init(): [dns-client] noSynchronisation = false
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:493: init(): [dns-client] query order = LAST, SRV, A, CNAME
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:533: init(): [dns-client] adding A-record from 'hosts' file: localhost = 127.0.0.1
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: localhost = [::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:533: init(): [dns-client] adding A-record from 'hosts' file: -kong-7cf984f79f-mrtgv = 10.1.4.171
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-allnodes = [fe00::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-allrouters = [fe00::2]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-mcastprefix = [fe00::0]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-localhost = [::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-loopback = [::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-localnet = [fe00::0]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:557: init(): [dns-client] validTtl = nil
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:598: init(): [dns-client] nameserver 10.0.0.10
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:603: init(): [dns-client] attempts = 5
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:610: init(): [dns-client] no_random = true
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:619: init(): [dns-client] timeout = 2000 ms
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:623: init(): [dns-client] ndots = 5
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:638: init(): [dns-client] badTtl = 1 s
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:640: init(): [dns-client] emptyTtl = 30 s
2023/08/16 20:35:21 [debug] 10337#0: [lua] globalpatches.lua:437: randomseed(): seeding PRNG from OpenSSL RAND_bytes()
2023/08/16 20:35:21 [info] 10337#0: [lua] node.lua:289: new(): kong node-id: 9ad2f4ed-af00-432a-914c-88545b3ea6ce
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:465: init(): [dns-client] (re)configuring dns client
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:470: init(): [dns-client] staleTtl = 4
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:474: init(): [dns-client] noSynchronisation = false
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:493: init(): [dns-client] query order = LAST, SRV, A, CNAME
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:533: init(): [dns-client] adding A-record from 'hosts' file: localhost = 127.0.0.1
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: localhost = [::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:533: init(): [dns-client] adding A-record from 'hosts' file: kong-7cf984f79f-mrtgv = 10.1.4.171
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-allnodes = [fe00::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-allrouters = [fe00::2]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-mcastprefix = [fe00::0]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-localhost = [::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-loopback = [::1]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:548: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-localnet = [fe00::0]
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:557: init(): [dns-client] validTtl = nil
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:598: init(): [dns-client] nameserver 10.0.0.10
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:603: init(): [dns-client] attempts = 5
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:610: init(): [dns-client] no_random = true
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:619: init(): [dns-client] timeout = 2000 ms
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:623: init(): [dns-client] ndots = 5
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:638: init(): [dns-client] badTtl = 1 s
2023/08/16 20:35:21 [debug] 10337#0: [lua] client.lua:640: init(): [dns-client] emptyTtl = 30 s
2023/08/16 20:35:21 [debug] 10337#0: [lua] vaults.lua:52: load_vault(): Loading vault: env
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: request-transformer
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: response-transformer
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: request-size-limiting
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: rate-limiting
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:242: loader_fn(): Loading custom plugin entity: 'rate-limiting.ratelimiting_metrics'
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: response-ratelimiting
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: syslog
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: loggly
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: datadog
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: ldap-auth
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: statsd
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: bot-detection
2023/08/16 20:35:21 [debug] 10337#0: [kong] iam-ecs-credentials.lua:40 No ECS environment variables found for IAM
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: aws-lambda
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: request-termination
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: prometheus
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: proxy-cache
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: session
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:242: loader_fn(): Loading custom plugin entity: 'session.sessions'
2023/08/16 20:35:21 [debug] 10337#0: [lua] openssl.lua:5: [acme] using ffi, OpenSSL version linked: 1010114f
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: acme
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:242: loader_fn(): Loading custom plugin entity: 'acme.acme_storage'
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: jwt
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:242: loader_fn(): Loading custom plugin entity: 'jwt.jwt_secrets'
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: acl
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:242: loader_fn(): Loading custom plugin entity: 'acl.acls'
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: correlation-id
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: cors
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: oauth2
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:242: loader_fn(): Loading custom plugin entity: 'oauth2.oauth2_credentials'
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:242: loader_fn(): Loading custom plugin entity: 'oauth2.oauth2_authorization_codes'
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:242: loader_fn(): Loading custom plugin entity: 'oauth2.oauth2_tokens'
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: tcp-log
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: udp-log
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: grpc-web
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: grpc-gateway
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: pre-function
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: post-function
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: azure-functions
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: opentelemetry
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: zipkin
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: file-log
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: http-log
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: key-auth
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:242: loader_fn(): Loading custom plugin entity: 'key-auth.keyauth_credentials'
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: hmac-auth
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:242: loader_fn(): Loading custom plugin entity: 'hmac-auth.hmacauth_credentials'
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: basic-auth
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:242: loader_fn(): Loading custom plugin entity: 'basic-auth.basicauth_credentials'
2023/08/16 20:35:21 [debug] 10337#0: [lua] plugins.lua:284: load_plugin(): Loading plugin: ip-restriction
2023/08/16 20:35:21 [notice] 10337#0: using the "epoll" event method
2023/08/16 20:35:21 [notice] 10337#0: openresty/1.21.4.1
2023/08/16 20:35:21 [notice] 10337#0: OS: Linux 5.15.0-1041-azure
2023/08/16 20:35:21 [notice] 10337#0: getrlimit(RLIMIT_NOFILE): 1048576:1048576
2023/08/16 20:35:21 [notice] 10345#0: start worker processes
2023/08/16 20:35:21 [notice] 10345#0: start worker process 10346
2023/08/16 20:35:36 [notice] 10345#0: signal 17 (SIGCHLD) received from 10346
2023/08/16 20:35:36 [alert] 10345#0: worker process 10346 exited on signal 9
2023/08/16 20:35:36 [notice] 10345#0: start worker process 10347
Run with --v (verbose) or --vv (debug) for more details

waiting for db

Quick help is much appreciated.

2

I got it resolved. It was due to compute resource constraints. You must provide enough compute resources so that kong can start, though the error wasn’t pointing to anything concrete.

Solution:
add resources section to your values.yaml file


image:
  repository: kong
  tag: "3.3"

resources:
  requests:
    memory: "64Mi"
    cpu: "250m"
  limits:
    memory: "512Mi"
    cpu: "500m"

env:
  prefix: /kong_prefix/
  log_level: debug
  ...
  ...