I’m using Helm for installing KONG on a cluster, pulling all the images from a private image registry. I’m using Bitnami Kong charts. when I start installing, it stopes and i get a post installment failure due to timeout on a condition.
After I do,
kubectl get pods
my-release-kong-7bfddf4d74-8w479 0/1 CrashLoopBackOff 5 4m55s
my-release-kong-7bfddf4d74-db6x8 0/1 CrashLoopBackOff 5 4m55s
my-release-kong-migrate-b968r 0/1 CrashLoopBackOff 5 4m53s
my-release-postgresql-0 1/1 Running 0 4m55s
when i try to see the events on my cluster i see this (there is more, but these are the ones of interest)
3m18s Normal Created pod/my-release-kong-7bfddf4d74-8w479 Created container kong
3m24s Normal Started pod/my-release-kong-7bfddf4d74-db6x8 Started container kong
3m18s Normal Started pod/my-release-kong-7bfddf4d74-8w479 Started container kong
3m23s Normal Started pod/my-release-kong-migrate-b968r Started container kong-migrate
3m23s Normal Created pod/my-release-kong-migrate-b968r Created container kong-migrate
3m24s Normal Pulled pod/my-release-kong-migrate-b968r Container image “privateregistry/kong:latest” already present on machine
5m1s Normal Pulling pod/my-release-postgresql-0 Pulling image “privateregistry/postgres:9.6”
8s Warning BackOff pod/my-release-kong-7bfddf4d74-db6x8 Back-off restarting failed container
5s Warning BackOff pod/my-release-kong-7bfddf4d74-8w479 Back-off restarting failed container
4m54s Normal Pulled pod/my-release-postgresql-0 Successfully pulled image “privateregistry/postgres:9.6” in 7.040182465s
4m54s Normal Created pod/my-release-postgresql-0 Created container my-release-postgresql
2s Warning BackOff pod/my-release-kong-migrate-b968r Back-off restarting failed container
4m50s Normal Started pod/my-release-postgresql-0 Started container my-release-postgresql
So when i check the logs on the migrate Pod, I see the below error
init_by_lua error: /usr/local/share/lua/5.1/kong/cmd/utils/migrations.lua:16: Database needs bootstrapping or is older than Kong 1.0.
this is my values.yaml
## @section Global parameters
## Global Docker image parameters
## Please, note that this will override the image parameters, including dependencies, configured to use the global value
## Current available global Docker image parameters: imageRegistry, imagePullSecrets and storageClass
## @param global.imageRegistry Global Docker image registry
## @param global.imagePullSecrets Global Docker registry secret names as an array
## @param global.storageClass Global StorageClass for Persistent Volume(s)
##
global:
imageRegistry: "privateRegistry.com"
imagePullSecrets: ['test']
storageClass: ""
kubeVersion: ""
nameOverride: ""
fullnameOverride: ""
commonAnnotations: {}
commonLabels: {}
clusterDomain: cluster.local
extraDeploy: []
diagnosticMode:
enabled: false
command:
- sleep
args:
- infinity
## @section Deployment parameters
image:
registry: privateRegistry.com
repository: repo1/kong
tag: latest
pullPolicy: IfNotPresent
pullSecrets: ['test']
debug: false
database: postgresql
replicaCount: 2
hostAliases: []
## @param updateStrategy.type Set up update strategy for kong installation. Set to Recreate if you use persistent volume that cannot be mounted by more than one pods to makesure the pods is destroyed first.
## ref: https://kubernetes.io/docs/concepts/workloads/controllers/deployment/#strategy
## Example:
## updateStrategy:
## type: RollingUpdate
## rollingUpdate:
## maxSurge: 25%
## maxUnavailable: 25%
##
updateStrategy:
type: RollingUpdate
## @param schedulerName Alternative scheduler
## ref: https://kubernetes.io/docs/tasks/administer-cluster/configure-multiple-schedulers/
##
schedulerName: ""
## @param useDaemonset Use a daemonset instead of a deployment. `replicaCount` will not take effect.
##
useDaemonset: false
## @param extraVolumes Array of extra volumes to be added to the Kong deployment deployment (evaluated as template). Requires setting `extraVolumeMounts`
##
extraVolumes: []
## @param initContainers Add additional init containers to the pod (evaluated as a template)
## e.g.
## - name: your-image-name
## image: your-image
## imagePullPolicy: Always
## ports:
## - name: portname
## containerPort: 1234
##
initContainers: []
## @param sidecars Attach additional containers to the pod (evaluated as a template)
## e.g.
## - name: your-image-name
## image: your-image
## imagePullPolicy: Always
## ports:
## - name: portname
## containerPort: 1234
##
sidecars: []
## SecurityContext configuration
## ref: https://kubernetes.io/docs/tasks/configure-pod-container/security-context/
## @param containerSecurityContext.runAsUser Set Kong container's Security Context runAsUser
## @param containerSecurityContext.runAsNonRoot Set Kong container's Security Context runAsNonRoot
##
containerSecurityContext:
runAsUser: 1001
runAsNonRoot: true
## @param podSecurityContext Pod security context
##
podSecurityContext: {}
## @param nodeSelector Node labels for pod assignment
## Ref: https://kubernetes.io/docs/user-guide/node-selection/
##
nodeSelector: {}
## @param tolerations Tolerations for pod assignment
## Ref: https://kubernetes.io/docs/concepts/configuration/taint-and-toleration/
##
tolerations: []
## @param podAffinityPreset Pod affinity preset. Ignored if `affinity` is set. Allowed values: `soft` or `hard`
## ref: https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#inter-pod-affinity-and-anti-affinity
##
podAffinityPreset: ""
## @param podAntiAffinityPreset Pod anti-affinity preset. Ignored if `affinity` is set. Allowed values: `soft` or `hard`
## Ref: https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#inter-pod-affinity-and-anti-affinity
##
podAntiAffinityPreset: soft
## Node affinity preset
## Ref: https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#node-affinity
##
nodeAffinityPreset:
## @param nodeAffinityPreset.type Node affinity preset type. Ignored if `affinity` is set. Allowed values: `soft` or `hard`
##
type: ""
## @param nodeAffinityPreset.key Node label key to match Ignored if `affinity` is set.
## E.g.
## key: "kubernetes.io/e2e-az-name"
##
key: ""
## @param nodeAffinityPreset.values Node label values to match. Ignored if `affinity` is set.
## E.g.
## values:
## - e2e-az1
## - e2e-az2
##
values: []
## @param affinity Affinity for pod assignment
## Ref: https://kubernetes.io/docs/concepts/configuration/assign-pod-node/#affinity-and-anti-affinity
## Note: podAffinityPreset, podAntiAffinityPreset, and nodeAffinityPreset will be ignored when it's set
##
affinity: {}
## @param podAnnotations Pod annotations
## ref: https://kubernetes.io/docs/concepts/overview/working-with-objects/annotations/
##
podAnnotations: {}
## @param podLabels Pod labels
## Ref: https://kubernetes.io/docs/concepts/overview/working-with-objects/labels/
##
podLabels: {}
(evaluated as a template)
##
autoscaling:
enabled: false
apiVersion: autoscaling/v2beta1
minReplicas: 2
maxReplicas: 5
metrics:
- type: Resource
resource:
name: cpu
targetAverageUtilization: 80
## Kong Pod Disruption Budget
## ref: https://kubernetes.io/docs/concepts/workloads/pods/disruptions/
## @param pdb.enabled Deploy a pdb object for the Kong pod
## @param pdb.maxUnavailable Maximum unavailable Kong replicas (expressed in percentage)
##
pdb:
enabled: false
maxUnavailable: "50%"
## @section Traffic Exposure Parameters
## Service parameters
##
service:
## @param service.type Kubernetes Service type
##
type: ClusterIP
## @param service.clusterIP Cluster internal IP of the service
## This is the internal IP address of the service and is usually assigned randomly.
## ref: https://kubernetes.io/docs/reference/kubernetes-api/service-resources/service-v1/#ServiceSpec
##
clusterIP: ""
## @param service.externalTrafficPolicy external traffic policy managing client source IP preservation
## default to "Cluster"
## set to "Local" in order to preserve the client source IP (only on service of type LoadBalancer or NodePort)
## ref: https://kubernetes.io/docs/tasks/access-application-cluster/create-external-load-balancer/
##
externalTrafficPolicy: ""
## @param service.proxyHttpPort kong proxy HTTP service port port
##
proxyHttpPort: 80
## @param service.proxyHttpsPort kong proxy HTTPS service port port
##
proxyHttpsPort: 443
## @param service.exposeAdmin Add the Kong Admin ports to the service
##
exposeAdmin: true
## @param service.adminHttpPort kong admin HTTPS service port (only if service.exposeAdmin=true)
##
adminHttpPort: 8001
## @param service.adminHttpsPort kong admin HTTPS service port (only if service.exposeAdmin=true)
##
adminHttpsPort: 8444
## @param service.disableHttpPort Disable Kong proxy HTTP and Kong admin HTTP ports
##
disableHttpPort: false
## Specify the nodePort value for the LoadBalancer and NodePort service types.
## ref: https://kubernetes.io/docs/concepts/services-networking/service/#type-nodeport
## @param service.proxyHttpNodePort Port to bind to for NodePort service type (proxy HTTP)
## @param service.proxyHttpsNodePort Port to bind to for NodePort service type (proxy HTTPS)
## @param service.adminHttpNodePort Port to bind to for NodePort service type (admin HTTP)
## @param service.adminHttpsNodePort Port to bind to for NodePort service type (admin HTTPS)
##
proxyHttpNodePort: ""
proxyHttpsNodePort: ""
adminHttpNodePort: ""
adminHttpsNodePort: ""
## @param service.loadBalancerIP loadBalancerIP if kong service type is `LoadBalancer`
## ref: https://kubernetes.io/docs/user-guide/services/#type-loadbalancer
##
loadBalancerIP: ""
## @param service.annotations Annotations for kong service
## set the LoadBalancer service type to internal only.
## ref: https://kubernetes.io/docs/concepts/services-networking/service/#internal-load-balancer
##
annotations: {}
## @param service.extraPorts Extra ports to expose (normally used with the `sidecar` value)
##
extraPorts: []
## Configure the ingress resource that allows you to access the
## Kong installation. Set up the URL
## ref: https://kubernetes.io/docs/user-guide/ingress/
##
ingress:
## @param ingress.enabled Enable ingress controller resource
##
enabled: false
## DEPRECATED: Use ingress.annotations instead of ingress.certManager
## certManager: false
##
## @param ingress.pathType Ingress path type
##
pathType: ImplementationSpecific
## @param ingress.apiVersion Force Ingress API version (automatically detected if not set)
##
apiVersion: ""
## @param ingress.hostname Default host for the ingress resource
##
hostname: kong.local
## @param ingress.path Ingress path
## with ALB ingress controllers.
##
path: /
## @param ingress.annotations Additional annotations for the Ingress resource. To enable certificate autogeneration, place here your cert-manager annotations.
## For a full list of possible ingress annotations, please see
## ref: https://github.com/kubernetes/ingress-nginx/blob/master/docs/user-guide/nginx-configuration/annotations.md
## Use this parameter to set the required annotations for cert-manager, see
## ref: https://cert-manager.io/docs/usage/ingress/#supported-annotations
##
## e.g:
## annotations:
## kubernetes.io/ingress.class: nginx
## cert-manager.io/cluster-issuer: cluster-issuer-name
##
annotations: {}
## @param ingress.tls Create TLS Secret
## TLS certificates will be retrieved from a TLS secret with name: {{- printf "%s-tls" .Values.ingress.hostname }}
## You can use the ingress.secrets parameter to create this TLS secret or relay on cert-manager to create it
##
tls: false
## @param ingress.extraHosts The list of additional hostnames to be covered with this ingress record.
## Most likely the hostname above will be enough, but in the event more hosts are needed, this is an array
## extraHosts:
## - name: kong.local
## path: /
##
extraHosts: []
## @param ingress.extraPaths Additional arbitrary path/backend objects
## For example: The ALB ingress controller requires a special rule for handling SSL redirection.
## extraPaths:
## - path: /*
## backend:
## serviceName: ssl-redirect
## servicePort: use-annotation
##
extraPaths: []
## @param ingress.extraTls The tls configuration for additional hostnames to be covered with this ingress record.
## see: https://kubernetes.io/docs/concepts/services-networking/ingress/#tls
## extraTls:
## - hosts:
## - kong.local
## secretName: kong.local-tls
##
extraTls: []
## @param ingress.secrets If you're providing your own certificates, please use this to add the certificates as secrets
## key and certificate should start with -----BEGIN CERTIFICATE----- or
## -----BEGIN RSA PRIVATE KEY-----
##
## name should line up with a tlsSecret set further up
## If you're using cert-manager, this is unneeded, as it will create the secret for you if it is not set
##
## It is also possible to create and manage the certificates outside of this helm chart
## Please see README.md for more information
## e.g:
## secrets:
## - name: kong.local-tls
## key:
## certificate:
##
##
secrets: []
## @section Kong Container Parameters
kong:
## @param kong.command Override default container command (useful when using custom images)
##
command: []
## @param kong.args Override default container args (useful when using custom images)
##
args: []
## @param kong.initScriptsCM Configmap with init scripts to execute
## ConfigMap containing `/docker-entrypoint-initdb.d` scripts to be executed at initialization time (evaluated as a template)
##
initScriptsCM: ""
## @param kong.initScriptsSecret Configmap with init scripts to execute
## Secret containing `/docker-entrypoint-initdb.d` scripts to be executed at initialization time (that contain sensitive data). Evaluated as a template.
##
initScriptsSecret: ""
## @param kong.extraEnvVars Array containing extra env vars to configure Kong
## For example:
## extraEnvVars:
## - name: GF_DEFAULT_INSTANCE_NAME
## value: my-instance
##
extraEnvVars: []
## @param kong.extraEnvVarsCM ConfigMap containing extra env vars to configure Kong
##
extraEnvVarsCM: ""
## @param kong.extraEnvVarsSecret Secret containing extra env vars to configure Kong (in case of sensitive data)
##
extraEnvVarsSecret: ""
## @param kong.extraVolumeMounts Array of extra volume mounts to be added to the Kong Container (evaluated as template). Normally used with `extraVolumes`.
##
extraVolumeMounts: []
## @param kong.customLivenessProbe Override default liveness probe (kong container)
##
customLivenessProbe: {}
## @param kong.customReadinessProbe Override default readiness probe (kong container)
##
customReadinessProbe: {}
## Configure extra options for liveness probe
## ref: https://kubernetes.io/docs/tasks/configure-pod-container/configure-liveness-readiness-probes/#configure-probes
## @param kong.livenessProbe.enabled Enable livenessProbe
## @param kong.livenessProbe.initialDelaySeconds Initial delay seconds for livenessProbe
## @param kong.livenessProbe.periodSeconds Period seconds for livenessProbe
## @param kong.livenessProbe.timeoutSeconds Timeout seconds for livenessProbe
## @param kong.livenessProbe.failureThreshold Failure threshold for livenessProbe
## @param kong.livenessProbe.successThreshold Success threshold for livenessProbe
##
livenessProbe:
enabled: true
initialDelaySeconds: 120
periodSeconds: 10
timeoutSeconds: 5
failureThreshold: 6
successThreshold: 1
## Configure extra options for readiness probe
## ref: https://kubernetes.io/docs/tasks/configure-pod-container/configure-liveness-readiness-probes/#configure-probes
## @param kong.readinessProbe.enabled Enable readinessProbe
## @param kong.readinessProbe.initialDelaySeconds Initial delay seconds for readinessProbe
## @param kong.readinessProbe.periodSeconds Period seconds for readinessProbe
## @param kong.readinessProbe.timeoutSeconds Timeout seconds for readinessProbe
## @param kong.readinessProbe.failureThreshold Failure threshold for readinessProbe
## @param kong.readinessProbe.successThreshold Success threshold for readinessProbe
##
readinessProbe:
enabled: true
initialDelaySeconds: 30
periodSeconds: 10
timeoutSeconds: 5
failureThreshold: 6
successThreshold: 1
## @param kong.lifecycleHooks Lifecycle hooks (kong container)
## ref: https://kubernetes.io/docs/concepts/containers/container-lifecycle-hooks/
##
lifecycleHooks: {}
## Container resource requests and limits
## ref: https://kubernetes.io/docs/user-guide/compute-resources/
## We usually recommend not to specify default resources and to leave this as a conscious
## choice for the user. This also increases chances charts run on environments with little
## resources, such as Minikube. If you do want to specify resources, uncomment the following
## lines, adjust them as necessary, and remove the curly braces after 'resources:'.
## @param kong.resources.limits The resources limits for the container
## @param kong.resources.requests The requested resources for the container
##
resources:
## Example:
## limits:
## cpu: 500m
## memory: 1Gi
limits: {}
## Examples:
## requests:
## cpu: 100m
## memory: 128Mi
requests: {}
## @section Kong Migration job Parameters
migration:
## In case you want to use a custom image for Kong migration, set this value
## image:
## registry:
## repository:
## tag:
##
## @param migration.command Override default container command (useful when using custom images)
##
command: []
## @param migration.args Override default container args (useful when using custom images)
##
args: []
## @param migration.hostAliases Add deployment host aliases
## https://kubernetes.io/docs/concepts/services-networking/add-entries-to-pod-etc-hosts-with-host-aliases/
##
hostAliases: []
## @param migration.annotations [object] Add annotations to the job
##
annotations:
helm.sh/hook: post-install, post-upgrade
helm.sh/hook-delete-policy: before-hook-creation,hook-succeeded
## @param migration.extraEnvVars Array containing extra env vars to configure the Kong migration job
## For example:
## extraEnvVars:
## - name: GF_DEFAULT_INSTANCE_NAME
## value: my-instance
##
extraEnvVars: []
## @param migration.extraEnvVarsCM ConfigMap containing extra env vars to configure the Kong migration job
##
extraEnvVarsCM: ""
## @param migration.extraEnvVarsSecret Secret containing extra env vars to configure the Kong migration job (in case of sensitive data)
##
extraEnvVarsSecret: ""
## @param migration.extraVolumeMounts Array of extra volume mounts to be added to the Kong Container (evaluated as template). Normally used with `extraVolumes`.
##
extraVolumeMounts: []
## Container resource requests and limits
## ref: https://kubernetes.io/docs/user-guide/compute-resources/
## We usually recommend not to specify default resources and to leave this as a conscious
## choice for the user. This also increases chances charts run on environments with little
## resources, such as Minikube. If you do want to specify resources, uncomment the following
## lines, adjust them as necessary, and remove the curly braces after 'resources:'.
## @param migration.resources.limits The resources limits for the container
## @param migration.resources.requests The requested resources for the container
##
resources:
## Example:
## limits:
## cpu: 500m
## memory: 1Gi
limits: {}
## Examples:
## requests:
## cpu: 250m
## memory: 256Mi
requests: {}
## @section Kong Ingress Controller Container Parameters
ingressController:
## @param ingressController.enabled Enable/disable the Kong Ingress Controller
##
enabled: false
## @param ingressController.customResourceDeletePolicy Add custom CRD resource delete policy (for Helm 2 support)
##
customResourceDeletePolicy: {}
## @param ingressController.image.registry Kong Ingress Controller image registry
## @param ingressController.image.repository Kong Ingress Controller image name
## @param ingressController.image.tag Kong Ingress Controller image tag
## @param ingressController.image.pullPolicy kong ingress controller image pull policy
## @param ingressController.image.pullSecrets Specify docker-registry secret names as an array
##
image:
registry: docker.io
repository: bitnami/kong-ingress-controller
tag: 2.2.0-debian-10-r7
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: https://kubernetes.io/docs/user-guide/images/#pre-pulling-images
##
pullPolicy: IfNotPresent
## Optionally specify an array of imagePullSecrets.
## Secrets must be manually created in the namespace.
## ref: https://kubernetes.io/docs/tasks/configure-pod-container/pull-image-private-registry/
## Example:
## pullSecrets:
## - myRegistryKeySecretName
##
pullSecrets: []
## @param ingressController.proxyReadyTimeout Maximum time (in seconds) to wait for the Kong container to be ready
##
proxyReadyTimeout: 300
## @param ingressController.rbac.create Create the necessary Service Accounts, Roles and Rolebindings for the Ingress Controller to work
## @param ingressController.rbac.existingServiceAccount Use an existing service account for all the RBAC operations
##
rbac:
create: true
existingServiceAccount: ""
## @param ingressController.ingressClass Name of the class to register Kong Ingress Controller (useful when having other Ingress Controllers in the cluster)
##
ingressClass: kong
## @param ingressController.command Override default container command (useful when using custom images)
##
command: []
## @param ingressController.args Override default container args (useful when using custom images)
##
args: []
## @param ingressController.extraEnvVars Array containing extra env vars to configure Kong
## For example:
## extraEnvVars:
## - name: GF_DEFAULT_INSTANCE_NAME
## value: my-instance
##
extraEnvVars: []
## @param ingressController.extraEnvVarsCM ConfigMap containing extra env vars to configure Kong Ingress Controller
##
extraEnvVarsCM: ""
## @param ingressController.extraEnvVarsSecret Secret containing extra env vars to configure Kong Ingress Controller (in case of sensitive data)
##
extraEnvVarsSecret: ""
## @param ingressController.extraVolumeMounts Array of extra volume mounts to be added to the Kong Ingress Controller container (evaluated as template). Normally used with `extraVolumes`.
##
extraVolumeMounts: []
## @param ingressController.customLivenessProbe Override default liveness probe (kong ingress controller container)
##
customLivenessProbe: {}
## @param ingressController.customReadinessProbe Override default readiness probe (kong ingress controller container)
##
customReadinessProbe: {}
## Configure extra options for liveness probe
## ref: https://kubernetes.io/docs/tasks/configure-pod-container/configure-liveness-readiness-probes/#configure-probes
## @param ingressController.livenessProbe.enabled Enable livenessProbe
## @param ingressController.livenessProbe.initialDelaySeconds Initial delay seconds for livenessProbe
## @param ingressController.livenessProbe.periodSeconds Period seconds for livenessProbe
## @param ingressController.livenessProbe.timeoutSeconds Timeout seconds for livenessProbe
## @param ingressController.livenessProbe.failureThreshold Failure threshold for livenessProbe
## @param ingressController.livenessProbe.successThreshold Success threshold for livenessProbe
##
livenessProbe:
enabled: true
initialDelaySeconds: 120
periodSeconds: 10
timeoutSeconds: 5
failureThreshold: 6
successThreshold: 1
## Configure extra options for readiness probe
## ref: https://kubernetes.io/docs/tasks/configure-pod-container/configure-liveness-readiness-probes/#configure-probes
## @param ingressController.readinessProbe.enabled Enable readinessProbe
## @param ingressController.readinessProbe.initialDelaySeconds Initial delay seconds for readinessProbe
## @param ingressController.readinessProbe.periodSeconds Period seconds for readinessProbe
## @param ingressController.readinessProbe.timeoutSeconds Timeout seconds for readinessProbe
## @param ingressController.readinessProbe.failureThreshold Failure threshold for readinessProbe
## @param ingressController.readinessProbe.successThreshold Success threshold for readinessProbe
##
readinessProbe:
enabled: true
initialDelaySeconds: 30
periodSeconds: 10
timeoutSeconds: 5
failureThreshold: 6
successThreshold: 1
## Container resource requests and limits
## ref: https://kubernetes.io/docs/user-guide/compute-resources/
## We usually recommend not to specify default resources and to leave this as a conscious
## choice for the user. This also increases chances charts run on environments with little
## resources, such as Minikube. If you do want to specify resources, uncomment the following
## lines, adjust them as necessary, and remove the curly braces after 'resources:'.
## @param ingressController.resources.limits The resources limits for the container
## @param ingressController.resources.requests The requested resources for the container
##
resources:
limits: {}
requests: {}
postgresql:
enabled: true
volumeMounts:
mountPath: /var/lib/postgresql/data
name: data-my-release-postgresql-0
image:
registry: privateRegistry.com
repository: repo1/postgres
tag: 9.6
pullPolicy: IfNotPresent
pullSecrets: ['test']
usePasswordFile: false
external:
chart
postgresqlUsername: kong
cassandra:
enabled: false
dbUser:
user: kong
usePasswordFile: false
external:
existingSecret: ""
metrics:
enabled: false
service:
annotations:
prometheus.io/scrape: "true"
prometheus.io/port: "{{ .Values.metrics.service.port }}"
prometheus.io/path: "/metrics"
type: ClusterIP
port: 9119
serviceMonitor: