IP white list in Kong using IP restriction plugin ingress-based

I’d like to be able to restrict some ingresses to only accept traffic from a specific set of IPs.

As this set of IPs will be the same for all the required ingresses, I would like to create a ClusterPlugin and associate it only with the required ingress.

Plugin code:

apiVersion: configuration.konghq.com/v1
  kind: KongClusterPlugin
  metadata:
    name: my-ip-restriction
    annotations:
      kubernetes.io/ingress.class: kong
    labels:
      global: "true"
  config:
    allow:
    - <My IP>
  plugin: ip-restriction

Ingress code:

[...]
annotations:
      konghq.com/plugins: my-ip-restriction
[...]

I only associated this plugin with 1 ingress, but the behavior was applied to all ingresses.
I’ve double-checked the configuration, and the plugin only exists in 1 ingress.

So I don’t know what I’ve done wrong or if it’s the expected behavior