use multiple plugins in sidecar installation method

[vet4ka]

Hello
Starting with Argo CD v2.5, installing config management plugins (CMPs) via the argocd-cm ConfigMap is deprecated. Support will be removed in v2.6.
Now I use the argocd-cm method like this:

 - name: vault-plugin-helm-values-ns
    init:
      command: [sh, -c]
      args: ["helm dependency build || true"]
   generate:
     command: ["sh", "-c"]
     args: ["helm template --namespace $ARGOCD_APP_NAMESPACE --release-name $ARGOCD_ENV_RELEASE_NAME . --set argocd.app.namespace=$ARGOCD_ENV_ARGOCD_APP_NAMESPACE --values $ARGOCD_ENV_VALUES_FILE > all.yaml && argocd-vault-plugin generate -s ${ARGOCD_ENV_AVP_SECRET} all.yaml"]

- name: kustomized-helm
   init:
     command: ["/bin/sh", "-c"]
     args: ["helm dependency build || true"]
   generate:
     command: ["/bin/sh", "-c"]
     args: ["helm template --namespace $ARGOCD_APP_NAMESPACE --release-name $ARGOCD_ENV_RELEASE_NAME --include-crds . --set argocd.app.namespace=$ARGOCD_ENV_ARGOCD_APP_NAMESPACE --values $ARGOCD_ENV_VALUES_FILE  > all.yaml && kustomize build -o allkustom.yaml && argocd-vault-plugin generate -s ${ARGOCD_ENV_AVP_SECRET} allkustom.yaml"]
....
....

im try argocd v2.5.9+e5f1194, mount plugins.yaml as a sidecar

apiVersion: v1
kind: ConfigMap
metadata:
  name: cmp-plugin
data:
  plugin.yaml: |
    ---
    apiVersion: argoproj.io/v1alpha1
    kind: ConfigManagementPlugin
    metadata:
      name: argocd-vault-additional-helm
    spec:
      version: v1.0
      allowConcurrency: true
      init:
        command: [sh, -c]
        args: ["helm dependency build || true "]
      generate:
        command: ["sh", "-c"]
        args: ["helm template ${ARGOCD_APP_NAME} -n ${ARGOCD_APP_NAMESPACE} ${ARGOCD_ENV_ADDITIONAL_SPEC} . --set argocd.app.namespace=$ARGOCD_APP_NAMESPACE > all.yaml && argocd-vault-plugin generate -s ${ARGOCD_ENV_AVP_SECRET} all.yaml"]
      discover:
        find:
          command:
            - sh
            - "-c"
            - "find . -name '*.yaml' | xargs -I {} grep \"<path\\|avp\\.kubernetes\\.io\" {} | grep ."
    ---
    apiVersion: argoproj.io/v1alpha1
    kind: ConfigManagementPlugin
    metadata:
      name: kustomized-helm
    spec:
      version: v1.0
      allowConcurrency: true
      init:
        command: ["/bin/sh", "-c"]
        args: ["helm dependency build || true"]
      generate:
        command: ["/bin/sh", "-c"]
        args: ["helm template --namespace $ARGOCD_APP_NAMESPACE --release-name $ARGOCD_ENV_RELEASE_NAME --include-crds . --set argocd.app.namespace=$ARGOCD_ENV_ARGOCD_APP_NAMESPACE --values $ARGOCD_ENV_VALUES_FILE  > all.yaml && kustomize build -o allkustom.yaml && argocd-vault-plugin generate -s ${ARGOCD_ENV_AVP_SECRET} allkustom.yaml"]
      discover:
        find:
          command:
            - sh
            - "-c"
            - "find . -name '*.yaml' | xargs -I {} grep \"<path\\|avp\\.kubernetes\\.io\" {} | grep ."

my cmp container logs:

time="2023-02-03T13:31:42Z" level=info msg="ArgoCD ConfigManagementPlugin Server is starting" built="2023-01-27T23:27:14Z" commit=e5f1194a6de78cc1124179a4c9bb1ae3484fb77d version=v2.5.9+e5f1194
time="2023-02-03T13:31:42Z" level=info msg="argocd-cmp-server v2.5.9+e5f1194 serving on /home/argocd/cmp-server/plugins/argocd-vault-plugin-v1.0.sock"
time="2023-02-03T13:41:42Z" level=info msg="Alloc=7559 TotalAlloc=19750 Sys=29521 NumGC=7 Goroutines=7"
time="2023-02-03T13:51:42Z" level=info msg="Alloc=7561 TotalAlloc=19757 Sys=29521 NumGC=12 Goroutines=7"
time="2023-02-03T14:01:42Z" level=info msg="Alloc=7561 TotalAlloc=19761 Sys=29521 NumGC=16 Goroutines=7"

It is possible using multiple plugin in new version ?
right now I have an empty list of plugins in my ui

[crenshaw-dev]

It is possible to have multiple sidecar plugins!

Removal of support for argocd-cm plugins has been deferred, because we are fixing a few shortcomings of sidecar plugins in 2.6.

1. Sidecar plugins may be specified by name in 2.6.
2. Sidecar plugins will appear in the UI in 2.6.

2.6 is available as a release candidate right now. 2.6.0 will be released next Monday (Feb. 6, 2023).

[phuongnt28]

I'm using the above format for multiple ConfigManagementPlugin. However, there is only 1 plugin shown on the UI. Any way to fix it? Thanks

[bsteinm2]

I am also having this issue! Have you found a solution?

[crenshaw-dev]

The cmp-server component does not support multiple plugins configured in a single sidecar. Each plugin needs its own sidecar, and its own plugin.yaml to configure that sidecar.

This is by design, because it helps enforce filesystem isolation between plugins.

[ArtemShevelyukhin]

Hi, @crenshaw-dev
I am using 2.8.9 version of the Argocd and don't understand how to configure multiple plugins
You says that

Each plugin needs its own sidecar, and its own plugin.yaml to configure that sidecar.

but the doc says that Argo expects only one "plugin.yaml"

Argo CD expects the plugin configuration file to be located at "/home/argocd/cmp-server/config/plugin.yaml" in the sidecar.

So, how to configure multiple cmp ?

[f7o]

"Register" two sidecars, just add two sidecar containers instead of one: https://argo-cd.readthedocs.io/en/stable/operator-manual/config-management-plugins/#register-the-plugin-sidecar

Have two different plugin.yaml files mounted, one to each container.