Replicate bucket key secrets to namespaces hosting clusters that reference the MedusaConfiguration

[adejanovski]

As the K8ssandraCluster gets created, if there’s a provided medusaConfigurationRef and it is in a different namespace than the K8ssandraCluster, the referenced secret must be duplicated in the K8ssandraCluster namespace with a new name: <cluster-name>-<secret-name>, and the following labels:

      k8ssandra.io/cluster-name: test
      k8ssandra.io/cluster-namespace: k8ssandra-operator
      k8ssandra.io/replicated-by: k8ssandracluster-controller

Labels should be placed on the copied secret using labels.SetReplicatedBy().
This will allow the ReplicatedSecret controller to cleanup any created secret upon deletion.

This secret will then be replicated to all the contexts/namespaces as part of the ReplicatedSecret workflow that’s already implemented in the operator.

Definition of Done

Preview Give feedback

1. The bucket credentials secret referenced in a MedusaConfiguration resource is replicated to the DCs namespaces using ReplicatedSecrets