Feature: Multi-cluster resources migration by karmada

[pidb]

💡 Hi, guys, I want to discuss about the use of karmada to migrate resources, the general idea is as follows:

1. We have two clusters (such as Alibaba Cloud and Huawei Cloud) and want to migrate resources on Alibaba Cloud to Huawei Cloud cluster. We know that karmada can do multi-cluster resource distribution and scheduling.
2. Through karmada, we need to write a lot of propagation policies. But in our scenario, we need to migrate the resources of the entire cluster, so there is no need to write a propagation policy, only a very simple migration, such as karmada migration foo-cluster or write a migration CRD?

What really makes this migration difficult is:

1. Migration of stateful services, such as Statefulset
2. Hot/live migration, without interruption of service. (provided that the cluster to be migrated is unscheduler, by karmada cordon foo-cluster.
3. Global cluster migration, such as migrating from AWS to Huawei Cloud.

[RainbowMango]

I'm sure it's a reasonable feature. I suppose you can lead the effort :)

[pidb]

Thanks, I am designing a proposal for this.

[jrkeen]

velero is a tool to back up and restore Kubernetes cluster resources and persistent volumes. Is it feasible for velero as a Karmada plugin?

[GitHubxsy]

Good idea. Deeper integration of Kamrada and velero

step1：Distribute velero-related crd through karmada for backup.
step2：Distribute velero-related crd through karmada for restore.
step3：...(I have no idea)..

[GitHubxsy]

This feature is so cool！！！

[nevermore-muyi]

This feature is so cool！！

[neujie]

So cool for it.
@jrkeen @algebra2k @RainbowMango @GitHubxsy @nevermore-muyi
Maybe define a set of APIs in karmada is a good way.
I have an idea, and look forward to discussing with you.

1. We define a set of CRs, such as Backup、Restore、Migration in Karmada;
2. Add a data controller in Karmada controller;
3. Create CRs, after successfully adding the K8S cluster;
4. Deploy data protection system, such as velero/portworx;
5. Deploy a CR controller(user define) to convert CRs to data protection system APIs.

We use velero as the default data protection system in karmada.

[GitHubxsy]

What are the capabilities of the data controller ?

[neujie]

1. Create CRs, after successfully adding the K8S cluster;
2. Sync operation status, such as Backup、Restore、Migration、Vault 、...

As we discuss, its functions can continue to be enriched

[RainbowMango]

Impressive!!! @neujie can we have a talk at the community meeting?

[pidb]

Awesome!! your ideas are surprisingly consistent with ours. We have currently implemented Backup, Restore CR and related controllers on the internal production system. We look forward to discussing with you and building it together.

[RainbowMango]

We have currently implemented Backup, Restore CR and related controllers on the internal production system.

Glad to hear that!!!

Happy New Year! By the way.