# Dgraph Helm Data Migration **URL:** \ **Category:** Dgraph\ **Tags:** kind:question\ **Created:** [February 1, 2021, 6:01pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588 "2021-02-01T18:01:14Z")\ **Posts on this page:** 14\ **Page:** 1
**Author:** ![Thulasidhar-Siva](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/thulasidhar-siva/32/5932_2.png) [@Thulasidhar-Siva](https://discuss.dgraph.io/u/Thulasidhar-Siva)\ **Post date:** [February 1, 2021, 6:01pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/1 "2021-02-01T18:01:14Z")
Hi, I am Running Dgraph on baremetal on version 20.07.3. Now I want to migrate to helm with same version. I started cluster with helm 0.13v chart. Cluster is Working Fine. Is there any thing like We need to use particular chart for particular dgraph version? Now my question is, how to replace my existing data which is on baremetal to data which is on helm. Thanks ---
**Author:** ![MichelDiz](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/micheldiz/32/11873_2.png) [@MichelDiz](https://discuss.dgraph.io/u/MichelDiz)\ **Post date:** [February 1, 2021, 8:39pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/2 "2021-02-01T20:39:37Z")
> [@Thulasidhar-Siva](#): > > Is there any thing like We need to use particular chart for particular dgraph version? Do you mean start the cluster with 20.07.3 instead of latest? You can do ```auto helm install my-release dgraph/dgraph --set image.tag="v20.07.3" ``` > [@Thulasidhar-Siva](#): > > Now my question is, how to replace my existing data which is on baremetal to data which is on helm. Export it and use Liveload to migrate. [https://dgraph.io/docs/deploy/dgraph-administration/#exporting-database](https://dgraph.io/docs/deploy/dgraph-administration/#exporting-database) ---
**Author:** ![Thulasidhar-Siva](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/thulasidhar-siva/32/5932_2.png) [@Thulasidhar-Siva](https://discuss.dgraph.io/u/Thulasidhar-Siva)\ **Post date:** [February 2, 2021, 6:41am UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/3 "2021-02-02T06:41:53Z")
Hi Michel, I Have One Doubt, In bare metal i am running V20.07.3, In Helm also the same version - why need to live load again. Copy/paste data directories won’t work in helm? ---
**Author:** ![MichelDiz](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/micheldiz/32/11873_2.png) [@MichelDiz](https://discuss.dgraph.io/u/MichelDiz)\ **Post date:** [February 2, 2021, 4:31pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/4 "2021-02-02T16:31:52Z")
> [@Thulasidhar-Siva](#): > > Copy/paste data directories won’t work in helm? It should. ---
**Author:** ![Thulasidhar-Siva](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/thulasidhar-siva/32/5932_2.png) [@Thulasidhar-Siva](https://discuss.dgraph.io/u/Thulasidhar-Siva)\ **Post date:** [February 2, 2021, 4:57pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/5 "2021-02-02T16:57:16Z")
But in my case it is showing error. Alpha pod is crashing. It is showing failed to create badger… ---
**Author:** ![MichelDiz](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/micheldiz/32/11873_2.png) [@MichelDiz](https://discuss.dgraph.io/u/MichelDiz)\ **Post date:** [February 2, 2021, 5:01pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/6 "2021-02-02T17:01:11Z")
Doing migrations with the files itself is a bit different and not safe. That’s why we don’t recommend this approach in docs - But it is the same as the bulkload approach(which is copy paste the output). In general, if the versions are the same. You should try to start the helm cluster without any dgraph instance running. That’s the challenger. And also clean any artifact left(files like locks, postings, and so on). After you copy the files to the volume, you could start the cluster. ---
**Author:** ![Thulasidhar-Siva](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/thulasidhar-siva/32/5932_2.png) [@Thulasidhar-Siva](https://discuss.dgraph.io/u/Thulasidhar-Siva)\ **Post date:** [February 2, 2021, 5:14pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/7 "2021-02-02T17:14:08Z")
Thanks Michel. So we can do bulk load with data & schema files in helm charts. If possible then how to do. ---
**Author:** ![MichelDiz](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/micheldiz/32/11873_2.png) [@MichelDiz](https://discuss.dgraph.io/u/MichelDiz)\ **Post date:** [February 2, 2021, 5:16pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/8 "2021-02-02T17:16:26Z")
I don’t know. In a usual k8s cluster, you can just do cp to the volume. Like I did here [GitHub - MichelDiz/Dgraph-Bulk-Script: Just a simple Sh to use Dgraph's Bulk Loader.](https://github.com/MichelDiz/Dgraph-Bulk-Script) - but the helm chart is different and I never tried to do the same. @joaquin can help there. In my repo, what I did was just add a script to “wait” for the files. And then start the cluster. ---
**Author:** ![Thulasidhar-Siva](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/thulasidhar-siva/32/5932_2.png) [@Thulasidhar-Siva](https://discuss.dgraph.io/u/Thulasidhar-Siva)\ **Post date:** [February 2, 2021, 5:19pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/9 "2021-02-02T17:19:04Z")
Yeah It is working fine with Kubernetes. When I repeat the same thing copy/paste in helm, I am facing error. ---
**Author:** ![Thulasidhar-Siva](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/thulasidhar-siva/32/5932_2.png) [@Thulasidhar-Siva](https://discuss.dgraph.io/u/Thulasidhar-Siva)\ **Post date:** [February 2, 2021, 5:21pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/10 "2021-02-02T17:21:38Z")
Thanks Michel for continuous support. ---
**Author:** ![joaquin](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/joaquin/32/2619_2.png) [@joaquin](https://discuss.dgraph.io/u/joaquin)\ **Post date:** [February 3, 2021, 7:46am UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/11 "2021-02-03T07:46:26Z")
Bulk Loader is an _offline process_ that needs to happen before Dgraph Alpha starts up (and thus where there is no existing **`p`** directory). In Kubernetes, you achieve this with an init container. I documented the process with bulk loader with Kubernetes using helm chart for deployment below: - [Dgraph Helm Data Migration - #13 by joaquin](http://discuss.hypermode.com/t/dgraph-helm-data-migration/12588/13) Note on the process I documented, this is an easy approach, where bulk loader operation is run redundantly inside each of the Dgraph Alpha pod’s init container. The bulk load really only needs to be done once to create the **`p`** directory. So, if you did bulk load somewhere else, let’s call this the _bulk load workstation_, you can then just copy the resulting **`p`** directory from the _bulk load workstation_ to the Dgraph Alpha pod’s init container as they startup up sequentially. Another approach is to use live loader, which is an _online process_ where the Dgraph Alpha container is already running with an existing **`p`** directory. For this, you can use `kubectl port-forward` command to map the necessary ports to localhost. Let me know if you want help with the live loader process. ---
**Author:** ![Thulasidhar-Siva](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/thulasidhar-siva/32/5932_2.png) [@Thulasidhar-Siva](https://discuss.dgraph.io/u/Thulasidhar-Siva)\ **Post date:** [February 3, 2021, 7:43pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/12 "2021-02-03T19:43:37Z")
Thanks a lot, will revert back if any query. ---
**Author:** ![joaquin](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/joaquin/32/2619_2.png) [@joaquin](https://discuss.dgraph.io/u/joaquin)\ **Post date:** [February 3, 2021, 7:48pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/13 "2021-02-03T19:48:58Z")
I just realized that I dropped these awesome instructions in a private thread, so pasting it below in case others may have similar questions on this topic. * * * Generally speaking for deploying dgraph with **`helm`** , you would use an _init container_ where you can populate the **`p`** directory before Dgraph alpha pods start. > NOTE: The process below assumes a single shard (group 1) cluster, using the default helm chart values that create alpha-0, alpha-1, alpha-2. Overview of Helm Chart is here: - [dgraph 25.0.0-preview6 · helm/dgraph](https://artifacthub.io/packages/helm/dgraph/dgraph) ## Process Do this process for every alpha pod, e.g. alpha-0, alpha-1, alpha-2: 1. Deploy Dgraph with **`initContainers`** enabled (the other init container default settings are unchanged): ```bash helm repo add dgraph https://charts.dgraph.io helm install "my-release" \ --set alpha.initContainers.init.enabled=true dgraph/dgraph ``` 2. Optionally, copy files to the Dgraph Alpha pod’s init container with **`kubectl cp`** if needed, e.g. ```bash kubectl cp /path/to/files :/dgraph/ -c ``` 3. Login into the desired Dgraph Alpha pod’s init container: ```bash kubectl exec -ti -c -- bash ``` 4. Inside the Dgraph Alpha pod’s init container, if you didn’t copy required files into the container already, you can do that now or optionally **`curl`** down needed files. Once ready, run **`dgraph bulk`** and then move the resulting directory to the appropriate path, e.g. **`mv /path/to/p /dgraph`**. 5. Inside the Dgraph Alpha pod’s init container, run **`touch /dgraph/doneinit`** to signal that we’re ready to start Dgraph Alpha container and no longer need the init container. 6. Repeat this process for all other alpha pods within this group. You may have to way a few seconds for the initial init container to become available. ### Notes The name of the pods will follow this format below depending on the release name, such as **`my-release`** : - `my-release-dgraph-alpha-0` - `my-release-dgraph-alpha-1` - `my-release-dgraph-alpha-2` You can always list the pod names with **`kubectl get pods`**. For the init container name, it will also be based on the release name, e.g. **`my-release`** : - `my-release-dgraph-alpha-init` Thus putting these together you could exec into the init container on alpha-0 with: ```bash kubectl exec -ti my-release-dgraph-alpha-0 -c my-release-dgraph-alpha-init -- bash ``` You can always get the name of the containers and init containers running in a pod with **`kubectl describe `** Let me know if you need further help. ---
**Author:** ![MichelDiz](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.dgraph.io/micheldiz/32/11873_2.png) [@MichelDiz](https://discuss.dgraph.io/u/MichelDiz)\ **Post date:** [February 3, 2021, 8:10pm UTC](https://discuss.dgraph.io/t/dgraph-helm-data-migration/12588/14 "2021-02-03T20:10:27Z")
One important piece of information related to this matter. You should always use the same zero group in all these steps. Cuz if you start the zero group from scratch, it will lead to conflicting uid leasing and timestamps. Pay attention that the Alphas doesn’t hold any information that belongs to the Zero Group. Two things you can choose to do. 1. Start the Zero group (without the alphas) in k8s and do the bulkload locally if the case, and you’re good to go just copying it to the pods. 2. Start both zero and bulk locally and copy the zero files to the k8s right after.