2. Migrate Your Services
Although your services from v1.6 won't work in Rancher v2.x by default, that doesn't mean you have to start again from square one, manually rebuilding your applications in v2.x. To help with migration from v1.6 to v2.x, Rancher has developed a migration tool. The migration-tools CLI is a utility that helps you recreate your applications in Rancher v2.x. This tool exports your Rancher v1.6 services as Compose files and converts them to a Kubernetes manifest that Rancher v2.x can consume.
Additionally, for each Rancher v1.6-specific Compose directive that cannot be consumed by Kubernetes, migration-tools CLI provides instructions on how to manually recreate them in Rancher v2.x.
This command line interface tool will:
Export Compose files (i.e.,
docker-compose.yml
andrancher-compose.yml
) for each stack in your v1.6 Cattle environment. For every stack, files are exported to a unique folder:<EXPORT_DIR>/<ENV_NAME>/<STACK_NAME>
.Parse Compose files that you’ve exported from your Rancher v1.6 stacks and converts them to Kubernetes manifests that Rancher v2.x can consume. The tool also outputs a list of directives present in the Compose files that cannot be converted automatically to Rancher v2.x. These are directives that you’ll have to manually configure using the Rancher v2.x UI.
A. Download the migration-tools CLI
The migration-tools CLI for your platform can be downloaded from our GitHub releases page. The tools are available for Linux, Mac, and Windows platforms.
B. Configure the migration-tools CLI
After you download migration-tools CLI, rename it and make it executable.
Open a terminal window and change to the directory that contains the migration-tool file.
Rename the file to
migration-tools
so that it no longer includes the platform name.Enter the following command to make
migration-tools
executable:chmod +x migration-tools
C. Run the migration-tools CLI
Next, use the migration-tools CLI to export all stacks in all of the Cattle environments into Compose files. Then, for stacks that you want to migrate to Rancher v2.x, convert the Compose files into Kubernetes manifest.
Prerequisite: Create an Account API Key to authenticate with Rancher v1.6 when using the migration-tools CLI.
Export the Docker Compose files for your Cattle environments and stacks from Rancher v1.6.
In the terminal window, execute the following command, replacing each placeholder with your values.
migration-tools export --url http://<RANCHER_URL:PORT> --access-key <RANCHER_ACCESS_KEY> --secret-key <RANCHER_SECRET_KEY> --export-dir <EXPORT_DIR> --all
Step Result: migration-tools exports Compose files (
docker-compose.yml
andrancher-compose.yml
) for each stack in the--export-dir
directory. If you omitted this option, Compose files are output to your current directory.A unique directory is created for each environment and stack. For example, if we export each environment/stack from Rancher v1.6, the following directory structure is created:
export/ # migration-tools --export-dir
|--<ENVIRONMENT>/ # Rancher v1.6 ENVIRONMENT
|--<STACK>/ # Rancher v1.6 STACK
|--docker-compose.yml # STANDARD DOCKER DIRECTIVES FOR ALL STACK SERVICES
|--rancher-compose.yml # RANCHER-SPECIFIC DIRECTIVES FOR ALL STACK SERVICES
|--README.md # README OF CHANGES FROM v1.6 to v2.x
Convert the exported Compose files to Kubernetes manifest.
Execute the following command, replacing each placeholder with the absolute path to your Stack's Compose files. If you want to migrate multiple stacks, you'll have to re-run the command for each pair of Compose files that you exported.
migration-tools parse --docker-file <DOCKER_COMPOSE_ABSOLUTE_PATH> --rancher-file <RANCHER_COMPOSE_ABSOLUTE_PATH>
Note: If you omit the
--docker-file
and--rancher-file
options from your command, migration-tools uses the current working directory to find Compose files.
Want full usage and options for the migration-tools CLI? See the Migration Tools CLI Reference.
migration-tools CLI Output
After you run the migration-tools parse command, the following files are output to your target directory.
Output | Description |
---|---|
output.txt | This file lists how to recreate your Rancher v1.6-specific functionality in Kubernetes. Each listing links to the relevant blog articles on how to implement it in Rancher v2.x. |
Kubernetes manifest specs | Migration-tools internally invokes Kompose to generate a Kubernetes manifest for each service you're migrating to v2.x. Each YAML spec file is named for the service you're migrating. |
Why are There Separate Deployment and Service Manifests?
To make an application publicly accessible by URL, a Kubernetes service is required in support of the deployment. A Kubernetes service is a REST object that abstracts access to the pods in the workload. In other words, a service provides a static endpoint to the pods by mapping a URL to pod(s) Therefore, even if the pods change IP address, the public endpoint remains unchanged. A service object points to its corresponding deployment (workload) by using selector labels.
When a you export a service from Rancher v1.6 that exposes public ports, migration-tools CLI parses those ports to a Kubernetes service spec that links to a deployment YAML spec.
Migration Example File Output
If we parse the two example files from Migration Example Files, docker-compose.yml
and rancher-compose.yml
, the following files are output:
File | Description |
---|---|
web-deployment.yaml | A file containing Kubernetes container specs for a Let's Chat deployment. |
web-service.yaml | A file containing specs for the Let's Chat service. |
database-deployment.yaml | A file containing container specs for the MongoDB deployment in support of Let's Chat. |
webLB-deployment.yaml | A file containing container specs for an HAProxy deployment that's serving as a load balancer.1 |
webLB-service.yaml | A file containing specs for the HAProxy service.1 |
1 Because Rancher v2.x uses Ingress for load balancing, we won't be migrating our Rancher v1.6 load balancer to v2.x.
D. Re-Deploy Services as Kubernetes Manifests
Note: Although these instructions deploy your v1.6 services in Rancher v2.x, they will not work correctly until you adjust their Kubernetes manifests.
- Rancher UI
- Rancher CLI
You can deploy the Kubernetes manifests created by migration-tools by importing them into Rancher v2.x.
Receiving an
ImportYaml Error
?Delete the YAML directive listed in the error message. These are YAML directives from your v1.6 services that Kubernetes can't read.
Prerequisite: Install Rancher CLI for Rancher v2.x.
Use the following Rancher CLI commands to deploy your application using Rancher v2.x. For each Kubernetes manifest output by migration-tools CLI, enter one of the commands below to import it into Rancher v2.x.
./rancher kubectl create -f <DEPLOYMENT_YAML_FILE> # DEPLOY THE DEPLOYMENT YAML
./rancher kubectl create -f <SERVICE_YAML_FILE> # DEPLOY THE SERVICE YAML
Following importation, you can view your v1.6 services in the v2.x UI as Kubernetes manifests by using the context menu to select <CLUSTER> > <PROJECT>
that contains your services. The imported manifests will display on the Resources > Workloads and on the tab at Resources > Workloads > Service Discovery. (In Rancher v2.x before v2.3.0, these are on the Workloads and Service Discovery tabs in the top navigation bar.)
What Now?
Although the migration-tool CLI parses your Rancher v1.6 Compose files to Kubernetes manifests, there are discrepancies between v1.6 and v2.x that you must address by manually editing your parsed Kubernetes manifests. In other words, you need to edit each workload and service imported into Rancher v2.x, as displayed below.
As mentioned in Migration Tools CLI Output, the output.txt
files generated during parsing lists the manual steps you must make for each deployment. Review the upcoming topics for more information on manually editing your Kubernetes specs.
Open your output.txt
file and take a look at its contents. When you parsed your Compose files into Kubernetes manifests, migration-tools CLI output a manifest for each workload that it creates for Kubernetes. For example, our when our Migration Example Files are parsed into Kubernetes manifests, output.txt
lists each resultant parsed Kubernetes manifest file (i.e., workloads). Each workload features a list of action items to restore operations for the workload in v2.x.
The following table lists possible directives that may appear in output.txt
, what they mean, and links on how to resolve them.
Directive | Instructions |
---|---|
ports | Rancher v1.6 Port Mappings cannot be migrated to v2.x. Instead, you must manually declare either a HostPort or NodePort, which are similar to Port Mappings. |
health_check | The Rancher v1.6 health check microservice has been replaced with native Kubernetes health checks, called probes. Recreate your v1.6 health checks in v2.0 using probes. |
labels | Rancher v1.6 uses labels to implement a variety of features in v1.6. In v2.x, Kubernetes uses different mechanisms to implement these features. Click through on the links here for instructions on how to address each label. io.rancher.container.pull_image: In v1.6, this label instructed deployed containers to pull a new version of the image upon restart. In v2.x, this functionality is replaced by the imagePullPolicy directive.io.rancher.scheduler.global: In v1.6, this label scheduled a container replica on every cluster host. In v2.x, this functionality is replaced by Daemon Sets. io.rancher.scheduler.affinity: In v2.x, affinity is applied in a different way. |
links | During migration, you must create links between your Kubernetes workloads and services for them to function properly in v2.x. |
scale | In v1.6, scale refers to the number of container replicas running on a single node. In v2.x, this feature is replaced by replica sets. |
start_on_create | No Kubernetes equivalent. No action is required from you. |