How to create a Swarm cluster with Docker
March 29, 2015 Editor 0
Editor’s note: this is an Early Release excerpt from Chapter 7 of Docker Cookbook by Sébastien Goasguen. The recipes in this book will help developers go from zero knowledge to distributed applications packaged and deployed within a couple of chapters. One of the key value propositions of Docker is app portability. The following will show you how to use Docker Machine to create a Swarm cluster across cloud providers.
You understand how to create a Swarm cluster manually (see Recipe 7.3), but you would like to create one with nodes in multiple public Cloud Providers and keep the UX experience of the local Docker CLI.
Use Docker Machine to start Docker hosts in several Cloud providers and bootstrap them automatically to create a swarm cluster.
This is an experimental feature in Docker Machine and is subject to change.
The first thing to do is to obtain a swarm discovery token. This will be used during the bootstrapping process when starting the nodes of the cluster. As explained in Recipe 7.3, swarm features multiple discovery process. In this recipe, we used the service hosted by Docker, Inc. A discovery token is obtained by running a container based on the swarm image and running the
createcommand. Assuming we do not have access to a Docker host already, we use
docker-machineto create one solely for this purpose.
With the token in hand, we can use
docker-machineand multiple public Cloud drivers to start worker nodes. We can start a swarm head node on VirtualBox, a worker on DigitalOcean and another one on Azure.
Do not start a swarm head in a public cloud and a worker on your localhost with VirtualBox. Chances are the head will not be able to route network traffic to your local worker node. It is possible to do, but you would have to open ports on your local router.
Your swarm cluster is now ready. Your swarm head node is running locally in a Virtualbox VM, one worker node is running in DigitalOcean and another one in Azure. You can set the local
docker-machinebinary to use the head node running in VirtualBox and start using the swarm subcommands:
If you start a container, swarm will schedule it in round-robin fashion on the cluster. For example, starting three
nginxcontainer in a for loop with:
Will lead to three
nginxcontainer on the three nodes in your cluster. Remember that you will need to open port 80 on the instances running in the Cloud to access the container.
Do not forget to remove the machine you started in the Cloud.
- Using Docker machine with Docker swarm.
Editor’s note: if you’re interested in learning more about networking at scale, you’ll want to check out Jay Edwards’ Distributed Systems training session at Velocity in Santa Clara May 27-29, 2015.
Related articles across the web
Subscribe to our stories
- In pictures: the 2019 Africa RISING Tanzania monitoring visit August 30, 2019
- Active Internationalization of Software Enterprises: Scale Development and Validation August 30, 2019
- The Manager’s Guide to Leveraging Disruption August 30, 2019
- Key take-aways from a recent Africa RISING exchange visit in Ghana August 30, 2019
- Device that recycles vaporized water from power plants wins MIT $100K May 28, 2019