Docker Swarm on AWS using Terraform

Google slides from the Vancouver Docker Meetup, Feb 15, 2017.

Setup

Install docker

Install packer

Install terraform

Install aws cli

Create a new user in AWS IAM with Programmatic Access and attach the following policies: AmazonVPCFullAccess, AmazonEC2FullAccess. Saving the Access Key ID and Secret Access Key.

Set environment variables for AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY and AWS_DEFAULT_REGION.

export AWS_ACCESS_KEY_ID=...
export AWS_SECRET_ACCESS_KEY=...
export AWS_DEFAULT_REGION=ca-central-1

Create a new AWS EC2 keypair and download the pem file.

Set environment variables for AWS_SSH_KEY_ID and AWS_SSH_KEY

export AWS_SSH_KEY_ID=docker
export AWS_SSH_KEY=<path to file>/docker.pem

Clone this repo

git clone https://github.com/markcallen/docker-swarm-aws-terraform.git

Alternatives

If you don't want to install packer, terraform or aws locally you can use docker images with them:

terraform

TERRAFORM="docker run -rm -v $PWD:/terraform -i -t hashicorp/terraform:light"

$TERRAFORM run -state=/terraform/terraform.tfstate /terraform

packer

PACKER="docker run -rm -v $PWD:/packer -i -t hashicorp/packer:light"

$PACKER build /packer/docker-gce.json

aws

AWS="docker run --rm -e AWS_ACCESS_KEY_ID=$AWS_ACCESS_KEY_ID -e AWS_SECRET_ACCESS_KEY=$AWS_SECRET_ACCESS_KEY -e AWS_DEFAULT_REGION=$AWS_DEFAULT_REGION -t $(tty &>/dev/null && echo "-i") mesosphere/aws-cli"

$AWS ec2 describe-regions --output text

Building a AWS AMI with docker

Creating a AMI with docker preinstalled will speed up the creation of the docker swarm as all the nodes will be exactly the same.

Create a VPC

cd packer
terraform plan
terraform apply

Get the values of aws_vpc_id, aws_subnet_id and aws_security_group_id from

terraform show

Create the AMI

packer build \
       -var aws_vpc_id=... \
       -var aws_subnet_id=... \
       -var aws_security_group_id=... \
       docker-aws.json

Teardown the VPC

terraform destroy -force

Creating the Swarm

Use terraform to create several masters and slaves.

Get the AMI name

aws ec2 describe-images --owners self --filters "Name=name,Values=docker*" --query 'Images[*].[ImageId,Name,CreationDate]' --output text

Test the configuration

cd swarm
terraform plan -var 'amis={ca-central-1 = "..." }' \
               -var aws_region=$AWS_DEFAULT_REGION \
               -var ssh_key_filename=$AWS_SSH_KEY \
               -var ssh_key_name=$AWS_SSH_KEY_ID

Build the swarm

terraform apply -var 'amis={ca-central-1 = "..." }' \
                -var aws_region=$AWS_DEFAULT_REGION \
                -var ssh_key_filename=$AWS_SSH_KEY \
                -var ssh_key_name=$AWS_SSH_KEY_ID

View Visualizer

open http://<manager ip>:8080/

Teardown the swarm

terraform destroy -force \
                  -var 'amis={ca-central-1 = "..." }' \
                  -var aws_region=$AWS_DEFAULT_REGION \
                  -var ssh_key_filename=$AWS_SSH_KEY \
                  -var ssh_key_name=$AWS_SSH_KEY_ID

Using the swarm

Log into the swarm manager

View services

docker service ls

Deploy the docker vote app

wget https://raw.githubusercontent.com/markcallen/docker-swarm-aws-terraform/master/vote/docker-stack.yml
docker stack deploy --compose-file docker-stack.yml vote

View the stack

docker stack ls

Vote

open http://<manager ip>:5000/

Vote Results

open http://<manager ip>:5001/

License & Authors

• Author:: Mark Allen ([email protected])

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.