Thursday, August 1, 2019

Installation of Docker CE for Docker Host and Docker Client on Ubuntu 19.04

In this blog-post, I would like to discuss the detailed steps that involved for install the latest version of  Docker as Learning Lab on your own laptop or desktop. The same set of exercise can be done on any cloud instance as well.

Here is the ideology for setting up a lab in your laptop both docker server and docker client in different VirtualBox. Hope this picture gives more details!

Docker Host and Docker Client setup in a Laptop

Docker Installation prerequisites

The list of the prerequisites are :

  • Ubuntu 19.04 64bit OS [ 16.xx above recommended ] 
  • User with sudo privileges vagrant by default 
  • Vagrant Installed
  • Oracle VirtualBox Installed 
  • Good speed internet 

Let's get started now with the following sequence of steps that could carry out to build Two Docker server and Docker Client on the Ubuntu 19.04 on VirtualBox. Docker Host runs on 192.168.33.250 and the Docker client runs on the 192.168.33.251 IP address.

Knowing the IP Address in Linux 

Step 1: Creating Ubuntu Disco VirtualBoxes with Vagrant

Create the Vagrant VirtualBoxes for Docker Host and Docker Client with the following lines in Vagrantfile:

# Ubuntu
Vagrant.configure("2") do |config|
  config.vm.provision "shell", inline: "echo Docker host, client vm creation script"
  config.vm.provider "virtualbox" do |vb|
    vb.memory = "4096"
   end

  config.vm.define "dockerhost" do |dockerhost|
    dockerhost.vm.box = "roboxes/ubuntu1904"
    dockerhost.vm.network "private_network", ip: "192.168.33.250"
    dockerhost.vm.hostname = "dockerhost.test.com"
  end

  config.vm.define "dockerclient1" do |dockerclient1|
    dockerclient1.vm.box = "roboxes/ubuntu1904"
    dockerclient1.vm.network "private_network", ip: "192.168.33.251"
    dockerclient1.vm.hostname = "dockerclient1.test.com"
  end
end
You can bring up the vagrant boxes by running the:
vagrant up

Now connect with the PuTTY with the two IP addresses which are defined in the Vagrantfile.
Login with 'vagrant' user, Check the operating system version in Ubuntu we can get it by lsb_release COMMAND

lsb_release -a

After confirming the OS version we can proceed to install the docker. In regular Ubuntu, you can proceed for update the Software Repositories
  • As usual, it’s a good idea to update the local database of software to make sure you’ve got access to the latest revisions.
  • Therefore, open a terminal window and type:
sudo apt-get update
  • Allow the operation to complete.



Step 2: Uninstall Old Versions of Docker if exists

Use the following command to remove the existing docker from the Ubuntu:

sudo apt-get remove docker docker-engine docker.io


Next, it’s recommended to uninstall any old Docker software before proceeding.

curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -

To get the latest repo for Debian packages, as Ubuntu uses the deb kernel

sudo add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu  $(lsb_release -cs)  stable"


Step 3: Install Docker

Here we have two different options, To install Docker on Ubuntu, in the terminal window enter the command:

 sudo apt install docker.io -y

Above command will install the older version because it was updated for Ubuntu once in a year. alternatively, you can use the following command to install Docker CE latest version for the current Ubuntu suitable version.

sudo apt-get install docker-ce -y

Validate the docker version installation with the following command:

sudo docker --version

To more details about server and client versions of docker-engine
sudo docker version

The following execution output:

Docker CE installation on Ubuntu 19.04

Test the Docker installation

The following basic docker container commands help us to understand everything is working fine on this container engine.
docker run hello-world
docker image ls  #lost the image that was downloaded
docker container ls -all # list the containers
docker container --help

Execution output as follows:

docker container commands

 Step 4: Start and Automate Docker

The Docker service needs to be set up to run at startup. To do so, type in each command followed by entering:

sudo systemctl start docker
sudo systemctl enable docker

The list of commands used on the two terminals(docker host and docker client) to install docker on the Ubuntu are:

sudo apt-get remove docker docker-engine docker.io
apt-get update
apt-get install apt-transport-https ca-certificates curl software-properties-common -y
add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu  $(lsb_release -cs)  stable"
apt-get update
apt-get install docker-ce
docker --version
docker version

Dedicated user for docker operations

Everytime when you run the docker command you need to use the 'sudo' before it. To avoid this, we can configure a Unix user dedicated for docker operations then, the user must be a member of  'docker ' group. This might be a bit tricky but useful, it gives more flexibility to run the docker related commands.

Step 1: Switch to super user make a directory that could be used as home directory, add user and execute the following commands
 sudo -i
 mkdir /u01/docker
 useradd -s /bin/bash -d /u01/docker -g docker docker
 passwd docker
 chown docker:docker /u01/docker

The trouble with failure in name resolution

This could be strange, but when we tried to run the docker container on the DockerHost or on DockerClient got the same message as :
root@dockerhost:~# ERRO[2019-08-02T23:43:48.602072101-07:00] Not continuing with pull after error: error pulling image configuration:                                   Get https://production.cloudflare.docker.com/registry-v2/docker/registry/v2/blobs/sha256/fc/fce289e99eb9bca977dae136fbe2a82b6b7d4c3724                                  74c9235adc1741675f587e/data?verify=1564817623-vxb615oMpsW7Kmp%2BJgQ8lfIOSmI%3D: dial tcp: lookup production.cloudflare.docker.com: Tem                                  porary failure in name resolution


After brainstorming, looking into the multiple communities, git pages, and StackOverflow answers finally reached to a fix as updating the resolve.conf file with following:

  1. the search line include docker.com because the docker pull uses this domain name
  2. include 8.8.8.8 nameserver to have name resolving capability to the VM
  3. include nameserver as per the IP address used for Docker Host

First, temporarily add a known DNS server to your system.
echo "nameserver 8.8.8.8" | sudo tee /etc/resolv.conf > /dev/null
apt -y install openresolv
mkdir -p /etc/resolvconf/resolv.conf.d
echo nameserver 8.8.8.8 >> /etc/resolvconf/resolv.conf.d/head
echo 'search docker.com' | sudo tee -a /etc/resolvconf/resolv.conf.d/head
echo 'nameserver 192.168.1.XXX' | sudo tee -a /etc/resolvconf/resolv.conf.d/head
resolvconf --enable-updates
resolvconf -u

Command execution changes
After resolved you can proceed to play with Docker Client.

Playing within Docker Client on Ubuntu 19.04


You can run a docker command with referring to DockerHost using -H option.
docker -H tcp://192.168.33.250:2375 images

You can try to get the images it will show nothing docker client when you do not mention -H option or DOCKER_HOST undefined

docker images

First, determine that docker deamon running in the Docker Host. In the Docker client, defining the DOCKER_HOST to tell the docker CLI we will use the remote Docker Host by specifying tcp://[docker host ip]:[deamon port]
export DOCKER_HOST=tcp://192.168.33.250:2375

Now all set to run docker commands in Docker Client VM, we can able to check the images list without -H option now.
docker images

We can run a container but actually, it will connect to the Docker Host, instead of running in Docker Client.
docker run alpine

Verify this with listing images, on both will show the same list because actual image downloaded in the DockerHost VM.
docker images

Play within Docker Client on Ubuntu 19.04

Docker CE installation on CentOS7


Here we have snippet of instructions to install Docker-ce on CentOS 7.
sudo -E yum-config-manager --add-repo "$DOCKERURL/centos/docker-ce.repo"
yum install -y yum-utils device-mapper-persistent-data lvm2
yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo
yum-config-manager --enable docker-ce-edge
yum-config-manager --enable docker-ce-test
yum install -y docker-ce
docker -v
usermod -aG docker vagrant
systemctl start docker
systemctl enable docker
systemctl status docker
docker info
docker run hello-world

Takeaways from this experiment

Two important takeaways from this experiment are:
1> Docker deamon will be running with 'dockerd' not as 'docker deamon'
.ps aux | grep "docker daemon" # OLD 
2> Docker default port 2376 earlier, new one is 2375 3> If docker.com is not in searchable dns then manually need to add in the resolv.conf file by updating head file.

You might be intrested to read similar article for CentOS, We have already have a full article on 'How to install docker on CentOS7 box'. Official Reference guide:

https://docs.docker.com/v17.09/get-started/

No comments:

Categories

Kubernetes (24) Docker (20) git (13) Jenkins (12) AWS (7) Jenkins CI (5) Vagrant (5) K8s (4) VirtualBox (4) CentOS7 (3) docker registry (3) docker-ee (3) ucp (3) Jenkins Automation (2) Jenkins Master Slave (2) Jenkins Project (2) containers (2) create deployment (2) docker EE (2) docker private registry (2) dockers (2) dtr (2) kubeadm (2) kubectl (2) kubelet (2) openssl (2) Alert Manager CLI (1) AlertManager (1) Apache Maven (1) Best DevOps interview questions (1) CentOS (1) Container as a Service (1) DevOps Interview Questions (1) Docker 19 CE on Ubuntu 19.04 (1) Docker Tutorial (1) Docker UCP (1) Docker installation on Ubunutu (1) Docker interview questions (1) Docker on PowerShell (1) Docker on Windows (1) Docker version (1) Docker-ee installation on CentOS (1) DockerHub (1) Features of DTR (1) Fedora (1) Freestyle Project (1) Git Install on CentOS (1) Git Install on Oracle Linux (1) Git Install on RHEL (1) Git Source based installation (1) Git line ending setup (1) Git migration (1) Grafana on Windows (1) Install DTR (1) Install Docker on Windows Server (1) Install Maven on CentOS (1) Issues (1) Jenkins CI server on AWS instance (1) Jenkins First Job (1) Jenkins Installation on CentOS7 (1) Jenkins Master (1) Jenkins automatic build (1) Jenkins installation on Ubuntu 18.04 (1) Jenkins integration with GitHub server (1) Jenkins on AWS Ubuntu (1) Kubernetes Cluster provisioning (1) Kubernetes interview questions (1) Kuberntes Installation (1) Maven (1) Maven installation on Unix (1) Operations interview Questions (1) Oracle Linux (1) Personal access tokens on GitHub (1) Problem in Docker (1) Prometheus (1) Prometheus CLI (1) RHEL (1) SCM (1) SCM Poll (1) SRE interview questions (1) Troubleshooting (1) Uninstall Git (1) Uninstall Git on CentOS7 (1) Universal Control Plane (1) Vagrantfile (1) amtool (1) aws IAM Role (1) aws policy (1) caas (1) chef installation (1) create organization on UCP (1) create team on UCP (1) docker CE (1) docker UCP console (1) docker command line (1) docker commands (1) docker community edition (1) docker container (1) docker editions (1) docker enterprise edition (1) docker enterprise edition deep dive (1) docker for windows (1) docker hub (1) docker installation (1) docker node (1) docker releases (1) docker secure registry (1) docker service (1) docker swarm init (1) docker swarm join (1) docker trusted registry (1) elasticBeanStalk (1) global configurations (1) helm installation issue (1) mvn (1) namespaces (1) promtool (1) service creation (1) slack (1)