Docker Installation - Revision history

DrEdWilliams at 12:24, 17 October 2021

2021-10-17T12:24:25Z

← Older revision		Revision as of 12:24, 17 October 2021
Line 1:		Line 1:
	~~This installs the official Docker distrubution from the '''community edition''' repository.~~

	__NOTOC__		__NOTOC__
	= Docker Community Edition install =		= Docker Community Edition install =
			This installs the official Docker distrubution from the '''community edition''' repository.

	== Fedora ==		== Fedora ==

DrEdWilliams at 11:51, 15 October 2021

2021-10-15T11:51:06Z

← Older revision		Revision as of 11:51, 15 October 2021
Line 25:		Line 25:

	=== Prerequisites ===		=== Prerequisites ===
	* [[Basic CentOS 7 ~~Installation]] or [[Basic CentOS 8~~ Installation]]		* [[Basic CentOS 7 Installation]]
	* [[CUDA + NVIDIA drivers]] (if GPU is present)		* [[CUDA + NVIDIA drivers]] (if GPU is present)

DrEdWilliams at 15:44, 26 September 2021

2021-09-26T15:44:27Z

← Older revision		Revision as of 15:44, 26 September 2021
Line 39:		Line 39:

	=== Prerequisites ===		=== Prerequisites ===
	* [[Basic Debian 10 Installation]]		* [[Basic Debian Installation]]

	=== Set up Docker-CE Repository ===		=== Set up Docker-CE Repository ===

DrEdWilliams at 03:57, 19 December 2020

2020-12-19T03:57:19Z

← Older revision		Revision as of 03:57, 19 December 2020
Line 70:		Line 70:

	= GPU Nodes =		= GPU Nodes =
	On GPU-enabled nodes, install the ~~nvidia runtime.~~		On GPU-enabled nodes, install the [[NVIDIA Docker Runtime]].

	~~(originally from https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html#docker)~~

	~~== CentOS 7/8 ==~~
	~~<pre>sudo yum-config-manager --add-repo https://nvidia.github.io/nvidia-docker/centos7/x86_64/nvidia-docker.repo~~
	~~sudo yum install -y nvidia-docker2</pre>~~

	~~== Debian 10 ==~~
	~~Setup the stable repository and the GPG key:~~
	~~<pre>distribution=$(. /etc/os-release;echo $ID$VERSION_ID) \~~
	~~&& curl -s -L https://nvidia.github.io/nvidia-docker/gpgkey \| sudo apt-key add - \~~
	~~&& curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list \| sudo tee /etc/apt/sources.list.d/nvidia-docker.list</pre>~~

	~~Note: To get access to experimental features such as CUDA on WSL or the new MIG capability on A100, you may want to add the experimental branch to the repository listing:~~

	~~curl -s -L https://nvidia.github.io/nvidia-container-runtime/experimental/$distribution/nvidia-container-runtime.list \| sudo tee /etc/apt/sources.list.d/nvidia-container-runtime.list~~

	~~Install the nvidia-docker2 package (and dependencies) after updating the package listing:~~
	~~sudo apt-get update~~
	~~sudo apt-get install -y nvidia-docker2~~

	~~== Finishing the install ==~~
	~~Restart the~~ Docker ~~daemon to complete the installation after setting the default runtime:~~
	~~sudo systemctl restart docker~~

	~~Test nvidia-smi with the latest official CUDA image~~
	~~sudo docker run --rm --gpus all nvidia/cuda:11.0-base nvidia-smi~~

	~~Test the GPU performance using a simple NVIDIA GPU Cloud container with the CUDA nbody sample program~~
	~~docker run -it --rm nvcr.io/nvidia/k8s/cuda-sample:nbody nbody -benchmark -fp64~~

	~~= Reloading Repository Certificates =~~

	Rather frequently, it seems, the NVIDIA folks invalidate their signing certificates for their repositories. When that happens, you just need to delete the certificates and let the 'yum' command reload them on the next update:

	~~$(sed -n 's/releasever=//p' /etc/yum.conf)~~
	~~${DIST:-$(~~. ~~/etc/os-release; echo $VERSION_ID)}~~
	~~sudo rpm -e gpg-pubkey-f796ecb0~~
	~~sudo gpg --homedir /var/lib/yum/repos/$(uname -m)/$DIST/nvidia-container-runtime/gpgdir --delete-key f796ecb0~~
	~~sudo gpg --homedir /var/lib/yum/repos/$(uname -m)/$DIST/libnvidia-container/gpgdir --delete-key f796ecb0~~
	~~sudo gpg --homedir /var/lib/yum/repos/$(uname -m)/$DIST/nvidia-docker/gpgdir --delete-key f796ecb0~~
	~~sudo yum -y makecache~~

DrEdWilliams at 03:55, 19 December 2020

2020-12-19T03:55:08Z

← Older revision		Revision as of 03:55, 19 December 2020
Line 2:		Line 2:

	__NOTOC__		__NOTOC__
			= Docker Community Edition install =

	== Fedora ==		== Fedora ==
	The docker team officially supports Fedora, but the rapid pace of Fedora releases (every 6 months) and the changing cgroups support (fedora has moved to v2 but docker is still on v1) has led to delays with the Fedora 33 release of docker-ce. I expect this will happen again for future releases, so the instructions below accommodate this possibility.		The docker team officially supports Fedora, but the rapid pace of Fedora releases (every 6 months) and the changing cgroups support (fedora has moved to v2 but docker is still on v1) has led to delays with the Fedora 33 release of docker-ce. I expect this will happen again for future releases, so the instructions below accommodate this possibility.

DrEdWilliams: /* GPU Nodes */

2020-12-19T03:54:12Z

GPU Nodes

← Older revision		Revision as of 03:54, 19 December 2020
Line 67:		Line 67:
	scp -r aslan:.docker ~		scp -r aslan:.docker ~

	=== GPU Nodes ===		= GPU Nodes =
	On GPU-enabled nodes, install the nvidia runtime.		On GPU-enabled nodes, install the nvidia runtime.

	(originally from https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html#docker)		(originally from https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html#docker)

	==== CentOS 7/8 ====		== CentOS 7/8 ==
	<pre>sudo yum-config-manager --add-repo https://nvidia.github.io/nvidia-docker/centos7/x86_64/nvidia-docker.repo		<pre>sudo yum-config-manager --add-repo https://nvidia.github.io/nvidia-docker/centos7/x86_64/nvidia-docker.repo
	sudo yum install -y nvidia-docker2</pre>		sudo yum install -y nvidia-docker2</pre>

	==== Debian 10 ====		== Debian 10 ==
	Setup the stable repository and the GPG key:		Setup the stable repository and the GPG key:
	<pre>distribution=$(. /etc/os-release;echo $ID$VERSION_ID) \		<pre>distribution=$(. /etc/os-release;echo $ID$VERSION_ID) \
Line 90:		Line 90:
	sudo apt-get install -y nvidia-docker2		sudo apt-get install -y nvidia-docker2

	==== Finishing the install ====		== Finishing the install ==
	Restart the Docker daemon to complete the installation after setting the default runtime:		Restart the Docker daemon to complete the installation after setting the default runtime:
	sudo systemctl restart docker		sudo systemctl restart docker
Line 100:		Line 100:
	docker run -it --rm nvcr.io/nvidia/k8s/cuda-sample:nbody nbody -benchmark -fp64		docker run -it --rm nvcr.io/nvidia/k8s/cuda-sample:nbody nbody -benchmark -fp64

	~~===~~= Reloading Repository Certificates ~~===~~=		= Reloading Repository Certificates =

	Rather frequently, it seems, the NVIDIA folks invalidate their signing certificates for their repositories. When that happens, you just need to delete the certificates and let the 'yum' command reload them on the next update:		Rather frequently, it seems, the NVIDIA folks invalidate their signing certificates for their repositories. When that happens, you just need to delete the certificates and let the 'yum' command reload them on the next update:

DrEdWilliams: added Debian nvidia-docker install directions

2020-12-19T03:52:44Z

added Debian nvidia-docker install directions

← Older revision		Revision as of 03:52, 19 December 2020
Line 70:		Line 70:
	On GPU-enabled nodes, install the nvidia runtime.		On GPU-enabled nodes, install the nvidia runtime.

	(originally from https://~~github~~.com/~~NVIDIA~~/~~nvidia~~-docker)		(originally from https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html#docker)

			==== CentOS 7/8 ====
	<pre>sudo yum-config-manager --add-repo https://nvidia.github.io/nvidia-docker/centos7/x86_64/nvidia-docker.repo		<pre>sudo yum-config-manager --add-repo https://nvidia.github.io/nvidia-docker/centos7/x86_64/nvidia-docker.repo
	sudo yum install -y nvidia-docker2		sudo yum install -y nvidia-docker2</pre>
	~~sudo systemctl restart docker~~ </pre>

	~~Test~~ nvidia-~~smi with the latest official CUDA image~~		==== Debian 10 ====
	~~docker run~~ --~~runtime=~~nvidia --~~rm nvidia~~/~~cuda~~ nvidia-~~smi~~		Setup the stable repository and the GPG key:
			<pre>distribution=$(. /etc/os-release;echo $ID$VERSION_ID) \
			&& curl -s -L https://nvidia.github.io/nvidia-docker/gpgkey \| sudo apt-key add - \
			&& curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list \| sudo tee /etc/apt/sources.list.d/nvidia-docker.list</pre>

	~~Make~~ the ~~nvidia runtime default~~		Note: To get access to experimental features such as CUDA on WSL or the new MIG capability on A100, you may want to add the experimental branch to the repository listing:
	* add ~~entry~~ to ~~/etc/docker/daemon.json~~
	* note that this gets reset when docker updates
	* resulting daemon.json file looks like this:

	~~<pre>{~~		curl -s -L https://nvidia.github.io/nvidia-container-runtime/experimental/$distribution/nvidia-container-runtime.list \| sudo tee /etc/apt/sources.list.d/nvidia-container-runtime.list
	~~"runtimes"~~: {
	"nvidia~~": {~~
	~~"path": "~~/~~usr~~/~~bin~~/nvidia-container-runtime",
	~~"runtimeArgs": []~~
	}
	},
	~~"default~~-runtime~~": "nvidia"~~
	~~} </pre>~~

	~~... or copy from aslan~~		Install the nvidia-docker2 package (and dependencies) after updating the package listing:
	~~scp aslan:/etc/docker/daemon.json /etc/docker~~		sudo apt-get update
			sudo apt-get install -y nvidia-docker2

	~~Reload~~ the ~~configuration~~ to ~~enable~~ the ~~change~~		==== Finishing the install ====
			Restart the Docker daemon to complete the installation after setting the default runtime:
	sudo systemctl restart docker		sudo systemctl restart docker

			Test nvidia-smi with the latest official CUDA image
			sudo docker run --rm --gpus all nvidia/cuda:11.0-base nvidia-smi

	Test the GPU performance using a simple NVIDIA GPU Cloud container with the CUDA nbody sample program		Test the GPU performance using a simple NVIDIA GPU Cloud container with the CUDA nbody sample program

10.0.0.7: /* Install containerd.io (CentOS 8 only) */

2020-12-13T22:20:24Z

Install containerd.io (CentOS 8 only)

← Older revision		Revision as of 22:20, 13 December 2020
Line 29:		Line 29:
	sudo yum install -y yum-utils device-mapper-persistent-data lvm2		sudo yum install -y yum-utils device-mapper-persistent-data lvm2
	sudo yum-config-manager --add-repo <nowiki>https://download.docker.com/linux/centos/docker-ce.repo</nowiki>		sudo yum-config-manager --add-repo <nowiki>https://download.docker.com/linux/centos/docker-ce.repo</nowiki>

	~~=== Install containerd.io (CentOS 8 only) ===~~
	RHEL/CentOS 8 replaced the normal docker with podman/buildah, so we have to manually install the containerd.io runtime. Choose the latest version of the RPM from the CentOS 7 repo. (see https://linuxconfig.org/how-to-install-docker-in-rhel-8)
	~~dnf install https://download.docker.com/linux/centos/7/x86_64/stable/Packages/containerd.io-1.2.10-3.2.el7.x86_64.rpm~~

	=== Install Docker ===		=== Install Docker ===

DrEdWilliams: /* Configuring Container Runtime */

2020-12-10T11:40:58Z

Configuring Container Runtime

@@ Line 51: / Line 51: @@
 === Install Docker ===
   sudo apt-get install -y docker-ce docker-ce-cli containerd.io
 == Finishing the Install ==

DrEdWilliams at 11:28, 7 December 2020

2020-12-07T11:28:04Z

@@ Line 2: / Line 2: @@
 __NOTOC__
 == CentOS ==
 ( originally from https://docs.docker.com/engine/installation/linux/centos/ )
@@ Line 18: / Line 35: @@
 === Install Docker ===
-  sudo yum install -y docker-ce
+  sudo yum install -y docker-ce docker-ce-cli containerd.io
 == Debian ==