Skip to content

deploy-with-kubeadm.md

Latest commit

 

History

History
153 lines (111 loc) · 6.14 KB

deploy-with-kubeadm.md

File metadata and controls

153 lines (111 loc) · 6.14 KB
title Configure Kubernetes with kubeadm
titleSuffix SQL Server Big Data Clusters
description Learn how to configure Kubernetes on multiple Ubuntu 16.04 or 18.04 machines (physical or virtual) for [!INCLUDE[big-data-clusters-2019](../includes/ssbigdataclusters-ver15.md)] deployments.
author MikeRayMSFT
ms.author mikeray
ms.reviewer mihaelab
ms.date 08/21/2019
ms.topic conceptual
ms.prod sql
ms.technology big-data-cluster

Configure Kubernetes on multiple machines for SQL Server big data cluster deployments

[!INCLUDEtsql-appliesto-ssver15-xxxx-xxxx-xxx]

This article provides an example of how to use kubeadm to configure Kubernetes on multiple machines for [!INCLUDEbig-data-clusters-2019] deployments. In this example, multiple Ubuntu 16.04 or 18.04 LTS machines (physical or virtual) are the target. If you are deploying to a different Linux platform, you must alter some of the commands to match your system.

Tip

For sample scripts that configure Kubernetes, see Create a Kubernetes cluster using Kubeadm on Ubuntu 16.04 LTS or 18.04 LTS. Also see this topic for a sample script that automates a deployment of a single node kubeadm deployment on a VM and then deploys a default configuration of big data cluster on top of it.

Prerequisites

  • Minimum of 3 Linux physical machines or virtual machines
  • Recommended configuration per machine:
    • 8 CPUs
    • 64 GB of memory
    • 100 GB of storage

Important

Before starting the big data cluster deployment, ensure the clocks are synchronized across all the Kubernetes nodes the deployment is targeting. The big data cluster has built-in health properties for various services that are time sensitive and clock skews can result in incorrect status.

Prepare the machines

On each machine, there are several required prerequisites. In a bash terminal, run the following commands on each machine:

  1. Add the current machine to the /etc/hosts file:

    echo $(hostname -i) $(hostname) | sudo tee -a /etc/hosts

  2. Disable swapping on all devices.

    sudo sed -i "/ swap / s/^/#/" /etc/fstab
sudo swapoff -a

  3. Import the keys and register the repository for Kubernetes.

    sudo curl -s https://packages.cloud.google.com/apt/doc/apt-key.gpg | sudo apt-key add -
echo 'deb http://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee -a /etc/apt/sources.list.d/kubernetes.list

  4. Configure docker and Kubernetes prerequisites on the machine.

    KUBE_DPKG_VERSION=1.15.0-00 #or your other target K8s version, which should be at least 1.13.
sudo apt-get update && \
sudo apt-get install -y ebtables ethtool && \
sudo apt-get install -y docker.io && \
sudo apt-get install -y apt-transport-https && \
sudo apt-get install -y kubelet=$KUBE_DPKG_VERSION kubeadm=$KUBE_DPKG_VERSION kubectl=$KUBE_DPKG_VERSION && \
curl https://raw.githubusercontent.com/kubernetes/helm/master/scripts/get | bash

  5. Set net.bridge.bridge-nf-call-iptables=1. On Ubuntu 18.04, the following commands first enable br_netfilter.

    . /etc/os-release
if [ "$VERSION_CODENAME" == "bionic" ]; then sudo modprobe br_netfilter; fi
sudo sysctl net.bridge.bridge-nf-call-iptables=1

Configure the Kubernetes master

After running the previous commands on each machine, choose one of the machines to be your Kubernetes master. Then run the following commands on that machine.

  1. First, create an rbac.yaml file in your current directory with the following command.

    cat <<EOF > rbac.yaml
apiVersion: rbac.authorization.k8s.io/v1beta1
kind: ClusterRoleBinding
metadata:
  name: default-rbac
subjects:
- kind: ServiceAccount
  name: default
  namespace: default
roleRef:
  kind: ClusterRole
  name: cluster-admin
  apiGroup: rbac.authorization.k8s.io
EOF

  2. Initialize the Kubernetes master on this machine. The example script below specifies Kubernetes version 1.15.0. The version you use depends on your Kubernetes cluster.

    KUBE_VERSION=1.15.0
sudo kubeadm init --pod-network-cidr=10.244.0.0/16 --kubernetes-version=$KUBE_VERSION

    You should see output that the Kubernetes master was successfully initialized.

  3. Note the kubeadm join command that you need to use on the other servers to join the Kubernetes cluster. Copy this for later use.

    kubeadm join

  4. Set up a Kubernetes configuration file your home directory.

    mkdir -p $HOME/.kube
sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
sudo chown $(id -u):$(id -g) $HOME/.kube/config

  5. Configure the cluster and the Kubernetes dashboard.

    kubectl apply -f https://raw.githubusercontent.com/coreos/flannel/master/Documentation/kube-flannel.yml
helm init
kubectl apply -f rbac.yaml
kubectl apply -f https://raw.githubusercontent.com/kubernetes/dashboard/v1.10.1/src/deploy/recommended/kubernetes-dashboard.yaml
kubectl create clusterrolebinding kubernetes-dashboard --clusterrole=cluster-admin --serviceaccount=kube-system:kubernetes-dashboard

Configure the Kubernetes agents

The other machines will act as Kubernetes agents in the cluster.

On each of the other machines, run the kubeadm join command that you copied in the previous section.

kubeadm join agents

View the cluster status

To verify the connection to your cluster, use the kubectl get command to return a list of the cluster nodes.

kubectl get nodes

Next steps

The steps in this article configured a Kubernetes cluster on multiple Ubuntu machines. The next step is to deploy SQL Server 2019 big data cluster. For instructions, see the following article:

Deploy SQL Server on Kubernetes