tutorial-load-sample-data.md

title	Load sample data
titleSuffix	SQL Server 2019 big data clusters
description	This tutorial demonstrates how to load sample data into a SQL Server big data cluster. The sample data includes relational data in the SQL Server master instance. It also includes HDFS data in the storage pool. This data supports other tutorials in this section.
author	rothja
ms.author	jroth
manager	craigg
ms.date	02/28/2019
ms.topic	tutorial
ms.prod	sql
ms.technology	big-data-cluster
ms.custom	seodec18

Tutorial: Load sample data into a SQL Server 2019 big data cluster

This tutorial explains how to use a script to load sample data into a SQL Server 2019 big data cluster (preview). Many of the other tutorials in the documentation use this sample data.

Tip

You can find additional samples for SQL Server 2019 big data cluster (preview) in the sql-server-samples GitHub repository. They are located in the sql-server-samples/samples/features/sql-big-data-cluster/ path.

Prerequisites

• A deployed big data cluster
• Big data tools
  • mssqlctl
  • kubectl
  • sqlcmd
  • curl

Load sample data

The following steps use a bootstrap script to download a SQL Server database backup and load the data into your big data cluster. For ease of use, these steps have been broken out into Windows and Linux sections.

Windows

The following steps describe how to use a Windows client to load the sample data into your big data cluster.

1. Open a new Windows command prompt.

   [!IMPORTANT] Do not use Windows PowerShell for these steps. In PowerShell, the script will fail as it will use the PowerShell version of curl.

2. Use curl to download the bootstrap script for the sample data.

   curl -o bootstrap-sample-db.cmd "https://raw.githubusercontent.com/Microsoft/sql-server-samples/master/samples/features/sql-big-data-cluster/bootstrap-sample-db.cmd"

3. Download the bootstrap-sample-db.sql Transact-SQL script. This script is called by the bootstrap script.

   curl -o bootstrap-sample-db.sql "https://raw.githubusercontent.com/Microsoft/sql-server-samples/master/samples/features/sql-big-data-cluster/bootstrap-sample-db.sql"

4. The bootstrap script requires the following positional parameters for your big data cluster:

   Parameter	Description
   <CLUSTER_NAMESPACE>	The name you gave your big data cluster.
   <SQL_MASTER_IP>	The IP address of your master instance.
   <SQL_MASTER_SA_PASSWORD>	The SA password for the master instance.
   <KNOX_IP>	The IP address of the HDFS/Spark Gateway.
   <KNOX_PASSWORD>	The password for the HDFS/Spark Gateway.

   [!TIP] Use kubectl to find the IP addresses for the SQL Server master instance and Knox. Run kubectl get svc -n <your-cluster-name> and look at the EXTERNAL-IP addresses for the master instance (endpoint-master-pool) and Knox (endpoint-security).

5. Run the bootstrap script.

   .\bootstrap-sample-db.cmd <CLUSTER_NAMESPACE> <SQL_MASTER_IP> <SQL_MASTER_SA_PASSWORD> <KNOX_IP> <KNOX_PASSWORD>

Linux

The following steps describe how to use a Linux client to load the sample data into your big data cluster.

1. Download the bootstrap script, and assign executable permissions to it.

   curl -o bootstrap-sample-db.sh "https://raw.githubusercontent.com/Microsoft/sql-server-samples/master/samples/features/sql-big-data-cluster/bootstrap-sample-db.sh"
   chmod +x bootstrap-sample-db.sh

2. Download the bootstrap-sample-db.sql Transact-SQL script. This script is called by the bootstrap script.

   curl -o bootstrap-sample-db.sql "https://raw.githubusercontent.com/Microsoft/sql-server-samples/master/samples/features/sql-big-data-cluster/bootstrap-sample-db.sql"

3. The bootstrap script requires the following positional parameters for your big data cluster:

   Parameter	Description
   <CLUSTER_NAMESPACE>	The name you gave your big data cluster.
   <SQL_MASTER_IP>	The IP address of your master instance.
   <SQL_MASTER_SA_PASSWORD>	The SA password for the master instance.
   <KNOX_IP>	The IP address of the HDFS/Spark Gateway.
   <KNOX_PASSWORD>	The password for the HDFS/Spark Gateway.

   [!TIP] Use kubectl to find the IP addresses for the SQL Server master instance and Knox. Run kubectl get svc -n <your-cluster-name> and look at the EXTERNAL-IP addresses for the master instance (endpoint-master-pool) and Knox (endpoint-security).

4. Run the bootstrap script.

   sudo env "PATH=$PATH" ./bootstrap-sample-db.sh <CLUSTER_NAMESPACE> <SQL_MASTER_IP> <SQL_MASTER_SA_PASSWORD> <KNOX_IP> <KNOX_PASSWORD>

Next steps

After the bootstrap script runs, your big data cluster has the sample databases and HDFS data. The following tutorials use the sample data to demonstrate big data cluster capabilities:

Data Virtualization:

• Tutorial: Query HDFS in a SQL Server big data cluster
• Tutorial: Query Oracle from a SQL Server big data cluster

Data ingestion:

• Tutorial: Ingest data into a SQL Server data pool with Transact-SQL
• Tutorial: Ingest data into a SQL Server data pool with Spark jobs

Notebooks:

Tutorial: Run a sample notebook on a SQL Server 2019 big data cluster