| title | In-database R analytics for SQL developers (tutorial)| Microsoft Docs |
|---|---|
| ms.prod | sql |
| ms.technology | machine-learning |
| ms.date | 06/07/2018 |
| ms.topic | tutorial |
| author | HeidiSteen |
| ms.author | heidist |
| manager | cgronlun |
[!INCLUDEappliesto-ss-xxxx-xxxx-xxx-md-winonly]
The goal of this tutorial is to provide SQL programmers with hands-on experience building a machine learning solution in SQL Server. In this tutorial, you'll learn how to incorporate R into an application or BI solution by wrapping R code in stored procedures.
Note
The same solution is available in Python. SQL Server 2017 is required. See In-database analytics for Python developers
The process of building an end to end solution typically consists of obtaining and cleaning data, data exploration and feature engineering, model training and tuning, and finally deployment of the model in production. Development and testing of the actual code is best performed using a dedicated development environment. For R, that might mean RStudio or [!INCLUDErtvs-short].
However, after the solution has been created, you can easily deploy it to [!INCLUDEssNoVersion] using [!INCLUDEtsql] stored procedures in the familiar environment of [!INCLUDEssManStudio].
In this tutorial, we assume that you have been given all the R code needed for the solution, and focus on building and deploying the solution using SQL Server.
-
Lesson 1: Download the sample data
Download the sample dataset and the sample SQL script files to a local computer.
-
Lesson 2: Import data to SQL Server using PowerShell
Execute a PowerShell script that creates a database and a table on the [!INCLUDEssCurrent] instance and loads the sample data to the table.
-
Lesson 3: Explore and visualize the data
Perform basic data exploration and visualization, by calling R packages and functions from [!INCLUDEtsql] stored procedures.
-
Lesson 4: Create data features using T-SQL
Create new data features using custom SQL functions.
-
Lesson 5: Train and save an R model using T-SQL
Build a machine learning model using R in stored procedures. Save the model to a SQL Server table.
-
Lesson 6: Operationalize the model
After the model has been saved to the database, call the model for prediction from [!INCLUDEtsql] by using stored procedures.
This tutorial uses a well-known public dataset, based on trips in New York city taxis. To make the sample code run quicker, we created a representative 1% sampling of the data. You'll use this data to build a binary classification model that predicts whether a particular trip is likely to get a tip or not, based on columns such as the time of day, distance, and pick-up location.
This tutorial assumes familiarity with basic database operations such as creating databases and tables, importing data, and writing SQL queries. It does not assume you know R. As such, all R code is provided. A skilled SQL programmer can use a supplied PowerShell script, sample data on GitHub, and [!INCLUDE [tsql](../../ includes /tsql-md.md)] in [!INCLUDE [ssManStudioFull](../../ includes / ssmanstudiofull-md.md) to complete this example.
Before starting the tutorial:
- Verify you have a configured instance of SQL Server 2016 R Services or SQL Server 2017 Machine Learning Services with R enabled. Additionally, confirm you have the R libraries.
- The login that you use for this tutorial must have permissions to create databases and other objects, to upload data, select data, and run stored procedures.
Note
We recommend that you do not use [!INCLUDEssManStudioFull] to write or test R code. If the code that you embed in a stored procedure has any problems, the information that is returned from the stored procedure is usually inadequate to understand the cause of the error.
For debugging, we recommend you use a tool such as [!INCLUDErtvs-short], or RStudio. The R scripts provided in this tutorial have already been developed and debugged using traditional R tools.