You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/advanced-analytics/what-s-new-in-sql-server-machine-learning-services.md
+75-33Lines changed: 75 additions & 33 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
title: "What's New in Machine Learning Services | Microsoft Docs"
3
3
ms.custom:
4
4
- "SQL2016_New_Updated"
5
-
ms.date: "07/14/2017"
5
+
ms.date: "07/31/2017"
6
6
ms.prod: "sql-server-2016"
7
7
ms.reviewer: ""
8
8
ms.suite: ""
@@ -22,62 +22,104 @@ In SQL Server 2016, Microsoft introduced SQL Server R Services, a feature that s
22
22
23
23
In SQL Server 2017, machine learning becomes even more powerful, with addition of support for the popular Python language. Along with the support for new languages comes a new name: **Machine Learning Services (In-Database)**.
24
24
25
-
## What's new in SQL Server 2017 Release Candidate 1
25
+
Catch the latest announcement here! [Python in SQL Server 2017: enhanced in-database machine learning](https://blogs.technet.microsoft.com/dataplatforminsider/2017/04/19/python-in-sql-server-2017-enhanced-in-database-machine-learning/)
26
26
27
-
SQL Server 2017 builds on Microsoft's commitment to making it easy to build and deploy machine learning solutions, with the following new features:
27
+
## What's new in SQL Server 2017 Release Candidate 2
28
28
29
-
- Improved and expanded Python libraries
30
-
- Updates to realtime scoring, plus a new native T-SQL scoring function
31
-
- Updates to Microsoft R
32
-
- Installation of pre-trained models
33
-
- New package management capabilities for the DBA
29
+
Microsoft Machine Learning Server in SQL Server now provides comprehensive support for building and deploying machine learning solutions. Here are the highlights of this release:
34
30
35
-
### Improved Python integration in SQL Server
31
+
> [!IMPORTANT]
32
+
>
33
+
> Machine learning services, including use of R or Python, are currently not supported when running SQL Server on Linux, or in Azure SQL database. Look for changes in a later release.
34
+
>
35
+
> However, native scoring using the PREDICT function is currently supported in the Linux edition.
36
+
37
+
### In-database Python integration
38
+
39
+
You can run Python in stored procedures, or execute Python remotely using the SQL Server computer as the compute context. This integration opens up new avenues for the vast community of Python developers and data scientists to use the power of SQL Server, and to explore innovations from Microsoft such as **revoscalepy** and **microsoftml**.
40
+
41
+
SQL Server developers gain access to the extensive Python libraries from the open source ecosystem, including popular frameworks such as scikit-learn, Tensorflow, Caffe and Theano/Keras.
42
+
43
+
But running Python in-database isn't just for machine learning; there are a myriad of other potential applications for integrating Python with SQL, leveraging the strengths of the respective languages to deliver more intelligent, powerful solutions.
44
+
45
+
+**revoscalepy**
46
+
47
+
This release includes the final version of **revoscalepy**, which supplies Pythonic equivalents of the scalable, streaming algorithms in RevoScaleR. You can create Python models for linear and logistic regressions, decision trees, boosted trees, and random forests, all parallelizable, and capable of being run in remote compute contexts.
48
+
49
+
For more information, see [What is revoscalepy](python/what-is-revoscalepy.md).
50
+
51
+
+ Remote compute contexts for Python
52
+
53
+
This release supports use of multiple data sources and remote compute contexts. The data scientist or developer can execute Python code on a remote SQL Server, to explore data or build models without moving data. Use of remote compute contexts requires **revoscalepy**.
54
+
55
+
+ Python support in Microsoft Machine Learning Server (Standalone)
56
+
57
+
SQL Server 2017 includes the option to install a standalone version of the Python and R platforms. By using Machine Learning Server, you can distribute and scale R or Python code without using SQL Server.
36
58
37
-
Support for Python in SQL Server was introduced in CTP 2.0. When you select Python as the language to install with SQL Server, you get the **revoscalepy** module, which supports the same scalable, distributed algorithms and compute contexts that are provided in RevoScaleR.
59
+
For an example of Python use in Microsoft Machine Learning Server, see [Publish and consume Python code](python/publish-consume-python-code.md).
38
60
39
-
In this release, the **revoscalepy** library is joined by **MicrosoftML for Python**, which provides fast, scalable machine learning algorithms and data transformations that run on the same compute contexts and data sources supported by revoscalepy.
61
+
### New algorithms
40
62
41
-
For more information, see these topics:
63
+
The **MicrosoftML** package for both R and Python contains state-of-the-art machine learning algorithms and data transformation that can be scaled or run in remote compute contexts. Algorithms include customizable deep neural networks, fast decision trees and decision forests, linear regression, and logistic regression.
42
64
43
-
+[Set up Python in Machine Learning Services](../advanced-analytics/python/setup-python-machine-learning-services.md)
65
+
The MicrosoftML package comes with both R and Python interfaces, and is based on Microsoft Machine Learning Server version 9.2.0.
44
66
45
-
+[revoscalepy function reference](https://docs.microsoft.com/r-server/python-reference/revoscalepy/revoscalepy-package)
67
+
For more information, see [Introduction to MicrosoftML](using-the-microsoftml-package.md) and [microsoftml for Python](https://docs.microsoft.com/r-server/python-reference/microsoftml/microsoftml-package).
46
68
47
-
+[MicrosoftML for Python](https://docs.microsoft.com/r-server/python-reference/microsoftml/microsoftml-package)
69
+
### Operationalization
70
+
71
+
This release contains multiple options and features to help you deploy and distribute machine learning tasks:
72
+
73
+
+ Operationalization with T-SQL
74
+
75
+
The integration of Python with T-SQL means that you can call any Python code using `sp_execute_external_script`. This secure infrastructure enables enterprise-grade deployment of Python models and scripts that can be called from an application using a simple stored procedure. Additional performance is by streaming data from SQL to Python processes and MPI ring parallelization.
76
+
77
+
+**mrsdeploy** for Python
78
+
79
+
The **mrsdeploy** package for Microsoft R Server now supports deployment of Python models and scripts as web services, and is available as an option in Machine Learning Server (Standalone). For an example of how it works, see [Publish and consume Python code](python/publish-consume-python-code.md).
80
+
81
+
+ Performance
82
+
83
+
Microsoft has pushed the boundaries of performance for scoring. With in-database scoring, we processed a million rows per second using R models. In this release, new features for **realtime scoring** and **native scoring** support better performance in single-row scoring and small batches as well.
48
84
49
85
### Realtime scoring and native scoring
50
86
51
-
_Realtime scoring_ is supported for scoring in SQL Server and in Machine Learning Server (Standalone). This feature relies on native C++ libraries to read a model stored in an optimized binary format. From the model, the function can generate predictions without having to call the R runtime. This makes batch scoring much faster.
87
+
Realtime scoring relies on native C++ libraries to read a model stored in an optimized binary format, and then generate predictions without having to call the R runtime. This makes scoring operations much faster.
52
88
53
-
Additionally, this release of SQL Server 2017 includes a native T-SQL function for fast scoring that can be run on any edition of SQL Server, even on Linux. The function is available by default, and requires no installation of R or extra configuration. This means you can train a model elsewhere, save it in SQL Server, and then perform scoring without ever calling R. This feature is referred to as _native scoring_.
89
+
Additionally, this release of SQL Server 2017 includes a native T-SQL function for fast scoring that can be run on any edition of SQL Server, even on Linux. The function requires no installation of R or extra configuration. This means you can train a model elsewhere, save it in SQL Server, and then perform scoring without ever calling R. This feature is referred to as _native scoring_.
90
+
91
+
- Native scoring is available only in SQL Server 2017. It uses a T-SQL function that can run in any edition of SQL Server, including Linux.
92
+
- Realtime scoring is supported in SQL Server 2017, and in Microsoft Machine Learning Server. You can runa stored procedure or perform realtime scoring from R code.
93
+
- Realtime scoring is also available for SQL Server 2016, if the instance is upgraded to the latest release of Microsoft R Server.
54
94
55
95
For more information, see these articles:
56
96
57
-
+[Realtime scoring](real-time-scoring.md)
58
-
+[Native scoring](sql-native-scoring.md)
59
-
+[How to perform realtime scoring or native scoring](r/how-to-do-realtime-scoring.md)
97
+
+[Realtime scoring](real-time-scoring.md)
98
+
+[Native scoring](sql-native-scoring.md)
99
+
+[How to perform realtime scoring or native scoring](r/how-to-do-realtime-scoring.md)
60
100
61
-
##Other updates
101
+
### Upgrade your ML experience and get pre-trained models
62
102
63
-
This section lists features that were released previously, but that have been updated in this release.
103
+
If you installed an earlier version of SQL Server 2016 R Services, you can now upgrade to the latest version by switching your server to use the Modern Lifecycle policy. By doing so, you can take advantage of a faster release cycle for R and automatically upgrade all R components. For more information, see [Microsoft R Server 9.0.1](https://docs.microsoft.com/r-server/whats-new-in-r-server).
64
104
65
-
### Improved package management for data scientists
105
+
The installer also offers the option to install a collection of pre-trained models in binary format. These models support machine learning in scenarios such as image recognition, where it might be difficult for customers to find large datasets to train a model. After you install one of the pre-trained models, you can use it for prediction on your own data without the time and expense involved in training such a large and complex model.
66
106
67
-
To provide better support for databases administrators who must manage R package libraries, SQL Server now supports the CREATE EXTERNAL LIBRARY command.
107
+
For more information, see [Install pre-trained models in SQL Server](r/install-pretrained-models-sql-server.md)
68
108
69
-
For more information, see [R package management for SQL Server R Services](../advanced-analytics/r/r-package-management-for-sql-server-r-services.md).
109
+
### Package management
70
110
71
-
### Upgrade your R experience with pre-trained models
111
+
This release includes many improvements in package management for SQL Server. These include:
72
112
73
-
The RevoScaleR package is included in SQL Server 2016, SQL Server 2017, and Microsoft R Server. It includes transforms and algorithms that support distributed or parallel processing, and multiple compute contexts.
113
+
- database roles to help the DBA manage and audit permissions
114
+
- the CREATE EXTERAL LIBRARY statement in T-SQL
115
+
- a rich set of R functions to help install, remove, or list packages owned by users.
74
116
75
-
If you installed an earlier version of RevoScaleR with SQL Server 2016, you can now upgrade to the latest version by switching your server to use the Modern Lifecycle policy. By doing so, you can take advantage of a faster release cycle for R and automatically upgrade all R components. For more information, see [Microsoft R Server 9.0.1](https://docs.microsoft.com/r-server/whats-new-in-r-server).
117
+
For more information, see [Package management](r/r-package-management-for-sql-server-r-services.md).
76
118
77
-
Additionally, when you install the new R components, you can get a collection of pre-trained models in binary format. These models support machine learning in scenarios such as image recognition, where it might be difficult for customers to find large datasets to train a model. After you install one of the pre-trained models, you can use it for prediction on your own data without the time and expense involved in training such a large and complex model.
119
+
### Get started
78
120
79
-
For more information, see [Install pre-trained models in SQL Server](r/install-pretrained-models-sql-server.md)
121
+
+[Set up Python in SQL Server Machine Learning Services](../advanced-analytics/python/setup-python-machine-learning-services.md)
80
122
81
-
> [!IMPORTANT]
82
-
>
83
-
> Machine learning services, including use of R or Python, are currently not supported when running SQL Server on Linux. Look for changes in a later release. However, native scoring using the PREDICT function is currently supported in the Linux edition.
123
+
+[Set up R in SQL Server Machine Learning Services](r/set-up-sql-server-r-services-in-database.md)
There are no new features in this release. Improvements in this release include bug fixes and performance.
24
+
21
25
## SQL Server 2017 Analysis Services RC1
22
26
There are no new features in this release, however, this release includes additional improvements to [Dynamic Management Views](https://docs.microsoft.com/sql/analysis-services/instances/use-dynamic-management-views-dmvs-to-monitor-analysis-services) (DMV) for tabular models at the 1200 and 1400 compatibility levels.
# Run the SQL Server 2017 container image with Docker
14
14
15
-
In this quick start tutorial, you use Docker to pull and run the SQL Server 2017 RC1 container image, [mssql-server-linux](https://hub.docker.com/r/microsoft/mssql-server-linux/). Then connect with **sqlcmd** to create your first database and run queries.
15
+
In this quick start tutorial, you use Docker to pull and run the SQL Server 2017 RC2 container image, [mssql-server-linux](https://hub.docker.com/r/microsoft/mssql-server-linux/). Then connect with **sqlcmd** to create your first database and run queries.
16
16
17
17
This image consists of SQL Server running on Linux based on Ubuntu 16.04. It can be used with the Docker Engine 1.8+ on Linux or on Docker for Mac/Windows.
# Install SQL Server and create a database on Red Hat
15
15
16
-
In this quick start tutorial, you first install SQL Server 2017 RC1 on Red Hat Enterprise Linux (RHEL) 7.3. Then connect with **sqlcmd** to create your first database and run queries.
16
+
In this quick start tutorial, you first install SQL Server 2017 RC2 on Red Hat Enterprise Linux (RHEL) 7.3. Then connect with **sqlcmd** to create your first database and run queries.
17
17
18
18
> [!TIP]
19
19
> This tutorial requires user input and an internet connection. If you are interested in the [unattended](sql-server-linux-setup.md#unattended) or [offline](sql-server-linux-setup.md#offline) installation procedures, see [Installation guidance for SQL Server on Linux](sql-server-linux-setup.md).
@@ -52,11 +52,11 @@ To configure SQL Server on RHEL, run the following commands in a terminal to ins
52
52
> Make sure to specify a strong password for the SA account (Minimum length 8 characters, including uppercase and lowercase letters, base 10 digits and/or non-alphanumeric symbols).
53
53
54
54
> [!TIP]
55
-
> When installing RC1, no purchased licenses are required to try any of the editions. Because it is a release candidate, the following message appears regardless of the edition you select:
55
+
> When installing RC2, no purchased licenses are required to try any of the editions. Because it is a release candidate, the following message appears regardless of the edition you select:
56
56
>
57
57
> `This is an evaluation version. There are [175] days left in the evaluation period.`
58
58
>
59
-
> This message does not reflect the edition you selected. It relates to the preview period for RC1.
59
+
> This message does not reflect the edition you selected. It relates to the preview period for RC2.
60
60
61
61
1. Once the configuration is done, verify that the service is running:
# Install SQL Server and create a database on SUSE Linux Enterprise Server
15
15
16
-
In this quick start tutorial, you first install SQL Server 2017 RC1 on SUSE Linux Enterprise Server (SLES) v12 SP2. Then connect with **sqlcmd** to create your first database and run queries.
16
+
In this quick start tutorial, you first install SQL Server 2017 RC2 on SUSE Linux Enterprise Server (SLES) v12 SP2. Then connect with **sqlcmd** to create your first database and run queries.
17
17
18
18
> [!TIP]
19
19
> This tutorial requires user input and an internet connection. If you are interested in the [unattended](sql-server-linux-setup.md#unattended) or [offline](sql-server-linux-setup.md#offline) installation procedures, see [Installation guidance for SQL Server on Linux](sql-server-linux-setup.md).
@@ -53,11 +53,11 @@ To configure SQL Server on SLES, run the following commands in a terminal to ins
53
53
> Make sure to specify a strong password for the SA account (Minimum length 8 characters, including uppercase and lowercase letters, base 10 digits and/or non-alphanumeric symbols).
54
54
55
55
> [!TIP]
56
-
> When installing RC1, no purchased licenses are required to try any of the editions. Because it is a release candidate, the following message appears regardless of the edition you select:
56
+
> When installing RC2, no purchased licenses are required to try any of the editions. Because it is a release candidate, the following message appears regardless of the edition you select:
57
57
>
58
58
> `This is an evaluation version. There are [175] days left in the evaluation period.`
59
59
>
60
-
> This message does not reflect the edition you selected. It relates to the preview period for RC1.
60
+
> This message does not reflect the edition you selected. It relates to the preview period for RC2.
61
61
62
62
1. Once the configuration is done, verify that the service is running:
# Install SQL Server and create a database on Ubuntu
14
14
15
-
In this quick start tutorial, you first install SQL Server 2017 RC1 on Ubuntu 16.04. Then connect with **sqlcmd** to create your first database and run queries.
15
+
In this quick start tutorial, you first install SQL Server 2017 RC2 on Ubuntu 16.04. Then connect with **sqlcmd** to create your first database and run queries.
16
16
17
17
> [!TIP]
18
18
> This tutorial requires user input and an internet connection. If you are interested in the [unattended](sql-server-linux-setup.md#unattended) or [offline](sql-server-linux-setup.md#offline) installation procedures, see [Installation guidance for SQL Server on Linux](sql-server-linux-setup.md).
@@ -58,11 +58,11 @@ To configure SQL Server on Ubuntu, run the following commands in a terminal to i
58
58
> Make sure to specify a strong password for the SA account (Minimum length 8 characters, including uppercase and lowercase letters, base 10 digits and/or non-alphanumeric symbols).
59
59
60
60
> [!TIP]
61
-
> When installing RC1, no purchased licenses are required to try any of the editions. Because it is a release candidate, the following message appears regardless of the edition you select:
61
+
> When installing RC2, no purchased licenses are required to try any of the editions. Because it is a release candidate, the following message appears regardless of the edition you select:
62
62
>
63
63
> `This is an evaluation version. There are [175] days left in the evaluation period.`
64
64
>
65
-
> This message does not reflect the edition you selected. It relates to the preview period for RC1.
65
+
> This message does not reflect the edition you selected. It relates to the preview period for RC2.
66
66
67
67
1. Once the configuration is done, verify that the service is running:
0 commit comments