You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/relational-databases/polybase/polybase-guide.md
+7-9Lines changed: 7 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
---
2
2
title: "Introducing data virtualization with PolyBase"
3
-
description: PolyBase enables your SQL Server instance to process Transact-SQL queries that read data from external data sources such as Hadoop and Azure Blob Storage.
3
+
description: PolyBase enables your SQL Server instance to process Transact-SQL queries that read data from external data sources such as Azure Blob Storage.
4
4
ms.date: 08/22/2022
5
5
ms.prod: sql
6
6
ms.technology: polybase
@@ -43,7 +43,7 @@ PolyBase provides these same functionalities for the following SQL products from
43
43
44
44
-[!INCLUDE[sssql16-md](../../includes/sssql16-md.md)] and later versions (Windows)
45
45
-[!INCLUDE[sssql19-md](../../includes/sssql19-md.md)] and later versions (Windows and Linux)
46
-
-[!INCLUDE[ssNoVersion](../../includes/ssnoversion-md.md)][!INCLUDE[pdw](../../includes/sspdw-md.md)] (PDW), hosted in the Analytics Platform System (APS)
@@ -101,8 +101,6 @@ For an example using PolyBase in [!INCLUDE[sssql22-md](../../includes/sssql22-md
101
101
1. Create an [external data source](../../t-sql/statements/create-external-data-source-transact-sql.md).
102
102
1. Create an [external table](../../t-sql/statements/create-external-table-transact-sql.md).
103
103
104
-
105
-
106
104
### Azure integration
107
105
108
106
With the underlying help of PolyBase, T-SQL queries can also import and export data from Azure Blob Storage. Further, PolyBase enables [!INCLUDE[ssazuresynapse_md](../../includes/ssazuresynapse_md.md)] to import and export data from Azure Data Lake Store, and from Azure Blob Storage.
@@ -122,10 +120,10 @@ PolyBase does not require you to install additional software to your Hadoop envi
122
120
123
121
PolyBase enables the following scenarios in [!INCLUDE[ssNoVersion](../../includes/ssnoversion-md.md)]:
124
122
125
-
-**Query data stored in Hadoop from a [!INCLUDE[ssNoVersion](../../includes/ssnoversion-md.md)] instance or PDW.** Users are storing data in cost-effective distributed and scalable systems, such as Hadoop. PolyBase makes it easy to query the data by using T-SQL.
126
-
127
123
-**Query data stored in Azure Blob Storage.** Azure Blob Storage is a convenient place to store data for use by Azure services. PolyBase makes it easy to access the data by using T-SQL.
128
124
125
+
-**Query data stored in Hadoop from a [!INCLUDE[ssNoVersion](../../includes/ssnoversion-md.md)] instance or PDW.** Users are storing data in cost-effective distributed and scalable systems, such as Hadoop. PolyBase makes it easy to query the data by using T-SQL.
126
+
129
127
-**Import data from Hadoop, Azure Blob Storage, or Azure Data Lake Store.** Leverage the speed of Microsoft SQL's columnstore technology and analysis capabilities by importing data from Hadoop, Azure Blob Storage, or Azure Data Lake Store into relational tables. There is no need for a separate ETL or import tool.
130
128
131
129
-**Export data to Hadoop, Azure Blob Storage, or Azure Data Lake Store.** Archive data to Hadoop, Azure Blob Storage, or Azure Data Lake Store to achieve cost-effective storage and keep it online for easy access.
@@ -142,15 +140,15 @@ PolyBase enables the following scenarios in [!INCLUDE[ssNoVersion](../../include
142
140
143
141
## Upgrading to SQL Server 2022
144
142
145
-
Starting in [!INCLUDE [sssql22-md](../../includes/sssql22-md.md)] Hadoop is no longer supported. Azure Storage connectors must be changed based on the reference table below:
143
+
Starting in [!INCLUDE [sssql22-md](../../includes/sssql22-md.md)] Hortonworks Data Platform (HDP) and Cloudera Distributed Hadoop (CDH) are no longer supported. Due to these changes, it is required to manually drop PolyBase external data sources created on previous versions of SQL Server that use `TYPE = HADOOP` or Azure Storage before migrating to [!INCLUDE [sssql22-md](../../includes/sssql22-md.md)]. Dropping external data sources also requires dropping the associated database objects, such as database scoped credentials and external tables.
144
+
145
+
Azure Storage connectors must be changed based on the reference table below:
146
146
147
147
| External Data Source | From | To |
148
148
|:--|:--|:--|
149
149
| Azure Blob Storage | wasb[s]| abs |
150
150
| ADLS Gen 2 | abfs[s]| adls |
151
151
152
-
Due to these changes, it is required to manually drop PolyBase external data sources created on previous versions of SQL Server that use `TYPE = HADOOP` or Azure Storage before migrating to [!INCLUDE [sssql22-md](../../includes/sssql22-md.md)]. Dropping external data sources also requires dropping the associated database objects, such as database scoped credentials and external tables.
153
-
154
152
## Next steps
155
153
156
154
Before using PolyBase, you must [install PolyBase on Windows](polybase-installation.md) or [install PolyBase on Linux](polybase-linux-setup.md), and [enable PolyBase in sp_configure](polybase-installation.md#enable) if necessary. For more tutorials on creating external data sources and external tables to a variety of data sources, see [PolyBase Transact-SQL reference](polybase-t-sql-objects.md).
0 commit comments