Merge pull request #18775 from dzsquared/dacfx-releasemarch2021

docs completed for update to dacfx

Author: v-andreaco

docs/toc.yml

@@ -9855,6 +9855,8 @@ items:
         href: tools/sqlpackage/sqlpackage-script.md
     - name: SqlPackage in development pipelines
       href: tools/sqlpackage/sqlpackage-pipelines.md
+    - name: SqlPackage for Azure Synapse Analytics
+      href: tools/sqlpackage/sqlpackage-for-azure-synapse-analytics.md
   - name: SQL Server Profiler
     href: tools/sql-server-profiler/sql-server-profiler.md
     items:

docs/tools/sqlpackage/release-notes-sqlpackage.md

@@ -2,9 +2,9 @@
 title: DacFx and SqlPackage release notes
 description: Release notes for Microsoft sqlpackage.
 ms.custom: "tools|sos"
-ms.date: 02/02/2019
+ms.date: 03/10/2021
 ms.prod: sql
-ms.reviewer: "alayu; sstein"
+ms.reviewer: "llali; sstein"
 ms.prod_service: sql-tools
 ms.topic: conceptual
 author: dzsquared
@@ -16,6 +16,53 @@ ms.author: drskwier
 
 This article lists the features and fixes delivered by the released versions of SqlPackage.exe.
 
+## 18.7 sqlpackage
+
+|Platform|Download|Release date|Version|Build
+|:---|:---|:---|:---|:---|
+|Windows|[MSI Installer](https://go.microsoft.com/fwlink/?linkid=2157201)|March 10, 2021|18.7|15.0.5084.2|
+|macOS .NET Core |[.zip file](https://go.microsoft.com/fwlink/?linkid=2157203)|March 10, 2021| 18.7|15.0.5084.2|
+|Linux .NET Core |[.zip file](https://go.microsoft.com/fwlink/?linkid=2157202)|March 10, 2021| 18.7|15.0.5084.2|
+|Windows .NET Core |[.zip file](https://go.microsoft.com/fwlink/?linkid=2157302)|March 10, 2021| 18.7|15.0.5084.2|
+
+### Features
+| Feature | Details |
+| :------ | :------ |
+| Deployment | Extract/Publish Big Data to/from Azure Storage. For more info, see [SqlPackage for Big Data](sqlpackage-for-azure-synapse-analytics.md) |
+| Azure Synapse Analytics | Row level security support (inline table valued function, security policy, security predicate)  |
+| Azure Synapse Analytics | Workload classification support |
+| Azure SQL Edge | External streaming job support |
+| Azure SQL Edge | Added table and database options for data retention. |
+| Import | Added 2 new index option properties for import operation. *DisableIndexesForDataPhase* (Disable indexes before importing data into SQL Server, default true) and *RebuildIndexesOfflineForDataPhase* (Rebuild indexes offline after importing data into SQL Server, default false) |
+| Logging | Added property for all operations (HashObjectNamesInLogs) that will turn all object names into a hash string in log messages. |
+| Performance | Improvements to import and export performance, including additional logging to assist in determining additional bottlenecks. |
+| SQLCMD | Added property for Deployment and Schema Compare (DoNotEvaluateSqlCmdVariables) that specifies whether SQLCMD variables will be replaced with values. |
+
+
+
+### Fixes
+| Feature | Details |
+| :------ | :------ | 
+| Deployment | Default MAXDOP changed from 0 to 8 for [Azure SQL](https://techcommunity.microsoft.com/t5/azure-sql/changing-default-maxdop-in-azure-sql-database/ba-p/1538528), updating schema model default in DacFx | 
+| Schema Compare | Stored procedures using OUT and OUTPUT keywords to be ignored as a difference |
+| Deployment | Additional validation for Big Data tokens |
+| Build/Deployment | Full schema model cleanup of temp external tables for final dacpac consistency.  |
+| Build/Deployment | Adding error handling and fixing non-Edge 150 RE. |
+| Import/Deployment | Sequence value restored during deployment |
+| Deployment | Fixed an issue where changing the compression option on clustered index caused the table to be recreated instead of alter index. |
+| Deployment | Fixed an issue where a clustered columnstore index was dropped and recreated if table column changed. |
+| Deployment | Fixed external users getting dropped and recreated during deployment. |
+| Schema Compare | Fixed schema compare issue with external streaming job. |
+| Import | Null reference exception raised when enabling ambient setting ReliableDdlEnabled scripting a deployment report.|
+| Deployment | Fixed an issue where deployment steps containing system versioning would be created in the incorrect order. |
+| Deployment | Fixed an issue where schema compare update or dacpac deploy failed due to target containing temporal tables. |
+| Deployment | Reseeds identity value after deployment based on target's previous last value. |
+
+### Known Issues
+| Feature | Details |
+| :------ | :------ |
+| Deployment | The Azure Synapse Analytics Workload Management feature (Workload Groups and Workload Classifiers) is not yet supported | 
+
 ## 18.6 sqlpackage
 
 |Platform|Download|Release date|Version|Build
@@ -269,7 +316,7 @@ This release includes cross-platform preview builds of sqlpackage that target .N
 | :---------- | :------ |
 | Deployment | For .NET Core, build and deployment contributors aren't supported. | 
 | Deployment | For .NET Core, older .dacpac and .bacpac files that use json data serialization aren't supported. | 
-| Deployment | For .NET Core referenced .dacpacs (for example master.dacpac) may not resolve due to issues with case-sensitive file systems. | A workaround is to capitalize the name of the reference file (for example MASTER.BACPAC). |
+| Deployment | For .NET Core referenced .dacpacs (for example master.dacpac) may not resolve due to issues with case-sensitive file systems. A workaround is to capitalize the name of the reference file (for example MASTER.BACPAC). |
 |   |   |
 
 ## 18.0 sqlpackage

docs/tools/sqlpackage/sqlpackage-download.md

@@ -9,7 +9,7 @@ ms.topic: conceptual
 author: "dzsquared"
 ms.author: "drskwier"
 ms.reviewer: "maghan; sstein"
-ms.date: 10/02/2020
+ms.date: 03/10/2021
 ---
 
 # Download and install sqlpackage
@@ -20,10 +20,10 @@ Download and install the latest .NET Framework release and macOS and Linux previ
 
 |Platform|Download|Release date|Version|Build
 |:---|:---|:---|:---|:---|
-|[Windows](#get-sqlpackage-for-windows)|[MSI Installer](https://go.microsoft.com/fwlink/?linkid=2143544)|September 18, 2020| 18.6 | 15.0.4897.1 |
-|[macOS .NET Core](#get-sqlpackage-net-core-for-macos) |[.zip file](https://go.microsoft.com/fwlink/?linkid=2143659)|September 18, 2020| 18.6| 15.0.4897.1 |
-|[Linux .NET Core](#get-sqlpackage-net-core-for-linux) |[.zip file](https://go.microsoft.com/fwlink/?linkid=2143497)|September 18, 2020| 18.6| 15.0.4897.1 |
-|[Windows .NET Core](#get-sqlpackage-net-core-for-windows) |[.zip file](https://go.microsoft.com/fwlink/?linkid=2143496)|September 18, 2020| 18.6| 15.0.4897.1 |
+|[Windows](#get-sqlpackage-for-windows)|[MSI Installer](https://go.microsoft.com/fwlink/?linkid=2157201)|March 10, 2021| 18.7 | 15.0.5084.2 |
+|[macOS .NET Core](#get-sqlpackage-net-core-for-macos) |[.zip file](https://go.microsoft.com/fwlink/?linkid=2157203)|March 10, 2021| 18.7| 15.0.5084.2 |
+|[Linux .NET Core](#get-sqlpackage-net-core-for-linux) |[.zip file](https://go.microsoft.com/fwlink/?linkid=2157202)|March 10, 2021| 18.7| 15.0.5084.2 |
+|[Windows .NET Core](#get-sqlpackage-net-core-for-windows) |[.zip file](https://go.microsoft.com/fwlink/?linkid=2157302)|March 10, 2021| 18.7| 15.0.5084.2 |
 
 For details about the latest release, see the [release notes](release-notes-sqlpackage.md). To download additional languages, see the [Available Languages](#available-languages) section.
 
@@ -46,13 +46,13 @@ dotnet add package Microsoft.SqlServer.DACFx
 
 This release of sqlpackage includes a standard Windows installer experience, and a .zip: 
 
-1. Download and run the [DacFramework.msi installer for Windows](https://go.microsoft.com/fwlink/?linkid=2143544).
+1. Download and run the [DacFramework.msi installer for Windows](https://go.microsoft.com/fwlink/?linkid=2157201).
 2. Open a new Command Prompt window, and run sqlpackage.exe
     - sqlpackage is installed to the ```C:\Program Files\Microsoft SQL Server\150\DAC\bin``` folder
 
 ## Get sqlpackage .NET Core for Windows
 
-1. Download [sqlpackage for Windows](https://go.microsoft.com/fwlink/?linkid=2143496).
+1. Download [sqlpackage for Windows](https://go.microsoft.com/fwlink/?linkid=2157302).
 2. To extract the file by right clicking on the file in Windows Explorer, and selecting 'Extract All...', and select the target directory.
 3. Open a new Terminal window and cd to the location where sqlpackage was extracted:
 
@@ -62,7 +62,7 @@ This release of sqlpackage includes a standard Windows installer experience, and
 
 ## Get sqlpackage .NET Core for macOS
 
-1. Download [sqlpackage for macOS](https://go.microsoft.com/fwlink/?linkid=2143659).
+1. Download [sqlpackage for macOS](https://go.microsoft.com/fwlink/?linkid=2157203).
 2. To extract the file and launch sqlpackage, open a new Terminal window and type the following commands:
 
    ```bash
@@ -88,7 +88,7 @@ This release of sqlpackage includes a standard Windows installer experience, and
 
 ## Get sqlpackage .NET Core for Linux
 
-1. Download [sqlpackage for Linux](https://go.microsoft.com/fwlink/?linkid=2143497) by using one of the installers or the tar.gz archive.
+1. Download [sqlpackage for Linux](https://go.microsoft.com/fwlink/?linkid=2157202) by using one of the installers or the tar.gz archive.
 2. To extract the file and launch sqlpackage, open a new Terminal window and type the following commands:
 
    ```bash
@@ -127,6 +127,7 @@ This release of sqlpackage includes a standard Windows installer experience, and
    $ sudo apt-get install libicu55      # for 16.x
    $ sudo apt-get install libicu57      # for 17.x
    $ sudo apt-get install libicu60      # for 18.x
+   $ sudo apt-get install libicu60      # for 20.x
    ```
 
 ## Uninstall sqlpackage
@@ -159,23 +160,23 @@ sqlpackage runs on Windows, macOS, and Linux and is built using .NET Core 3.1.
 
 - Red Hat Enterprise Linux 7+
 - SUSE Linux Enterprise Server v12 SP2+
-- Ubuntu 16.04+
+- Ubuntu 16.04, 18.04, 20.04
 
 ## Available Languages
 
 This release of sqlpackage can be installed in the following languages:
 
 sqlpackage Windows:  
-[Chinese (Simplified)](https://go.microsoft.com/fwlink/?linkid=2143544&clcid=0x804) | [Chinese (Traditional)](https://go.microsoft.com/fwlink/?linkid=2143544&clcid=0x404) | [English (United States)](https://go.microsoft.com/fwlink/?linkid=2143544&clcid=0x409) | [French](https://go.microsoft.com/fwlink/?linkid=2143544&clcid=0x40c) | [German](https://go.microsoft.com/fwlink/?linkid=2143544&clcid=0x407) | [Italian](https://go.microsoft.com/fwlink/?linkid=2143544&clcid=0x410) | [Japanese](https://go.microsoft.com/fwlink/?linkid=2143544&clcid=0x411) | [Korean](https://go.microsoft.com/fwlink/?linkid=2143544&clcid=0x412) | [Portuguese (Brazil)](https://go.microsoft.com/fwlink/?linkid=2143544&clcid=0x416) | [Russian](https://go.microsoft.com/fwlink/?linkid=2143544&clcid=0x419) | [Spanish](https://go.microsoft.com/fwlink/?linkid=2143544&clcid=0x40a)
+[Chinese (Simplified)](https://go.microsoft.com/fwlink/?linkid=2157201&clcid=0x804) | [Chinese (Traditional)](https://go.microsoft.com/fwlink/?linkid=2157201&clcid=0x404) | [English (United States)](https://go.microsoft.com/fwlink/?linkid=2157201&clcid=0x409) | [French](https://go.microsoft.com/fwlink/?linkid=2157201&clcid=0x40c) | [German](https://go.microsoft.com/fwlink/?linkid=2157201&clcid=0x407) | [Italian](https://go.microsoft.com/fwlink/?linkid=2157201&clcid=0x410) | [Japanese](https://go.microsoft.com/fwlink/?linkid=2157201&clcid=0x411) | [Korean](https://go.microsoft.com/fwlink/?linkid=2157201&clcid=0x412) | [Portuguese (Brazil)](https://go.microsoft.com/fwlink/?linkid=2157201&clcid=0x416) | [Russian](https://go.microsoft.com/fwlink/?linkid=2157201&clcid=0x419) | [Spanish](https://go.microsoft.com/fwlink/?linkid=2157201&clcid=0x40a)
 
 sqlpackage .NET Core Windows:  
-[Chinese (Simplified)](https://go.microsoft.com/fwlink/?linkid=2143496&clcid=0x804) | [Chinese (Traditional)](https://go.microsoft.com/fwlink/?linkid=2143496&clcid=0x404) | [English (United States)](https://go.microsoft.com/fwlink/?linkid=2143496&clcid=0x409) | [French](https://go.microsoft.com/fwlink/?linkid=2143496&clcid=0x40c) | [German](https://go.microsoft.com/fwlink/?linkid=2143496&clcid=0x407) | [Italian](https://go.microsoft.com/fwlink/?linkid=2143496&clcid=0x410) | [Japanese](https://go.microsoft.com/fwlink/?linkid=2143496&clcid=0x411) | [Korean](https://go.microsoft.com/fwlink/?linkid=2143496&clcid=0x412) | [Portuguese (Brazil)](https://go.microsoft.com/fwlink/?linkid=2143496&clcid=0x416) | [Russian](https://go.microsoft.com/fwlink/?linkid=2143496&clcid=0x419) | [Spanish](https://go.microsoft.com/fwlink/?linkid=2143496&clcid=0x40a)
+[Chinese (Simplified)](https://go.microsoft.com/fwlink/?linkid=2157302&clcid=0x804) | [Chinese (Traditional)](https://go.microsoft.com/fwlink/?linkid=2157302&clcid=0x404) | [English (United States)](https://go.microsoft.com/fwlink/?linkid=2157302&clcid=0x409) | [French](https://go.microsoft.com/fwlink/?linkid=2157302&clcid=0x40c) | [German](https://go.microsoft.com/fwlink/?linkid=2157302&clcid=0x407) | [Italian](https://go.microsoft.com/fwlink/?linkid=2157302&clcid=0x410) | [Japanese](https://go.microsoft.com/fwlink/?linkid=2157302&clcid=0x411) | [Korean](https://go.microsoft.com/fwlink/?linkid=2157302&clcid=0x412) | [Portuguese (Brazil)](https://go.microsoft.com/fwlink/?linkid=2157302&clcid=0x416) | [Russian](https://go.microsoft.com/fwlink/?linkid=2157302&clcid=0x419) | [Spanish](https://go.microsoft.com/fwlink/?linkid=2157302&clcid=0x40a)
 
 sqlpackage .NET Core macOS:  
-[Chinese (Simplified)](https://go.microsoft.com/fwlink/?linkid=2143659&clcid=0x804) | [Chinese (Traditional)](https://go.microsoft.com/fwlink/?linkid=2143659&clcid=0x404) | [English (United States)](https://go.microsoft.com/fwlink/?linkid=2143659&clcid=0x409) | [French](https://go.microsoft.com/fwlink/?linkid=2143659&clcid=0x40c) | [German](https://go.microsoft.com/fwlink/?linkid=2143659&clcid=0x407) | [Italian](https://go.microsoft.com/fwlink/?linkid=2143659&clcid=0x410) | [Japanese](https://go.microsoft.com/fwlink/?linkid=2143659&clcid=0x411) | [Korean](https://go.microsoft.com/fwlink/?linkid=2143659&clcid=0x412) | [Portuguese (Brazil)](https://go.microsoft.com/fwlink/?linkid=2143659&clcid=0x416) | [Russian](https://go.microsoft.com/fwlink/?linkid=2143659&clcid=0x419) | [Spanish](https://go.microsoft.com/fwlink/?linkid=2143659&clcid=0x40a)
+[Chinese (Simplified)](https://go.microsoft.com/fwlink/?linkid=2157203&clcid=0x804) | [Chinese (Traditional)](https://go.microsoft.com/fwlink/?linkid=2157203&clcid=0x404) | [English (United States)](https://go.microsoft.com/fwlink/?linkid=2157203&clcid=0x409) | [French](https://go.microsoft.com/fwlink/?linkid=2157203&clcid=0x40c) | [German](https://go.microsoft.com/fwlink/?linkid=2157203&clcid=0x407) | [Italian](https://go.microsoft.com/fwlink/?linkid=2157203&clcid=0x410) | [Japanese](https://go.microsoft.com/fwlink/?linkid=2157203&clcid=0x411) | [Korean](https://go.microsoft.com/fwlink/?linkid=2157203&clcid=0x412) | [Portuguese (Brazil)](https://go.microsoft.com/fwlink/?linkid=2157203&clcid=0x416) | [Russian](https://go.microsoft.com/fwlink/?linkid=2157203&clcid=0x419) | [Spanish](https://go.microsoft.com/fwlink/?linkid=2157203&clcid=0x40a)
 
 sqlpackage .NET Core Linux:  
-[Chinese (Simplified)](https://go.microsoft.com/fwlink/?linkid=2143497&clcid=0x804) | [Chinese (Traditional)](https://go.microsoft.com/fwlink/?linkid=2143497&clcid=0x404) | [English (United States)](https://go.microsoft.com/fwlink/?linkid=2143497&clcid=0x409) | [French](https://go.microsoft.com/fwlink/?linkid=2143497&clcid=0x40c) | [German](https://go.microsoft.com/fwlink/?linkid=2143497&clcid=0x407) | [Italian](https://go.microsoft.com/fwlink/?linkid=2143497&clcid=0x410) | [Japanese](https://go.microsoft.com/fwlink/?linkid=2143497&clcid=0x411) | [Korean](https://go.microsoft.com/fwlink/?linkid=2143497&clcid=0x412) | [Portuguese (Brazil)](https://go.microsoft.com/fwlink/?linkid=2143497&clcid=0x416) | [Russian](https://go.microsoft.com/fwlink/?linkid=2143497&clcid=0x419) | [Spanish](https://go.microsoft.com/fwlink/?linkid=2143497&clcid=0x40a)
+[Chinese (Simplified)](https://go.microsoft.com/fwlink/?linkid=2157202&clcid=0x804) | [Chinese (Traditional)](https://go.microsoft.com/fwlink/?linkid=2157202&clcid=0x404) | [English (United States)](https://go.microsoft.com/fwlink/?linkid=2157202&clcid=0x409) | [French](https://go.microsoft.com/fwlink/?linkid=2157202&clcid=0x40c) | [German](https://go.microsoft.com/fwlink/?linkid=2157202&clcid=0x407) | [Italian](https://go.microsoft.com/fwlink/?linkid=2157202&clcid=0x410) | [Japanese](https://go.microsoft.com/fwlink/?linkid=2157202&clcid=0x411) | [Korean](https://go.microsoft.com/fwlink/?linkid=2157202&clcid=0x412) | [Portuguese (Brazil)](https://go.microsoft.com/fwlink/?linkid=2157202&clcid=0x416) | [Russian](https://go.microsoft.com/fwlink/?linkid=2157202&clcid=0x419) | [Spanish](https://go.microsoft.com/fwlink/?linkid=2157202&clcid=0x40a)
 
 
 ## Next Steps

docs/tools/sqlpackage/sqlpackage-extract.md

@@ -9,7 +9,7 @@ ms.assetid: 198198e2-7cf4-4a21-bda4-51b36cb4284b
 author: "dzsquared"
 ms.author: "drskwier"
 ms.reviewer: "maghan; sstein"
-ms.date: 12/11/2020
+ms.date: 3/10/2021
 ---
 
 # SqlPackage Extract parameters and properties
@@ -54,6 +54,10 @@ SqlPackage {parameters}{properties}{SQLCMD Variables}
 
 |Property|Value|Description|
 |---|---|---|
+|**/p:**|AzureStorageBlobEndpoint=(STRING)|Azure blob storage endpoint, see [SqlPackage for Azure Synapse Analytics](sqlpackage-for-azure-synapse-analytics.md#extract).|
+|**/p:**|AzureStorageContainer=(STRING)|Azure blob storage container, see [SqlPackage for Azure Synapse Analytics](sqlpackage-for-azure-synapse-analytics.md#extract).|
+|**/p:**|AzureStorageKey=(STRING)|Azure storage account key, see [SqlPackage for Azure Synapse Analytics](sqlpackage-for-azure-synapse-analytics.md#extract).|
+|**/p:**|AzureStorageRootPath=(STRING)|Storage root path within the container. Without this property, the path defaults to `servername/databasename/timestamp/`. See [SqlPackage for Azure Synapse Analytics](sqlpackage-for-azure-synapse-analytics.md#extract).|
 |**/p:**|CommandTimeout=(INT32 '60')|Specifies the command timeout in seconds when executing queries against SQL Server.|
 |**/p:**|DacApplicationDescription=(STRING)|Defines the Application description to be stored in the DACPAC metadata.|
 |**/p:**|DacApplicationName=(STRING)|Defined the Application name to be stored in the DACPAC metadata. The default value is the database name.|

docs/tools/sqlpackage/sqlpackage-for-azure-synapse-analytics.md

@@ -0,0 +1,41 @@
+---
+title: SqlPackage for Azure Synapse Analytics
+description: Tips for using SqlPackage in Azure Synapse Analytics scenarios
+ms.custom: "tools|sos"
+ms.date: 03/10/2021
+ms.prod: sql
+ms.reviewer: "llali; sstein"
+ms.prod_service: sql-tools
+ms.topic: conceptual
+author: dzsquared
+ms.author: drskwier
+---
+# SqlPackage for Azure Synapse Analytics
+
+This article highlights features of SqlPackage.exe that are focused on Azure Synapse Analytics databases.
+
+## Extract
+To [extract](sqlpackage-extract.md) a schema to Azure Blob Storage, the following properties are required:
+- /p:AzureStorageBlobEndpoint
+- /p:AzureStorageContainer
+- /p:AzureStorageKey
+
+Access for extract is authorized via a storage account key.  An additional parameter is optional, which sets the storage root path within the container:
+- /p:AzureStorageRootPath
+
+Without this property, the path defaults to `servername/databasename/timestamp/`.
+
+## Publish
+To [publish](sqlpackage-publish.md) a schema from a dacpac in Azure Blob Storage, the following properties are required:
+- /p:AzureStorageBlobEndpoint
+- /p:AzureStorageContainer
+- /p:AzureStorageRootPath
+- /p:AzureStorageKey or /p:AzureSharedAccessSignatureToken
+
+Access for publish can be authorized via a storage account key or a shared access signature (SAS) token.
+
+## Next Steps
+- Learn more about [Extract](sqlpackage-extract.md)
+- Learn more about [Publish](sqlpackage-publish.md)
+- Learn more about [Azure Blob Storage](https://docs.microsoft.com/azure/storage/blobs/storage-blobs-introduction)
+- Learn more about [Azure Storage Account Keys](https://docs.microsoft.com/azure/storage/common/storage-account-keys-manage)