| title | azdata bdc spark settings reference |
|---|---|
| titleSuffix | SQL Server Big Data Clusters |
| description | Reference article for azdata bdc spark settings commands. |
| author | MikeRayMSFT |
| ms.author | mikeray |
| ms.reviewer | seanw |
| ms.date | 10/05/2021 |
| ms.prod | sql |
| ms.technology | big-data-cluster |
| ms.topic | reference |
Applies to [!INCLUDE azure-data-cli-azdata]
The following article provides reference for the sql commands in the azdata tool. For more information about other azdata commands, see azdata reference
| Command | Description |
|---|---|
| azdata bdc spark settings set | Set spark service-scope settings. |
| azdata bdc spark settings show | Show spark service-scope settings and optionally spark settings for specified resources |
Provides the ability to set a service-scoped or resource-scoped setting. Specify the full name of the setting and the value. Does not apply the setting to the running BDC. Run apply to do so.
azdata bdc spark settings set [--resources -r]
[--settings -s]Set the default number of driver cores to 1 and driver memory to 1664m for the Spark service.
azdata bdc spark settings set --settings spark-defaults-conf.spark.driver.cores=1,spark-defaults-conf.spark.driver.memory=1664mSet the default number of executor cores to 1 for the Storage Pool.
azdata bdc spark settings set --settings spark-defaults-conf.spark.executor.cores=1 –resources storage-0Sets the given setting(s) for the provided resource(s). Resources can be specified as a comma separated list.
Sets the configured value for the provided settings. Multiple settings can be set using a comma separated list.
Increase logging verbosity to show all debug logs.
Show this help message and exit.
Output format. Allowed values: json, jsonc, table, tsv. Default: json.
JMESPath query string. See http://jmespath.org/ for more information and examples.
Increase logging verbosity. Use --debug for full debug logs.
Shows the BDC's spark service-scope (optionally resource-scope) settings. By default, this command shows user-configured service-scope settings. Filters are available to show all settings (system-managed and configurable), configurable settings, or pending settings. To see a specific service-scope or resource-scope setting, you can provide the setting name. Use “recursive” to show settings for all resources as part of the service.
azdata bdc spark settings show [--resources -r]
[--settings -s]
[--filter-option -f]
[--recursive -rec]
[--include-details -i]
[--description -d]Show the user configured Spark service-scope settings.
azdata bdc spark settings showShow the running and configured value for Spark driver cores in the Storage Pool.
azdata bdc spark settings show --settings spark-defaults-conf.spark.driver.cores --resources storage-0Show any configurable memory-related setting for the Spark service.
azdata bdc spark settings show --settings *memory* --resources storage-0Shows the setting(s) information for the given resource(s). Resources can be specified as a comma separated list.
Shows information for the specified setting name(s).
Filter which cluster-scope settings are shown, rather than only 'User Configured' settings. Filters are available to show all settings (system-managed & user-configurable), all configurable settings, or pending settings.
userConfigured
Shows the setting information for the given scope (service or service-resource) and all lower-scoped components (resources).
Includes additional details for the settings chosen to be shown.
Includes a description of the setting.
Increase logging verbosity to show all debug logs.
Show this help message and exit.
Output format. Allowed values: json, jsonc, table, tsv. Default: json.
JMESPath query string. See http://jmespath.org/ for more information and examples.
Increase logging verbosity. Use --debug for full debug logs.
For more information about other azdata commands, see azdata reference.
For more information about how to install the azdata tool, see Install azdata.