Bump github.com/databricks/databricks-sdk-go from 0.65.0 to 0.67.0 (#2812)

Bumps
[github.com/databricks/databricks-sdk-go](https://github.com/databricks/databricks-sdk-go)
from 0.65.0 to 0.67.0.
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/databricks/databricks-sdk-go/blob/main/CHANGELOG.md">github.com/databricks/databricks-sdk-go's
changelog</a>.</em></p>
<blockquote>
<h2>Release v0.67.0</h2>
<h3>Bug Fixes</h3>
<ul>
<li>Fixed the deserialization of responses in VectorSearchAPI's
<code>QueryIndex()</code> method (<a
href="https://redirect.github.com/databricks/databricks-sdk-py/pull/1214">#1214</a>).</li>
</ul>
<h3>API Changes</h3>
<ul>
<li>Added <code>FutureFeatureDataPath</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/ml#CreateForecastingExperimentRequest">ml.CreateForecastingExperimentRequest</a>.</li>
<li>Added <code>ExcludeColumns</code> and <code>IncludeColumns</code>
fields for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#TableSpecificConfig">pipelines.TableSpecificConfig</a>.</li>
<li>Added <code>NetworkCheckControlPlaneFailure</code>,
<code>NetworkCheckDnsServerFailure</code>,
<code>NetworkCheckMetadataEndpointFailure</code>,
<code>NetworkCheckMultipleComponentsFailure</code>,
<code>NetworkCheckNicFailure</code>,
<code>NetworkCheckStorageFailure</code> and
<code>SecretPermissionDenied</code> enum values for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/compute#TerminationReasonCode">compute.TerminationReasonCode</a>.</li>
<li>[Breaking] Changed <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/vectorsearch#ListValue">vectorsearch.ListValue</a>
to.</li>
<li>[Breaking] Changed <code>PipelineId</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#EditPipeline">pipelines.EditPipeline</a>
to be required.</li>
<li>Changed <code>ConnectionName</code>,
<code>GatewayStorageCatalog</code> and <code>GatewayStorageSchema</code>
fields for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#IngestionGatewayPipelineDefinition">pipelines.IngestionGatewayPipelineDefinition</a>
to be required.</li>
<li>[Breaking] Changed <code>ConnectionName</code>,
<code>GatewayStorageCatalog</code> and <code>GatewayStorageSchema</code>
fields for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#IngestionGatewayPipelineDefinition">pipelines.IngestionGatewayPipelineDefinition</a>
to be required.</li>
<li>[Breaking] Changed <code>Kind</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#PipelineDeployment">pipelines.PipelineDeployment</a>
to be required.</li>
<li>Changed <code>Kind</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#PipelineDeployment">pipelines.PipelineDeployment</a>
to be required.</li>
<li>[Breaking] Changed <code>DestinationCatalog</code>,
<code>DestinationSchema</code> and <code>SourceUrl</code> fields for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#ReportSpec">pipelines.ReportSpec</a>
to be required.</li>
<li>Changed <code>DestinationCatalog</code>,
<code>DestinationSchema</code> and <code>SourceUrl</code> fields for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#ReportSpec">pipelines.ReportSpec</a>
to be required.</li>
<li>[Breaking] Changed <code>DestinationCatalog</code>,
<code>DestinationSchema</code> and <code>SourceSchema</code> fields for
<a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#SchemaSpec">pipelines.SchemaSpec</a>
to be required.</li>
<li>Changed <code>DestinationCatalog</code>,
<code>DestinationSchema</code> and <code>SourceSchema</code> fields for
<a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#SchemaSpec">pipelines.SchemaSpec</a>
to be required.</li>
<li>Changed <code>DestinationCatalog</code>,
<code>DestinationSchema</code> and <code>SourceTable</code> fields for
<a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#TableSpec">pipelines.TableSpec</a>
to be required.</li>
<li>[Breaking] Changed <code>DestinationCatalog</code>,
<code>DestinationSchema</code> and <code>SourceTable</code> fields for
<a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/pipelines#TableSpec">pipelines.TableSpec</a>
to be required.</li>
<li>[Breaking] Changed pagination for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/sql#AlertsV2API.ListAlerts">AlertsV2API.ListAlerts</a>.</li>
<li>[Breaking] Changed waiter for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/dashboards#GenieAPI.CreateMessage">GenieAPI.CreateMessage</a>.</li>
</ul>
<h2>Release v0.66.0</h2>
<h3>Bug Fixes</h3>
<ul>
<li>Tolerate trailing slashes in hostnames in <code>Config</code>.</li>
</ul>
<h3>API Changes</h3>
<ul>
<li>Added <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/sql#AlertsV2API">w.AlertsV2</a>
workspace-level service.</li>
<li>Added <code>UpdateNccAzurePrivateEndpointRulePublic</code> method
for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#NetworkConnectivityAPI">a.NetworkConnectivity</a>
account-level service.</li>
<li>Added <code>CreatedAt</code>, <code>CreatedBy</code> and
<code>MetastoreId</code> fields for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/catalog#SetArtifactAllowlist">catalog.SetArtifactAllowlist</a>.</li>
<li>[Breaking] Added <code>NetworkConnectivityConfig</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#CreateNetworkConnectivityConfigRequest">settings.CreateNetworkConnectivityConfigRequest</a>.</li>
<li>[Breaking] Added <code>PrivateEndpointRule</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#CreatePrivateEndpointRuleRequest">settings.CreatePrivateEndpointRuleRequest</a>.</li>
<li>Added <code>DomainNames</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#NccAzurePrivateEndpointRule">settings.NccAzurePrivateEndpointRule</a>.</li>
<li>Added <code>AutoResolveDisplayName</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/sql#CreateAlertRequest">sql.CreateAlertRequest</a>.</li>
<li>Added <code>AutoResolveDisplayName</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/sql#CreateQueryRequest">sql.CreateQueryRequest</a>.</li>
<li>Added <code>CreateCleanRoom</code>,
<code>ExecuteCleanRoomTask</code> and <code>ModifyCleanRoom</code> enum
values for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/catalog#Privilege">catalog.Privilege</a>.</li>
<li>Added <code>DnsResolutionError</code> and
<code>GcpDeniedByOrgPolicy</code> enum values for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/compute#TerminationReasonCode">compute.TerminationReasonCode</a>.</li>
<li>Added <code>Expired</code> enum value for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#NccAzurePrivateEndpointRuleConnectionState">settings.NccAzurePrivateEndpointRuleConnectionState</a>.</li>
<li>[Breaking] Changed
<code>CreateNetworkConnectivityConfiguration</code> and
<code>CreatePrivateEndpointRule</code> methods for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#NetworkConnectivityAPI">a.NetworkConnectivity</a>
account-level service with new required argument order.</li>
<li>[Breaking] Changed <code>WorkloadSize</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/serving#ServedModelInput">serving.ServedModelInput</a>
to type <code>string</code>.</li>
<li>[Breaking] Changed <code>GroupId</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#NccAzurePrivateEndpointRule">settings.NccAzurePrivateEndpointRule</a>
to type <code>string</code>.</li>
<li>[Breaking] Changed <code>TargetServices</code> field for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#NccAzureServiceEndpointRule">settings.NccAzureServiceEndpointRule</a>
to type <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#EgressResourceTypeList">settings.EgressResourceTypeList</a>.</li>
<li>[Breaking] Removed <code>Name</code> and <code>Region</code> fields
for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#CreateNetworkConnectivityConfigRequest">settings.CreateNetworkConnectivityConfigRequest</a>.</li>
<li>[Breaking] Removed <code>GroupId</code> and <code>ResourceId</code>
fields for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#CreatePrivateEndpointRuleRequest">settings.CreatePrivateEndpointRuleRequest</a>.</li>
<li>[Breaking] Removed <code>Large</code>, <code>Medium</code> and
<code>Small</code> enum values for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/serving#ServedModelInputWorkloadSize">serving.ServedModelInputWorkloadSize</a>.</li>
<li>[Breaking] Removed <code>Blob</code>, <code>Dfs</code>,
<code>MysqlServer</code> and <code>SqlServer</code> enum values for <a
href="https://pkg.go.dev/github.com/databricks/databricks-sdk-go/service/settings#NccAzurePrivateEndpointRuleGroupId">settings.NccAzurePrivateEndpointRuleGroupId</a>.</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/databricks/databricks-sdk-go/commit/13af0878b6d34ffa07009b02050b124d3217f4d1"><code>13af087</code></a>
[Release] Release v0.67.0</li>
<li><a
href="https://github.com/databricks/databricks-sdk-go/commit/c7796ceca71d5fc91ff6ead4066fe43055619e89"><code>c7796ce</code></a>
Bump API Specification to 2 May 2025 (<a
href="https://redirect.github.com/databricks/databricks-sdk-go/issues/1214">#1214</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-go/commit/4e775146dc0cb65a9e5621040ba38e0ffd91143c"><code>4e77514</code></a>
[Release] Release v0.66.0</li>
<li><a
href="https://github.com/databricks/databricks-sdk-go/commit/cedae03775b56d60b96f5d4415323ae2a2c340db"><code>cedae03</code></a>
Bump API specification to 30 Apr 2025 (<a
href="https://redirect.github.com/databricks/databricks-sdk-go/issues/1212">#1212</a>)</li>
<li><a
href="https://github.com/databricks/databricks-sdk-go/commit/eab964f3172844ba6280b2eb57b5562a16bf16fd"><code>eab964f</code></a>
Tolerate trailing slash (<a
href="https://redirect.github.com/databricks/databricks-sdk-go/issues/1211">#1211</a>)</li>
<li>See full diff in <a
href="https://github.com/databricks/databricks-sdk-go/compare/v0.65.0...v0.67.0">compare
view</a></li>
</ul>
</details>
<br />

<details>
<summary>Most Recent Ignore Conditions Applied to This Pull
Request</summary>

| Dependency Name | Ignore Conditions |
| --- | --- |
| github.com/databricks/databricks-sdk-go | [>= 0.28.a, < 0.29] |
</details>


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=github.com/databricks/databricks-sdk-go&package-manager=go_modules&previous-version=0.65.0&new-version=0.67.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Andrew Nester <andrew.nester@databricks.com>

Author: dependabot[bot]

.codegen.json

@@ -10,17 +10,19 @@
         ".codegen/cmds-account.go.tmpl": "cmd/account/cmd.go"
     },
     "version": {
-      "experimental/python/README.md": "version $VERSION or above",
-      "experimental/python/databricks/bundles/version.py": "__version__ = \"$VERSION\"",
-      "experimental/python/pyproject.toml": "version = \"$VERSION\"",
-      "experimental/python/uv.lock": "name = \"databricks-bundles\"\nversion = \"$VERSION\"",
-      "libs/template/templates/experimental-jobs-as-code/library/versions.tmpl": "{{define \"latest_databricks_bundles_version\" -}}$VERSION{{- end}}"
+        "experimental/python/README.md": "version $VERSION or above",
+        "experimental/python/databricks/bundles/version.py": "__version__ = \"$VERSION\"",
+        "experimental/python/pyproject.toml": "version = \"$VERSION\"",
+        "experimental/python/uv.lock": "name = \"databricks-bundles\"\nversion = \"$VERSION\"",
+        "libs/template/templates/experimental-jobs-as-code/library/versions.tmpl": "{{define \"latest_databricks_bundles_version\" -}}$VERSION{{- end}}"
     },
     "toolchain": {
         "required": [
             "go"
         ],
         "post_generate": [
+            "[ ! -f tagging.py ] || mv tagging.py internal/genkit/tagging.py",
+            "rm .github/workflows/next-changelog.yml",
             "go test -timeout 240s -run TestConsistentDatabricksSdkVersion github.com/databricks/cli/internal/build",
             "make schema",
             "echo 'bundle/internal/tf/schema/\\*.go linguist-generated=true' >> ./.gitattributes",

.codegen/_openapi_sha

@@ -1 +1 @@
-06a18b97d7996d6cd8dd88bfdb0f2c2792739e46
+d4c86c045ee9d0410a41ef07e8ae708673b95fa1

.codegen/service.go.tmpl

@@ -128,7 +128,7 @@ func new{{.PascalName}}() *cobra.Command {
 
 	var {{.CamelName}}Req {{.Service.Package.Name}}.{{.Request.PascalName}}
 	{{- if .RequestBodyField }}
-	{{.CamelName}}Req.{{.RequestBodyField.PascalName}} = &{{.Service.Package.Name}}.{{.RequestBodyField.Entity.PascalName}}{}
+	{{.CamelName}}Req.{{.RequestBodyField.PascalName}} = {{ if .RequestBodyField.IsOptionalObject }}&{{end}}{{.Service.Package.Name}}.{{.RequestBodyField.Entity.PascalName}}{}
 	{{- end }}
 	{{- if $canUseJson}}
 	var {{.CamelName}}Json flags.JsonFlag

.gitattributes

@@ -37,6 +37,7 @@ cmd/workspace/access-control/access-control.go linguist-generated=true
 cmd/workspace/aibi-dashboard-embedding-access-policy/aibi-dashboard-embedding-access-policy.go linguist-generated=true
 cmd/workspace/aibi-dashboard-embedding-approved-domains/aibi-dashboard-embedding-approved-domains.go linguist-generated=true
 cmd/workspace/alerts-legacy/alerts-legacy.go linguist-generated=true
+cmd/workspace/alerts-v2/alerts-v2.go linguist-generated=true
 cmd/workspace/alerts/alerts.go linguist-generated=true
 cmd/workspace/apps/apps.go linguist-generated=true
 cmd/workspace/artifact-allowlists/artifact-allowlists.go linguist-generated=true

.github/workflows/tagging.yml

@@ -48,4 +48,4 @@ jobs:
           GITHUB_TOKEN: ${{ steps.generate-token.outputs.token }}
           GITHUB_REPOSITORY: ${{ github.repository }}
         run: |
-          python internal/genkit/tagging.py
+          python tagging.py

bundle/internal/schema/annotations_openapi.yml

@@ -349,12 +349,10 @@ github.com/databricks/cli/bundle/config/resources.Job:
       Job-level parameter definitions
   "performance_target":
     "description": |-
-      The performance mode on a serverless job. The performance target determines the level of compute performance or cost-efficiency for the run.
+      The performance mode on a serverless job. This field determines the level of compute performance or cost-efficiency for the run.
 
       * `STANDARD`: Enables cost-efficient execution of serverless workloads.
       * `PERFORMANCE_OPTIMIZED`: Prioritizes fast startup and execution times through rapid scaling and optimized cluster performance.
-    "x-databricks-preview": |-
-      PRIVATE
   "queue":
     "description": |-
       The queue settings of the job.
@@ -1410,7 +1408,8 @@ github.com/databricks/databricks-sdk-go/service/compute.EbsVolumeType:
 github.com/databricks/databricks-sdk-go/service/compute.Environment:
   "_":
     "description": |-
-      The environment entity used to preserve serverless environment side panel and jobs' environment for non-notebook task.
+      The environment entity used to preserve serverless environment side panel, jobs' environment for non-notebook task, and DLT's environment for classic and serverless pipelines.
+      (Note: DLT uses a copied version of the Environment proto below, at //spark/pipelines/api/protos/copied/libraries-environments-copy.proto)
       In this minimal environment spec, only pip dependencies are supported.
   "client":
     "description": |-
@@ -1981,7 +1980,8 @@ github.com/databricks/databricks-sdk-go/service/jobs.JobEnvironment:
       The key of an environment. It has to be unique within a job.
   "spec":
     "description": |-
-      The environment entity used to preserve serverless environment side panel and jobs' environment for non-notebook task.
+      The environment entity used to preserve serverless environment side panel, jobs' environment for non-notebook task, and DLT's environment for classic and serverless pipelines.
+      (Note: DLT uses a copied version of the Environment proto below, at //spark/pipelines/api/protos/copied/libraries-environments-copy.proto)
       In this minimal environment spec, only pip dependencies are supported.
 github.com/databricks/databricks-sdk-go/service/jobs.JobNotificationSettings:
   "no_alert_for_canceled_runs":
@@ -2583,8 +2583,6 @@ github.com/databricks/databricks-sdk-go/service/jobs.Task:
   "power_bi_task":
     "description": |-
       The task triggers a Power BI semantic model update when the `power_bi_task` field is present.
-    "x-databricks-preview": |-
-      PRIVATE
   "python_wheel_task":
     "description": |-
       The task runs a Python wheel when the `python_wheel_task` field is present.
@@ -2819,7 +2817,7 @@ github.com/databricks/databricks-sdk-go/service/pipelines.DayOfWeek:
         SUNDAY
 github.com/databricks/databricks-sdk-go/service/pipelines.DeploymentKind:
   "_":
-    "description": |
+    "description": |-
       The deployment method that manages the pipeline:
       - BUNDLE: The pipeline is managed by a Databricks Asset Bundle.
     "enum":
@@ -2841,7 +2839,7 @@ github.com/databricks/databricks-sdk-go/service/pipelines.EventLogSpec:
 github.com/databricks/databricks-sdk-go/service/pipelines.FileLibrary:
   "path":
     "description": |-
-      The absolute path of the file.
+      The absolute path of the source code.
 github.com/databricks/databricks-sdk-go/service/pipelines.Filters:
   "exclude":
     "description": |-
@@ -2872,7 +2870,7 @@ github.com/databricks/databricks-sdk-go/service/pipelines.IngestionGatewayPipeli
     "description": |-
       Required, Immutable. The name of the catalog for the gateway pipeline's storage location.
   "gateway_storage_name":
-    "description": |
+    "description": |-
       Optional. The Unity Catalog-compatible name for the gateway storage location.
       This is the destination to use for the data that is extracted by the gateway.
       Delta Live Tables system will automatically create the storage location under the catalog and schema.
@@ -2896,10 +2894,10 @@ github.com/databricks/databricks-sdk-go/service/pipelines.ManualTrigger: {}
 github.com/databricks/databricks-sdk-go/service/pipelines.NotebookLibrary:
   "path":
     "description": |-
-      The absolute path of the notebook.
+      The absolute path of the source code.
 github.com/databricks/databricks-sdk-go/service/pipelines.Notifications:
   "alerts":
-    "description": |
+    "description": |-
       A list of alerts that trigger the sending of notifications to the configured
       destinations. The supported alerts are:
 
@@ -2908,7 +2906,7 @@ github.com/databricks/databricks-sdk-go/service/pipelines.Notifications:
       * `on-update-fatal-failure`: A pipeline update fails with a non-retryable (fatal) error.
       * `on-flow-failure`: A single data flow fails.
   "email_recipients":
-    "description": |
+    "description": |-
       A list of email addresses notified when a configured alert is triggered.
 github.com/databricks/databricks-sdk-go/service/pipelines.PipelineCluster:
   "apply_policy_default_values":
@@ -2927,7 +2925,7 @@ github.com/databricks/databricks-sdk-go/service/pipelines.PipelineCluster:
       Attributes related to clusters running on Microsoft Azure.
       If not specified at cluster creation, a set of default values will be used.
   "cluster_log_conf":
-    "description": |
+    "description": |-
       The configuration for delivering spark logs to a long-term storage destination.
       Only dbfs destinations are supported. Only one destination can be specified
       for one cluster. If the conf is given, the logs will be delivered to the destination every
@@ -2968,7 +2966,7 @@ github.com/databricks/databricks-sdk-go/service/pipelines.PipelineCluster:
     "description": |-
       A label for the cluster specification, either `default` to configure the default cluster, or `maintenance` to configure the maintenance cluster. This field is optional. The default value is `default`.
   "node_type_id":
-    "description": |
+    "description": |-
       This field encodes, through a single value, the resources available to each of
       the Spark nodes in this cluster. For example, the Spark nodes can be provisioned
       and optimized for memory or compute intensive workloads. A list of available node
@@ -2987,7 +2985,7 @@ github.com/databricks/databricks-sdk-go/service/pipelines.PipelineCluster:
     "description": |-
       The ID of the cluster policy used to create the cluster if applicable.
   "spark_conf":
-    "description": |
+    "description": |-
       An object containing a set of optional, user-specified Spark configuration key-value pairs.
       See :method:clusters/create for more details.
   "spark_env_vars":
@@ -3017,15 +3015,15 @@ github.com/databricks/databricks-sdk-go/service/pipelines.PipelineClusterAutosca
       The minimum number of workers the cluster can scale down to when underutilized.
       It is also the initial number of workers the cluster will have after creation.
   "mode":
-    "description": |
+    "description": |-
       Databricks Enhanced Autoscaling optimizes cluster utilization by automatically
       allocating cluster resources based on workload volume, with minimal impact to
       the data processing latency of your pipelines. Enhanced Autoscaling is available
       for `updates` clusters only. The legacy autoscaling feature is used for `maintenance`
       clusters.
 github.com/databricks/databricks-sdk-go/service/pipelines.PipelineClusterAutoscaleMode:
   "_":
-    "description": |
+    "description": |-
       Databricks Enhanced Autoscaling optimizes cluster utilization by automatically
       allocating cluster resources based on workload volume, with minimal impact to
       the data processing latency of your pipelines. Enhanced Autoscaling is available
@@ -3045,20 +3043,20 @@ github.com/databricks/databricks-sdk-go/service/pipelines.PipelineDeployment:
       The path to the file containing metadata about the deployment.
 github.com/databricks/databricks-sdk-go/service/pipelines.PipelineLibrary:
   "file":
-    "description": |
+    "description": |-
       The path to a file that defines a pipeline and is stored in the Databricks Repos.
   "jar":
-    "description": |
+    "description": |-
       URI of the jar to be installed. Currently only DBFS is supported.
     "x-databricks-preview": |-
       PRIVATE
   "maven":
-    "description": |
+    "description": |-
       Specification of a maven library to be installed.
     "x-databricks-preview": |-
       PRIVATE
   "notebook":
-    "description": |
+    "description": |-
       The path to a notebook that defines a pipeline and is stored in the Databricks workspace.
   "whl":
     "description": |-
@@ -3148,6 +3146,19 @@ github.com/databricks/databricks-sdk-go/service/pipelines.TableSpec:
     "description": |-
       Configuration settings to control the ingestion of tables. These settings override the table_configuration defined in the IngestionPipelineDefinition object and the SchemaSpec.
 github.com/databricks/databricks-sdk-go/service/pipelines.TableSpecificConfig:
+  "exclude_columns":
+    "description": |-
+      A list of column names to be excluded for the ingestion.
+      When not specified, include_columns fully controls what columns to be ingested.
+      When specified, all other columns including future ones will be automatically included for ingestion.
+      This field in mutually exclusive with `include_columns`.
+  "include_columns":
+    "description": |-
+      A list of column names to be included for the ingestion.
+      When not specified, all columns except ones in exclude_columns will be included. Future
+      columns will be automatically included.
+      When specified, all other future columns will be automatically excluded from ingestion.
+      This field in mutually exclusive with `exclude_columns`.
   "primary_keys":
     "description": |-
       The primary key of the table used to apply changes.
@@ -3692,7 +3703,7 @@ github.com/databricks/databricks-sdk-go/service/serving.ServedEntityInput:
       Whether the compute resources for the served entity should scale down to zero.
   "workload_size":
     "description": |-
-      The workload size of the served entity. The workload size corresponds to a range of provisioned concurrency that the compute autoscales between. A single unit of provisioned concurrency can process one request at a time. Valid workload sizes are "Small" (4 - 4 provisioned concurrency), "Medium" (8 - 16 provisioned concurrency), and "Large" (16 - 64 provisioned concurrency). If scale-to-zero is enabled, the lower bound of the provisioned concurrency for each workload size is 0.
+      The workload size of the served entity. The workload size corresponds to a range of provisioned concurrency that the compute autoscales between. A single unit of provisioned concurrency can process one request at a time. Valid workload sizes are "Small" (4 - 4 provisioned concurrency), "Medium" (8 - 16 provisioned concurrency), and "Large" (16 - 64 provisioned concurrency). Additional custom workload sizes can also be used when available in the workspace. If scale-to-zero is enabled, the lower bound of the provisioned concurrency for each workload size is 0.
   "workload_type":
     "description": |-
       The workload type of the served entity. The workload type selects which type of compute to use in the endpoint. The default value for this parameter is "CPU". For deep learning workloads, GPU acceleration is available by selecting workload types like GPU_SMALL and others. See the available [GPU types](https://docs.databricks.com/en/machine-learning/model-serving/create-manage-serving-endpoints.html#gpu-workload-types).
@@ -3719,19 +3730,10 @@ github.com/databricks/databricks-sdk-go/service/serving.ServedModelInput:
       Whether the compute resources for the served entity should scale down to zero.
   "workload_size":
     "description": |-
-      The workload size of the served entity. The workload size corresponds to a range of provisioned concurrency that the compute autoscales between. A single unit of provisioned concurrency can process one request at a time. Valid workload sizes are "Small" (4 - 4 provisioned concurrency), "Medium" (8 - 16 provisioned concurrency), and "Large" (16 - 64 provisioned concurrency). If scale-to-zero is enabled, the lower bound of the provisioned concurrency for each workload size is 0.
+      The workload size of the served entity. The workload size corresponds to a range of provisioned concurrency that the compute autoscales between. A single unit of provisioned concurrency can process one request at a time. Valid workload sizes are "Small" (4 - 4 provisioned concurrency), "Medium" (8 - 16 provisioned concurrency), and "Large" (16 - 64 provisioned concurrency). Additional custom workload sizes can also be used when available in the workspace. If scale-to-zero is enabled, the lower bound of the provisioned concurrency for each workload size is 0.
   "workload_type":
     "description": |-
       The workload type of the served entity. The workload type selects which type of compute to use in the endpoint. The default value for this parameter is "CPU". For deep learning workloads, GPU acceleration is available by selecting workload types like GPU_SMALL and others. See the available [GPU types](https://docs.databricks.com/en/machine-learning/model-serving/create-manage-serving-endpoints.html#gpu-workload-types).
-github.com/databricks/databricks-sdk-go/service/serving.ServedModelInputWorkloadSize:
-  "_":
-    "enum":
-      - |-
-        Small
-      - |-
-        Medium
-      - |-
-        Large
 github.com/databricks/databricks-sdk-go/service/serving.ServedModelInputWorkloadType:
   "_":
     "description": |-

bundle/run/app.go

@@ -155,7 +155,7 @@ func (a *appRunner) deploy(ctx context.Context) error {
 	sourceCodePath := app.SourceCodePath
 	wait, err := w.Apps.Deploy(ctx, apps.CreateAppDeploymentRequest{
 		AppName: app.Name,
-		AppDeployment: &apps.AppDeployment{
+		AppDeployment: apps.AppDeployment{
 			Mode:           apps.AppDeploymentModeSnapshot,
 			SourceCodePath: sourceCodePath,
 		},
@@ -176,7 +176,7 @@ func (a *appRunner) deploy(ctx context.Context) error {
 		// Now we can try to deploy the app again
 		wait, err = w.Apps.Deploy(ctx, apps.CreateAppDeploymentRequest{
 			AppName: app.Name,
-			AppDeployment: &apps.AppDeployment{
+			AppDeployment: apps.AppDeployment{
 				Mode:           apps.AppDeploymentModeSnapshot,
 				SourceCodePath: sourceCodePath,
 			},

bundle/run/app_test.go

@@ -110,7 +110,7 @@ func setupTestApp(t *testing.T, initialAppState apps.ApplicationState, initialCo
 	}
 	appApi.EXPECT().Deploy(mock.Anything, apps.CreateAppDeploymentRequest{
 		AppName: "my_app",
-		AppDeployment: &apps.AppDeployment{
+		AppDeployment: apps.AppDeployment{
 			Mode:           apps.AppDeploymentModeSnapshot,
 			SourceCodePath: "/Workspace/Users/foo@bar.com/files/my_app",
 		},
@@ -213,7 +213,7 @@ func TestAppDeployWithDeploymentInProgress(t *testing.T) {
 	// First deployment fails
 	appApi.EXPECT().Deploy(mock.Anything, apps.CreateAppDeploymentRequest{
 		AppName: "my_app",
-		AppDeployment: &apps.AppDeployment{
+		AppDeployment: apps.AppDeployment{
 			Mode:           apps.AppDeploymentModeSnapshot,
 			SourceCodePath: "/Workspace/Users/foo@bar.com/files/my_app",
 		},
@@ -237,7 +237,7 @@ func TestAppDeployWithDeploymentInProgress(t *testing.T) {
 	// Second one should succeeed
 	appApi.EXPECT().Deploy(mock.Anything, apps.CreateAppDeploymentRequest{
 		AppName: "my_app",
-		AppDeployment: &apps.AppDeployment{
+		AppDeployment: apps.AppDeployment{
 			Mode:           apps.AppDeploymentModeSnapshot,
 			SourceCodePath: "/Workspace/Users/foo@bar.com/files/my_app",
 		},