Skip to content

Conversation

@vjanelle
Copy link

What changes were proposed in this pull request?

Changing how two variables used when spark-submit is executed from a static assignment to a dynamic one - goal is to embed the spark-submit process in a jvm for faster startup.

Why are the changes needed?

Reduce the total technical debt to embed the driver/configmap creation process to match upstream

Does this PR introduce any user-facing change?

No

How was this patch tested?

Still testing

Was this patch authored or co-authored using generative AI tooling?

No

@github-actions
Copy link

JIRA Issue Information

=== Improvement SPARK-55120 ===
Summary: Embedding spark-submit
Assignee: None
Status: Open
Affected: ["3.1.0"]


This comment was automatically generated by GitHub Actions

@vjanelle vjanelle marked this pull request as draft January 21, 2026 22:33
@HyukjinKwon HyukjinKwon changed the title [SPARK-55120][KUBERNETE$S] Change driver/executor uuid to be val instead of def [SPARK-55120][K8S] Change driver/executor uuid to be val instead of def Jan 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant