Skip to content

[CORE] Add explicit tracking for disabled test suites#12512

Open
zml1206 wants to merge 4 commits into
apache:mainfrom
zml1206:disble_suite
Open

[CORE] Add explicit tracking for disabled test suites#12512
zml1206 wants to merge 4 commits into
apache:mainfrom
zml1206:disble_suite

Conversation

@zml1206

@zml1206 zml1206 commented Jul 15, 2026

Copy link
Copy Markdown
Contributor

No description provided.

Copilot AI review requested due to automatic review settings July 15, 2026 02:48
@github-actions github-actions Bot added the CORE works for Gluten Core label Jul 15, 2026
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@zml1206 zml1206 changed the title [VL] Add explicit tracking for disabled test suites [CORE] Add explicit tracking for disabled test suites Jul 15, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds an explicit “disabled suite” concept to Gluten’s UT backend settings so suites can be intentionally marked as disabled (with a human-readable reason) instead of being silently omitted.

Changes:

  • Introduces disableSuite(...) and a disabledSuites registry in BackendTestSettings, and makes shouldRun short-circuit disabled suites.
  • Updates Spark 4.0 / 4.1 Velox test settings to explicitly disable several suites with documented reasons.
  • Adds Spark 4.0 / 4.1 GlutenSubExprEvaluationRuntimeSuite wrappers so the suite can be referenced and explicitly disabled.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
gluten-ut/common/src/test/scala/org/apache/gluten/utils/BackendTestSettings.scala Adds disabled-suite tracking + API and integrates it into suite filtering.
gluten-ut/spark40/src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala Converts previously “not enabled” suites into explicitly disabled suites with reasons.
gluten-ut/spark41/src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala Same as Spark 4.0: explicitly disables suites with documented reasons.
gluten-ut/spark40/src/test/scala/org/apache/spark/sql/catalyst/expressions/GlutenSubExprEvaluationRuntimeSuite.scala Adds wrapper suite class so it can be explicitly disabled/tracked.
gluten-ut/spark41/src/test/scala/org/apache/spark/sql/catalyst/expressions/GlutenSubExprEvaluationRuntimeSuite.scala Same wrapper addition for Spark 4.1 (shim trait).

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +53 to +55
protected def disableSuite(suiteName: String, reason: String): Unit = {
require(reason.nonEmpty, "Disable reason must not be empty")
if (enabledSuites.containsKey(suiteName)) {
Copilot AI review requested due to automatic review settings July 15, 2026 03:13
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Comment on lines 37 to +40
protected def enableSuite(suiteName: String): SuiteSettings = {
if (disabledSuites.containsKey(suiteName)) {
throw new IllegalArgumentException("Suite is already disabled: " + suiteName)
}
Comment on lines +58 to +60
if (disabledSuites.containsKey(suiteName)) {
throw new IllegalArgumentException("Duplicated disabled suite: " + suiteName)
}
@philo-he

Copy link
Copy Markdown
Member

@zml1206, thank you for the PR. Can we remove .disable and the associated disableReason, and use the new disableSuite?

https://github.com/search?q=repo%3Aapache%2Fgluten+.disable%28&type=code

Copilot AI review requested due to automatic review settings July 15, 2026 06:11
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 13 out of 13 changed files in this pull request and generated no new comments.

Copilot AI review requested due to automatic review settings July 15, 2026 09:11
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 13 out of 13 changed files in this pull request and generated 1 comment.

Comment on lines +53 to +57
protected def disableSuite(suiteName: String, reason: String): Unit = {
require(reason.nonEmpty, "Disable reason must not be empty")
if (enabledSuites.containsKey(suiteName)) {
throw new IllegalArgumentException("Suite is already enabled: " + suiteName)
}
Copilot AI review requested due to automatic review settings July 15, 2026 14:12
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 13 out of 13 changed files in this pull request and generated 2 comments.

Comment on lines 37 to 43
protected def enableSuite(suiteName: String): SuiteSettings = {
if (disabledSuites.containsKey(suiteName)) {
throw new IllegalArgumentException("Suite is already disabled: " + suiteName)
}
if (enabledSuites.containsKey(suiteName)) {
throw new IllegalArgumentException("Duplicated suite name: " + suiteName)
}
Comment on lines +53 to +62
protected def disableSuite(suiteName: String, reason: String): Unit = {
require(reason.nonEmpty, "Disable reason must not be empty")
if (enabledSuites.containsKey(suiteName)) {
throw new IllegalArgumentException("Suite is already enabled: " + suiteName)
}
if (disabledSuites.containsKey(suiteName)) {
throw new IllegalArgumentException("Duplicated disabled suite: " + suiteName)
}
disabledSuites.put(suiteName, reason)
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CORE works for Gluten Core

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants