Give more wait time and retry for kafka setup for ExactlyOnceKafkaRealtimeClusterIntegrationTest and separate it from the test suite run

[xiangfu0]

This pull request improves the reliability and configurability of Kafka cluster startup in integration tests, particularly to better support resource-constrained CI environments. The main changes include making Kafka startup parameters overridable, updating the test execution order in Maven to ensure a specific test runs first, and customizing Kafka startup behavior for CI.

Kafka startup configurability and reliability:

• Added new protected methods (getKafkaStartMaxAttempts, getKafkaStartRetryWaitMs, getKafkaClusterReadyTimeoutMs) in BaseClusterIntegrationTest.java to allow subclasses to override Kafka broker startup attempts, retry wait time, and cluster readiness timeout. All usages of the previous constants in Kafka startup logic now use these methods. [1] [2] [3] [4] [5] [6]

• Overrode the new Kafka startup configuration methods in ExactlyOnceKafkaRealtimeClusterIntegrationTest.java to provide more generous retry and timeout values when running in CI environments (detected via GITHUB_ACTIONS), improving test reliability under resource constraints.

Test execution order improvements:

• Updated the Maven Surefire plugin configuration in pinot-integration-tests/pom.xml to disable the default test execution, and instead:
  • Run ExactlyOnceKafkaRealtimeClusterIntegrationTest first in its own execution.
  • Exclude this test from the subsequent set of tests, so it only runs once and before all others. [1] [2]

[codecov-commenter]

❌ 2 Tests Failed:

Tests completed	Failed	Passed	Skipped
10836	2	10834	66

View the top 1 failed test(s) by shortest run time

org.apache.pinot.integration.tests.BaseRealtimeClusterIntegrationTest::@BeforeClass setUp

Stack Traces | 1256s run time

Failed to load 115545 documents; current count=0 for table=mytable expected [115545] but found [0]

View the full list of 1 ❄️ flaky test(s)

org.apache.pinot.integration.tests.ExactlyOnceKafkaRealtimeClusterIntegrationTest::setUp

Flake rate in main: 100.00% (Passed 0 times, Failed 40 times)

Stack Traces | 1256s run time

Failed to load 115545 documents; current count=0 for table=mytable expected [115545] but found [0]

To view more test analytics, go to the Test Analytics Dashboard
_{📋 Got 3 mins? Take this short survey to help us improve Test Analytics.}

[Copilot]

Pull request overview

This pull request addresses flakiness in the ExactlyOnceKafkaRealtimeClusterIntegrationTest when running in GitHub Actions CI environments. The test uses a 3-broker Kafka cluster with transactions, which requires more resources and time to start reliably in resource-constrained CI environments.

Changes:

• Introduced configurable Kafka startup parameters (max attempts, retry wait time, cluster ready timeout) in BaseClusterIntegrationTest
• Overrode these parameters in ExactlyOnceKafkaRealtimeClusterIntegrationTest to use more generous timeouts when running in GitHub Actions
• Restructured Maven test execution to run ExactlyOnceKafkaRealtimeClusterIntegrationTest first in isolation before other tests

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File	Description
pinot-integration-test-base/src/test/java/org/apache/pinot/integration/tests/BaseClusterIntegrationTest.java	Added three protected methods to allow subclasses to customize Kafka startup configuration (max attempts, retry wait time, cluster ready timeout); updated all usages to call these methods instead of using constants directly
pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/ExactlyOnceKafkaRealtimeClusterIntegrationTest.java	Overrode Kafka configuration methods to use higher values (5 attempts, 5s retry wait, 180s timeout) when GITHUB_ACTIONS environment variable is true
pinot-integration-tests/pom.xml	Restructured integration-tests-set-1 profile to run ExactlyOnceKafkaRealtimeClusterIntegrationTest in a separate execution first, then exclude it from the remaining E*Test.java pattern