Skip to content

[FLINK-38975][runtime] Support application recovery#27741

Open
eemario wants to merge 4 commits intoapache:masterfrom
eemario:FLIP560-3-2
Open

[FLINK-38975][runtime] Support application recovery#27741
eemario wants to merge 4 commits intoapache:masterfrom
eemario:FLIP560-3-2

Conversation

@eemario
Copy link
Contributor

@eemario eemario commented Mar 6, 2026

What is the purpose of the change

This pull request support application recovery in session mode.

Brief change log

  • Add ApplicationStore to store running applications in session mode
  • Add ApplicationResultStore to store terminated applications
  • Combine ApplicationStore/ApplicationResultStore/Blob and improve application/job termination workflow to support application recovery

Verifying this change

This change added tests and can be verified as follows:

  • Added tests for ApplicationStore and its implementation
  • Added tests for ApplicationResultStore and its implementataion
  • Added tests for Dispatcher to validate the cleanup and recovery for applications
  • Manually verified the change by running a standalone cluster with local zookeeper, killing the JM, restarting the JM and confirming application and job recovery.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): (no)
  • The public API, i.e., is any changed class annotated with @Public(Evolving): (yes)
  • The serializers: (no)
  • The runtime per-record code paths (performance sensitive): (no)
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes)
  • The S3 file system connector: (no)

Documentation

  • Does this pull request introduce a new feature? (yes)
  • If yes, how is the feature documented? (docs)

@flinkbot
Copy link
Collaborator

flinkbot commented Mar 6, 2026

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

@eemario eemario force-pushed the FLIP560-3-2 branch 2 times, most recently from 5fe098f to f24fcd2 Compare March 10, 2026 02:11
@eemario eemario marked this pull request as ready for review March 10, 2026 02:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants