0AyanamiRei opened a new pull request, #68773:
URL: https://github.com/apache/doris/pull/68773
### What problem does this PR solve?
Issue Number: None
Related PR: #67681, #68560
Problem Summary:
Manual backport of #67681 to branch-4.1, replacing the closed automatic
backport #68560.
Persist the routine load create journal before publishing the job to the
scheduler. This keeps the initial NEED_SCHEDULE state stable during
serialization and prevents replay from restoring a RUNNING job without tasks.
Adapt RoutineLoadJobPersistenceTest to branch-4.1: use the Kafka classes in
their existing routineload package and remove unsupported Kinesis references.
The Kafka test retains assertions for journal-before-publication ordering and
successful scheduling after publication. This addresses the test compilation
failure in TeamCity build 1062738.
### Release note
Fix routine load jobs potentially becoming stuck after replay due to
scheduling before the create journal is persisted.
### Check List (For Author)
- Test
- [ ] Regression test
- [x] Unit Test
- [ ] Manual test
- Unit test adapted for branch-4.1. Local compilation and tests were not
run, as requested. `git diff --check` passed.
- Behavior changed:
- [ ] No.
- [x] Yes. The create journal is persisted before the job becomes
visible to the scheduler.
- Does this need documentation?
- [x] No.
- [ ] Yes.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
