JNSimba opened a new pull request, #65588:
URL: https://github.com/apache/doris/pull/65588
### What problem does this PR solve?
Issue Number: None
Related PR: #65325
Problem Summary:
Streaming jobs currently support MySQL and PostgreSQL CDC sources but cannot
use OceanBase as a source.
This change adds OceanBase MySQL compatibility mode as a streaming job data
source. It introduces OceanBase source type handling in FE and the CDC client,
reuses the MySQL-compatible CDC processing path, validates source configuration
and compatibility mode before creating target tables, and supports initial,
snapshot, latest, earliest, and specific startup offsets.
The OceanBase third-party environment exposes separate JDBC and CDC ports.
Test coverage includes basic synchronization, data types, startup offsets,
schema changes, and FE restart recovery.
### Release note
Support OceanBase MySQL compatibility mode as a CDC source for streaming
jobs.
### Check List (For Author)
- Test
- [x] Regression test
- `test_streaming_oceanbase_job`
- `test_streaming_oceanbase_job_all_type`
- `test_streaming_oceanbase_job_offset`
- `test_streaming_oceanbase_job_schema_change`
- [x] Unit Test
- `DataSourceConfigValidatorTest`
- `StreamingJobUtilsTest`
- `SourceReaderFactoryTest`
- [x] Manual test
- `OceanBaseWriteDmlITCase`
- `OceanBaseSchemaChangeITCase`
- `OceanBaseStartupOffsetITCase`
- [ ] No need to test or manual test. Explain why:
- Behavior changed:
- [ ] No.
- [x] Yes. OceanBase MySQL compatibility mode can be used as a streaming
job CDC source.
- Does this need documentation?
- [x] No.
- [ ] Yes.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
