xxsc0529 commented on PR #10700:
URL: https://github.com/apache/inlong/pull/10700#issuecomment-2251877737
> > > please add test result with real data from any source to oceanbase
> >
> >
> > What kind of test data is needed and where to put it
>
> You can refer to
inlong-sort/sort-end-to-end-tests/sort-end-to-end-tests-v1.15/src/test/java/org/apache/inlong/sort/tests/Mysql2StarRocksTest.java
>
> or package your code to manager container. Then start a job to verify the
oceanbase connector work properly.If all right, plz provide some screenshots~
The logic of Oceanbase and MySQL is the same, using MySQL-CDC, and the
following is tested in the form of a remote debug project jar package through
local source code
This step shows that the pre-configuration logic is passable, and the
corresponding CDC can be found and flinksql can be generated，Below is the
generated flinksql
FlinkSqlParseResult(tableEnv=org.apache.flink.table.api.bridge.java.internal.StreamTableEnvironmentImpl@42554211,
createTableSqls=[CREATE TABLE `table_mysqtooceanbase`(
`id` INT,
`user_name` STRING)
WITH (
'inlong.metric.labels' =
'groupId=mysqtooceanbase&streamId=mysqtooceanbase&nodeId=mysqtooceanbase',
'topic' = 'mysqtooceanbase.mysqtooceanbase',
'properties.bootstrap.servers' = '127.0.0.1:9092',
'connector' = 'kafka-inlong',
'inlong-msg.debezium-json.schema-include' = 'false',
'inlong-msg.debezium-json.encode.decimal-as-plain-number' = 'true',
'inlong-msg.inner.format' = 'debezium-json',
'format' = 'inlong-msg',
'inlong-msg.debezium-json.timestamp-format.standard' = 'SQL',
'inlong-msg.debezium-json.ignore-parse-errors' = 'true',
'inlong-msg.debezium-json.map-null-key.literal' = 'null',
'inlong-msg.debezium-json.map-null-key.mode' = 'DROP',
'inlong-msg.ignore-parse-errors' = 'false',
'scan.startup.mode' = 'earliest-offset',
'properties.group.id' =
'kafka-local_mysqtooceanbase.mysqtooceanbase_consumer_group'
), CREATE TABLE `table_oceanbase`(
PRIMARY KEY (`id`) NOT ENFORCED,
`id` INT,
`user_name` STRING)
WITH (
'inlong.metric.labels' =
'groupId=mysqtooceanbase&streamId=mysqtooceanbase&nodeId=oceanbase',
'connector' = 'jdbc-inlong',
'url' = 'jdbc:mysql://Confidentiality:4848/test',
'username' = 'Confidentiality@tt1',
'password' = '123456',
'table-name' = 't_ds_user'
)], loadSqls=[INSERT INTO `table_oceanbase`
SELECT
`id` AS `id`,
`user_name` AS `user_name`
FROM `table_mysqtooceanbase` ])
Go to flink-ui to find that the task has also been submitted
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
