tongyp created FLINK-37678:
------------------------------
Summary: suggest improve doris connector version
Key: FLINK-37678
URL: https://issues.apache.org/jira/browse/FLINK-37678
Project: Flink
Issue Type: Bug
Components: Flink CDC
Affects Versions: cdc-3.3.0
Reporter: tongyp
flinkcdc pipeline from MySQL to Doris,the checkpoint may failed,the taskmanager
stack is
"PostPartition -> Sink Writer: Flink CDC Event Sink: doris (1/2)#9" Id=83
BLOCKED on org.apache.doris.flink.sink.batch.DorisBatchStreamLoad@25a62e8 owned
by "pool-2-streamload-executor-1" Id=100
at
app//org.apache.doris.flink.sink.batch.DorisBatchStreamLoad.writeRecord(DorisBatchStreamLoad.java:182)
- blocked on org.apache.doris.flink.sink.batch.DorisBatchStreamLoad@25a62e8
at
app//org.apache.doris.flink.sink.batch.DorisBatchWriter.writeOneDorisRecord(DorisBatchWriter.java:154)
at
app//org.apache.doris.flink.sink.batch.DorisBatchWriter.write(DorisBatchWriter.java:120)
at
app//org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.processElement(SinkWriterOperator.java:160)
at
app//org.apache.flink.cdc.runtime.operators.sink.DataSinkWriterOperator.processElement(DataSinkWriterOperator.java:178)
at
app//org.apache.flink.streaming.runtime.io.RecordProcessorUtils$$Lambda$887/0x00000008407e8440.accept(Unknown
Source)
at
app//org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:75)
at
app//org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:50)
at
app//org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29)
at
app//org.apache.flink.streaming.api.operators.StreamMap.processElement(StreamMap.java:38)
at
app//org.apache.flink.streaming.runtime.io.RecordProcessorUtils$$Lambda$887/0x00000008407e8440.accept(Unknown
Source)
at
app//org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:238)
at
app//org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:157)
at
app//org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:114)
at
app//org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
at
app//org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:638)
at
app//org.apache.flink.streaming.runtime.tasks.StreamTask$$Lambda$753/0x0000000840686c40.runDefaultAction(Unknown
Source)
at
app//org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
at
app//org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:973)
at
app//org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:917)
at
app//org.apache.flink.runtime.taskmanager.Task$$Lambda$1297/0x00000008409fa040.run(Unknown
Source)
at
app//org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:970)
at
app//org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:949)
at app//org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:763)
at app//org.apache.flink.runtime.taskmanager.Task.run(Task.java:575)
at java.base@11.0.25/java.lang.Thread.run(Unknown Source)
doris connector fix some bugs
[https://github.com/apache/doris-flink-connector/pull/506]
[https://github.com/apache/doris-flink-connector/pull/511]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
