zhoukaiii opened a new issue, #14195: URL: https://github.com/apache/doris/issues/14195
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version updated master ### What's Wrong? 数据在通过hdfsreader ->doriswriter写入数据时报错 初步怀疑是这样的数据导致写入失败 2022-11-11 张三50%/李四50%/王五 2 异常的日志： 2022/11/11 10:51:19 - Shell - (stdout) 经DataX智能分析,该任务最可能的错误原因是: 2022/11/11 10:51:19 - Shell - (stdout) com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-05], Description:[往您配置的写入表中写入数据时失败.]. - java.lang.RuntimeException: Writing records to Doris failed. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:130) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65) 2022/11/11 10:51:19 - Shell - (stdout) at java.lang.Thread.run(Thread.java:748) 2022/11/11 10:51:19 - Shell - (stdout) Caused by: java.lang.RuntimeException: Writing records to Doris failed. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:206) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:167) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:115) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:128) 2022/11/11 10:51:19 - Shell - (stdout) ... 3 more 2022/11/11 10:51:19 - Shell - (stdout) Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:187) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:36) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:151) 2022/11/11 10:51:19 - Shell - (stdout) ... 1 more 2022/11/11 10:51:19 - Shell - (stdout) Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:81) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:180) 2022/11/11 10:51:19 - Shell - (stdout) ... 3 more 2022/11/11 10:51:19 - Shell - (stdout) - java.lang.RuntimeException: Writing records to Doris failed. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:130) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65) 2022/11/11 10:51:19 - Shell - (stdout) at java.lang.Thread.run(Thread.java:748) 2022/11/11 10:51:19 - Shell - (stdout) Caused by: java.lang.RuntimeException: Writing records to Doris failed. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:206) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:167) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:115) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:128) 2022/11/11 10:51:19 - Shell - (stdout) ... 3 more 2022/11/11 10:51:19 - Shell - (stdout) Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:187) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:36) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:151) 2022/11/11 10:51:19 - Shell - (stdout) ... 1 more 2022/11/11 10:51:19 - Shell - (stdout) Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:81) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:180) 2022/11/11 10:51:19 - Shell - (stdout) ... 3 more 2022/11/11 10:51:19 - Shell - (stdout) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:40) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:152) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65) 2022/11/11 10:51:19 - Shell - (stdout) at java.lang.Thread.run(Thread.java:748) 2022/11/11 10:51:19 - Shell - (stdout) Caused by: java.lang.RuntimeException: Writing records to Doris failed. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:130) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150) 2022/11/11 10:51:19 - Shell - (stdout) ... 2 more 2022/11/11 10:51:19 - Shell - (stdout) Caused by: java.lang.RuntimeException: Writing records to Doris failed. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:206) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:167) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:115) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:128) 2022/11/11 10:51:19 - Shell - (stdout) ... 3 more 2022/11/11 10:51:19 - Shell - (stdout) Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:187) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:36) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:151) 2022/11/11 10:51:19 - Shell - (stdout) ... 1 more 2022/11/11 10:51:19 - Shell - (stdout) Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status. 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:81) 2022/11/11 10:51:19 - Shell - (stdout) at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:180) 2022/11/11 10:51:19 - Shell - (stdout) ... 3 more 2022/11/11 10:51:19 - Shell - (stdout) 2022/11/11 10:51:19 - xx- Finished job entry [Shell] (result=[false]) 2022/11/11 10:51:19 - xx- Job execution finished ### What You Expected? 希望能成功处理类似的数据 ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
