liu668 opened a new issue, #8909: URL: https://github.com/apache/seatunnel/issues/8909
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened when me submit a kafka -to-S3 job by rest-api，the task was submitted successfully, but there was an error message when sending the data. I couldn't find the reason and hope to receive a reply，thank you! ### SeaTunnel Version 2.3.9 ### SeaTunnel Config ```conf { "env": { "execution.parallelism": 1, "job.mode":"STREAMING", "job.name":"test" }, "source": [ { "plugin_name": "Kafka", "bootstrap.servers": "127.0.0.1:9092", "topic": "seatunnel_test", "format": "json" } ], "transform": [ ], "sink": [ { "plugin_name": "S3File", "bucket": "s3a://seatunnel", "path": "/seatunnel_test/data", "tmp_pat": "/seatunnel_test/temp", "fs.s3a.endpoint":"s3.eu-west-1.amazonaws.com", "fs.s3a.aws.credentials.provider":"org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider", "access_key": "XXX", "secret_key": "XXX", "have_partition" :true, "partition_by" : ["site_id","year","month","day"], "sink_columns" : ["site_id","year","month","day","app_id","channel_id","user_id","device_id","request_id","page_url","os","user_agent","screen_height","screen_width","lib_type","lib_version","timezone_offset","spm","event_time","event_type","event_detail","ip","collect_time","data_type","_lang","_version"], "partition_dir_expression" : "${k0}=${v0}/${k1}=${v1}/${k2}=${v2}/${k3}=${v3}/", "is_partition_field_write_in_file" : false, "custom_filename" :true, "file_name_expression" :"${transactionId}_${now}", "filename_time_format" : "yyyy.MM.dd", "is_enable_transaction":true, "file_format_type": "parquet", "data_save_mode":"APPEND_DATA", "hadoop_s3_properties": { "fs.s3a.buffer.dir" : "/data/st_test/s3a", "fs.s3a.fast.upload.buffer" : "disk" } } ] } ``` ### Running Command ```shell rest api ``` ### Error Exception ```log java.lang.RuntimeException: java.lang.RuntimeException: table seatunnel_test sink throw error at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:302) at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:70) at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:39) at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:27) at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.handleRecord(IntermediateBlockingQueue.java:70) at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.collect(IntermediateBlockingQueue.java:50) at org.apache.seatunnel.engine.server.task.flow.IntermediateQueueFlowLifeCycle.collect(IntermediateQueueFlowLifeCycle.java:51) at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.collect(TransformS eaTunnelTask.java:72) at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:169) at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.call(TransformSeaTunnelTask.java:77) at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:694) at org.apache.seatunnel.engine.server.TaskExecutionService$NamedTaskWrapper.run(TaskExecutionService.java:1019) at org.apache.seatunnel.api.tracing.MDCRunnable.run(MDCRunnable.java:43) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.RuntimeException: table seatunnel_test sink throw error at org.apache.seatunnel.api.sink.multitablesink.MultiTableSinkWri ter.subSinkErrorCheck(MultiTableSinkWriter.java:140) at org.apache.seatunnel.api.sink.multitablesink.MultiTableSinkWriter.prepareCommit(MultiTableSinkWriter.java:240) at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:201) ... 17 more Caused by: java.lang.NullPointerException at org.apache.seatunnel.connectors.seatunnel.file.sink.writer.AbstractWriteStrategy.generatorPartitionDir(AbstractWriteStrategy.java:205) at org.apache.seatunnel.connectors.seatunnel.file.sink.writer.AbstractWriteStrategy.getOrCreateFilePathBeingWritten(AbstractWriteStrategy.java:362) at org.apache.seatunnel.connectors.seatunnel.file.sink.writer.ParquetWriteStrategy.write(ParquetWriteStrategy.java:121) at org.apache.seatunnel.connectors.seatunnel.file.sink.BaseFileSinkWriter.write(BaseFileSinkWriter.java:134) at org.apache.seatunnel.connectors.seatunnel.file.sink.BaseFileSinkWriter.write(BaseFileSinkWriter.java:46) at org.apache.seatunnel.api.sink.multitablesink.Mu ltiTableWriterRunnable.run(MultiTableWriterRunnable.java:67) ... 6 more ``` ### Zeta or Flink or Spark Version _No response_ ### Java or Scala Version _No response_ ### Screenshots _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
