Carl-Zhou-CN commented on PR #7476: URL: https://github.com/apache/seatunnel/pull/7476#issuecomment-2319646433
> > > https://github.com/apache/seatunnel/blob/1bba72385b6797dc5edd96fa5951376d0594e633/seatunnel-translation/seatunnel-translation-spark/seatunnel-translation-spark-3.3/src/main/java/org/apache/seatunnel/translation/spark/source/partition/micro/SeaTunnelMicroBatchPartitionReader.java#L27-L49 > > > > > > https://github.com/apache/seatunnel/blob/1bba72385b6797dc5edd96fa5951376d0594e633/seatunnel-translation/seatunnel-translation-spark/seatunnel-translation-spark-3.3/src/main/java/org/apache/seatunnel/translation/spark/source/partition/batch/ParallelBatchPartitionReader.java#L87-L97 > > > > > > PartitionReader never close in streaming mode. > > > > > > hi @CheneyYin It seems that after a checkpoint, it will be close > > The `next()` never return false useless call `close()`. However Spark MicroStreamExecution will call `close()` after `next()` return false. So reader never stop and never commit batch. yes, you're right -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
