Limess commented on issue #4146: URL: https://github.com/apache/hudi/issues/4146#issuecomment-988642069
> @Limess : So, is the expectation that, if you set checkpoint = 0, deltastreamer should start from scratch as though we are starting deltastreamer for the first time ? Yes that's the expectation - this is also what currently happens, but where it doesn't match my expectations is that the subsequent commit is skipped so nothing is actually writen. Intuitively I'd expect that if the checkpoint < the commit timestamp, Hudi should always commit. > if you wish to override the checkpoint, probably you need to set --initial-checkpoint-provider. > > https://github.com/apache/hudi/blob/e8473b9a2b5bf0ad9370377899f6a7ea4d1ceba1/hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java#L357 I did look into this and found it hard to understand/use, neither existing implementations match this use case. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
