[GitHub] [hudi] nsivabalan commented on issue #4146: [SUPPORT] Deltastreamer commits with a custom checkpoint configuration are skipped if the generated checkpoint matches the previous commit checkpoint

[GitBox]

nsivabalan commented on issue #4146:
URL: https://github.com/apache/hudi/issues/4146#issuecomment-988951531


   This worked for me. 
   First run
   ```
   nsb$ grep "Checkpoint" /tmp/logs/log23.out 
   21/12/08 07:47:52 INFO DeltaSync: Checkpoint to resume from : Optional.empty
   21/12/08 07:49:35 INFO DeltaSync: Checkpoint to resume from : 
Option{val=1638825407000}
   21/12/08 07:50:35 INFO DeltaSync: Checkpoint to resume from : 
Option{val=1638825408000}
   21/12/08 07:51:46 INFO DeltaSync: Checkpoint to resume from : 
Option{val=1638825413000}
   ```
   
   Stopped deltastreamer and restarted with additional config --checkpoint 
1638825407000
   
   ```
   nsb$ tail -f /tmp/logs/log24.out | grep "Checkpoint" 
   21/12/08 07:54:36 INFO DeltaSync: Checkpoint to resume from : 
Option{val=1638825407000}
   21/12/08 07:56:16 INFO DeltaSync: Checkpoint to resume from : 
Option{val=1638825408000}
   21/12/08 07:57:56 INFO DeltaSync: Checkpoint to resume from : 
Option{val=1638825413000}
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org