Thank you so much for helping!
You were correct that Hudi sink requires checkpointing and by default they
were not enabled for Zeppelin and SQL Client. I added the interval setting
and how it works.
On Tue, Mar 15, 2022 at 10:58 AM Caizhi Weng wrote:
> Hi!
>
> Hudi sink will commit only after a
Hi!
Hudi sink will commit only after a successful checkpoint or at the end of
input. I guess you did not enable checkpointing and as Kafka is a never
ending source Hudi will never commit the records. For your testing job, as
value sources are finite and will end soon you can see records in Hudi
in
