Thank you so much for helping!
You were correct that Hudi sink requires checkpointing and by default they
were not enabled for Zeppelin and SQL Client. I added the interval setting
and how it works.
On Tue, Mar 15, 2022 at 10:58 AM Caizhi Weng wrote:
> Hi!
>
> Hudi sink will commit only after a
Hi!
Hudi sink will commit only after a successful checkpoint or at the end of
input. I guess you did not enable checkpointing and as Kafka is a never
ending source Hudi will never commit the records. For your testing job, as
value sources are finite and will end soon you can see records in Hudi
in
Hi,
I have two connectors created with SQL CLI. Source from Kafka/Debezium, and
the sink S3 Hudi.
I can SELECT from the source table OK. I can issue INSERT INTO the sink OK.
So I think both of them work fine. Both have same table structure, jus
However when I do:
INSERT INTO sink
SELECT id, LAS
