Hi Youzha,
could you double-check if your filter function is actually just filtering
out all messages? For example, could you replace the filter by (record ->
true)? Filtering all records would most certainly describe the behavior
best.
If that doesn't work, we need to go back to the basics: whic
Hi,
Sorry for my last pict attachment. there is still filter transform process
before produce to kafka. when i check it again, if i use rebalance
function, there will be stuck on the first process after consume message.
on my last post. the process stuck on filter process. After consume from
topic
Hi Arvid,
thanks for your reply.
yes i’m using exactly once mode and i’ve enable checkpointing.
env.enableCheckpointing(2, CheckpointingMode.EXACTLY_ONCE);
this is my flow in the web UI. i’m trying to do the simple thing. read from
kafka and then sink it to another topic.
this is the web
Hi Youzha,
do you use exactly once mode in kafka producer? Make sure that you have
enabled checkpointing and set the interval appropriately.
You can also see the message flow in the web UI. Check if something is
reaching the sink. Aside from that, if you use window operators make sure
that they f
Hi, i’m using kafka consumer and producer on flink.
i’ve succeed to consume, transform, and produce to another topic on my
development env ( 1 partition and a few dummy msg)
but when i try to submit job on production env ( 20 partitions and the size
is about 100Gb ),
there is no one message produ
