Hi Sourav,
Basically, Kafka consumer is pull-based [1]. If you want to build push-based
system, you should use other options.
Flink supports both pull-based and push-based paradigm. It depends upon an
implementation of data source. As one of examples, Flink provides a streaming
source function
Hi Gordon,
Need little more clarification around reading data from Kafka.
As soon as any component behaves as a consumer of a topic/queue (iof a
messaging system), it essentially does polling of the data after a regular
interval (that interval may be small though). Hence essentially it captures
a
Hi Sourav,
Flink's streaming processes incoming data by-each-entry (true streaming, as
compared to micro-batch), and streaming is inherently designed as a
push-model, where a topology of stream transformations "listens" to a data
source.
You can have a Flink streaming topology's data source confi
