On 2021/01/13 12:07, vinay.raic...@t-systems.com wrote:
Ok. Attached is the PPT of what am attempting to achieve w.r.t. time
Hope I am all set to achieve the three bullets mentioned in attached
slide to create reports with KafkaSource and KafkaBuilder approach.
If you have any additional tips
attached (example for live dashboards use case)
Kind regards
Vinay
-Original Message-
From: Aljoscha Krettek
Sent: 13 January 2021 14:06
To: user@flink.apache.org
Cc: RAICHUR, VINAY
Subject: Re: Flink to get historical data from kafka between timespan t1 & t2
On 2021/01/13 0
On 2021/01/13 07:58, vinay.raic...@t-systems.com wrote:
Not sure about your proposal regarding Point 3:
* firstly how is it ensured that the stream is closed? If I understand
the doc correctly the stream will be established starting with the
latest timestamp (hmm... is it not a standard behavio
link to get historical data from kafka between timespan t1 & t2
Hi,
for your point 3. you can look at
`FlinkKafkaConsumerBase.setStartFromTimestamp(...)`.
Points 1. and 2. will not work with the well established `FlinkKafkaConsumer`.
However, it should be possible to do it with the new `Kaf
Hi Team & Aljoscha
Any update on below please?
-Original Message-
From: RAICHUR, VINAY
Sent: 11 January 2021 19:43
To: 'Aljoscha Krettek' ; user@flink.apache.org
Subject: RE: Flink to get historical data from kafka between timespan t1 & t2
Importance: High
Hi Aljoscha
On 2021/01/11 14:12, vinay.raic...@t-systems.com wrote:
a) As mentioned by you "KafkaSource" was introduced in Flink 1.12 so, I
suppose we have to upgrade to this version of Flink. Can you share the
link of the stable Flink image (containerized version) to be used in
our set-up keeping in mind
On 2021/01/08 16:55, vinay.raic...@t-systems.com wrote:
Could you also attach the code snippet for KafkaSource`, `KafkaSourceBuilder`,
and `OffsetInitializers` that you were referring to in your previous reply, for
my reference please to make it more clearer for me.
Ah sorry, but this I was r
,
Vinay
-Original Message-
From: Aljoscha Krettek
Sent: 08 January 2021 19:26
To: user@flink.apache.org
Subject: Re: Flink to get historical data from kafka between timespan t1 & t2
Hi,
for your point 3. you can look at
`FlinkKafkaConsumerBase.setStartFromTimestamp(...)`.
Points 1. a
Hi,
for your point 3. you can look at
`FlinkKafkaConsumerBase.setStartFromTimestamp(...)`.
Points 1. and 2. will not work with the well established
`FlinkKafkaConsumer`. However, it should be possible to do it with the
new `KafkaSource` that was introduced in Flink 1.12. It might be a bit
r
Hi Flink Community Team,
This is a desperate request for your help on below.
I am new to the Flink and trying to use it with Kafka for Event-based data
stream processing in my project. I am struggling using Flink to find solutions
to my requirements of project below:
1. Get all Kafka topic
10 matches
Mail list logo
