Re: Windowing on the consumer side

2022-01-08 Thread Flink Lover
93/how-to-get-elements-of-a-specific-window-for-flink-consumer-with-json-data > [2] https://lists.apache.org/thread/5p8oognvlwsbmsvnfltqkh9q3htnp3b7 > > Best, > D. > > On Sat, Jan 8, 2022 at 7:32 AM Flink Lover wrote: > >> Hi, >> >> I tried th

Re: Windowing on the consumer side

2022-01-07 Thread Flink Lover
at, Jan 8, 2022 at 4:07 AM Mariam Walid wrote: > You can do this using the windowAll function, it works with non-keyed > streams. > > On Friday, January 7, 2022, Flink Lover wrote: > >> Can somebody help me with this? I tried several examples where they have >> extracte

Re: Windowing on the consumer side

2022-01-07 Thread Flink Lover
every 2 secs and call the process function. - Martin O On Fri, Jan 7, 2022 at 11:37 PM Flink Lover wrote: > I have an incoming json data like below: > {"custId": 1,"custFirstName":"Martin", > "custLastName":"owen","edl_created

Re: Trigger the producer to send data to the consumer after mentioned seconds

2022-01-07 Thread Flink Lover
general it all boils down > to running java compiler with specified "-target" [1]. > > [1] > https://docs.oracle.com/javase/8/docs/technotes/tools/windows/javac.html > > D. > > On Fri, Jan 7, 2022 at 6:22 PM Flink Lover wrote: > >> Could you please help

Windowing on the consumer side

2022-01-07 Thread Flink Lover
I have an incoming json data like below: {"custId": 1,"custFirstName":"Martin", "custLastName":"owen","edl_created_at":"2022-03-01 00:00:00"} Now, this record has been pushed successfully via producer to the consumer. But I am willing to get records of say 2 seconds window but I don't have any key

Re: Trigger the producer to send data to the consumer after mentioned seconds

2022-01-07 Thread Flink Lover
Could you please help me with this? On Fri, Jan 7, 2022 at 11:48 AM Flink Lover wrote: > I tried Flink version 1.14.2 / 1.13.5 > > On Fri, Jan 7, 2022 at 11:46 AM Flink Lover > wrote: > >> Also, I am using flink-connector-kafka_2.11 >> >> val consume

Re: Trigger the producer to send data to the consumer after mentioned seconds

2022-01-06 Thread Flink Lover
I tried Flink version 1.14.2 / 1.13.5 On Fri, Jan 7, 2022 at 11:46 AM Flink Lover wrote: > Also, I am using flink-connector-kafka_2.11 > > val consumer = new FlinkKafkaConsumer[String]("topic_name", new > SimpleStringSchema(), properties) > > > val myProducer

Re: Trigger the producer to send data to the consumer after mentioned seconds

2022-01-06 Thread Flink Lover
aWrapper[String](new SimpleStringSchema()), // serialization schema getProperties(), // producer config FlinkKafkaProducer.Semantic.AT_LEAST_ONCE) On Fri, Jan 7, 2022 at 11:43 AM Flink Lover wrote: > Hi All, > > I checked the Java version using the java -version on the terminal and it &

Re: Trigger the producer to send data to the consumer after mentioned seconds

2022-01-06 Thread Flink Lover
he JDK version you actually > use is probably below 1.8. Can you have a double check on the environment > that your job is running in? > > Cheers, > > Qingsheng Ren > > > > On Jan 7, 2022, at 1:13 AM, Flink Lover wrote: > > > > Hello Folks! > > > >

Trigger the producer to send data to the consumer after mentioned seconds

2022-01-06 Thread Flink Lover
Hello Folks! I have a DataStream which sends data to the consumer but I got the data once the code completed its execution. I didn't receive the records as the code was writing it to the topic. I was able to achieve this behavior using AT_LEAST_ONCE property but I decided to implement Watermarks.