Re: Is Idle state retention time in SQL client possible?

Hi, This can be set via the environment file. Please have a look at the documentation [1] (see "execution: min-idle-state-retention: " and "execution: max-idle-retention: " keys). Fabian [1] https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/table/sqlClient.html#environment-files A

Re: Problem starting taskexecutor daemons in 3 node cluster

SSH access to the nodes and nodes being able to talk to each other are separate issues. The former is only used for starting the Flink cluster. Once the cluster is started, Flink only requires that nodes can talk to each other (independent of SSH). Cheers, Till On Tue, Sep 17, 2019 at 7:39 AM Kom

Re: Joining Pojos

POJO is available in KeySelector[1]. Could you provide more information about your problem? Version of Flink? Error messages? [1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/api_concepts.html#define-keys-using-key-selector-functions *Best Regards,* *Zhenghua Gao* On Mon, Sep 16,

Flink help / pairing

I am currently building a system based on Flink and could use some ongoing help. Is there any expert who would be free for some remote pairing? Happy to pay for time of course! Thanks Ben

Difference between data stream window function and cep within

Hi All, I'd like to know the difference between data stream window function and cep within, I googled this issue but found no useful information. Below the cep within, is there a tumbling window or sliding window or just a process function? Your explanation will be truly appreciated. Yours sinc

Re: Flink help / pairing

Maybe you can find some information here: https://www.ververica.com/training Best， Leonard Xu > On 2019年9月17日, at 下午7:17, Benjamin Wootton > wrote: > > I am currently building a system based on Flink and could use some ongoing > help. > > Is there any ex

Error "Failed to load native Mesos library from" when I run Flink on a compiled version of Apache Mesos

Hi, I am compiling mesos from source code and trying to execute Flink on it. For some reason I am having the error that "Failed to load native Mesos library from /usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib".

Re: serialization issue in streaming job run with scala Future

I think the issue may not be linked with Future. What happens is when this piece of code is executed .. val rides: DataStream[TaxiRide] = readStream(inTaxiRide) .filter { ride ⇒ ride.getIsStart().booleanValue } .keyBy("rideId") val fares: DataStream[TaxiFare] = readStream(inTaxiFare)

How exactly does Idle-state retention policy work?

Hi there, I'm using FlinkSQL to solve to do the job for me. Based on this , configured the idle-state milliseconds. *context*: FlinkSQL reads Kafka stream with no key and put to dynamic table

Re: Difference between data stream window function and cep within

Hi Joshua, There is no tumbling/sliding window underlying the cep within implementation. The difference between datastream window and cep within is that: 1) Regarding to datastream window, the window is unified for all the elements (You can think that the window already exists before the input

Re: Error "Failed to load native Mesos library from" when I run Flink on a compiled version of Apache Mesos

Hey Felipe, I haven't tried to run Flink on Mesos, but I guess you can try exporting those ENV variables so that Flink can see them. Alternatively you can try something like *LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/felipe/workspace-vsc/mesos/build/src/.libs/ ./bin/mesos-appmaster.sh* If the probl

Re: How exactly does Idle-state retention policy work?

Hi Srikanth, As you side, the idle-state retention time configuration only works for "group aggregate" and "over aggregate". Regarding to your question: > If it happens to be that the 'ip' acts as a key in my query for the eviction > to work, how does Flink justify the Heap size grew to 80GB an

Re: Window metadata removal

Hi Fabian,  Thank you for your reply. I'm not sure my question was clear enough so I'll try to explain our scenario:We are working in “event time” mode.We want to handle ‘late data’ up to last X days (for example last 7 days)For each incoming event:The event is being aggregated using window functio