Re: watermark trigger doesn't check whether element's timestamp is passed

Hello, I have just opened the JIRA issue and I have almost completed the implementation of this feature. I will keep you posted :) Cheers, Ventura This message, for the D. Lgs n. 196/2003 (Privacy Code), may contain confidential and/or privile

Re: repartion locally to task manager

ot across the boundaries of TaskManagers)? > > > (map) (map) (map) (map) >\ / \/ > \ /\ / >(reduce)(reduce) > ^ ^^ ^ > | \/ | > | +--+ | > | / \ | > (source) (source) > > > > Greetings,

repartion locally to task manager

Hello, I am trying to introduce a new feature in my flink project, I would like to shuffle (random repartition) my dataset only locally to a task manager, so that each internal worker will have a different set of objects to work on. I have looked to internal flink mechanism, and I know (i hope) ho

Re: Broadcasted Variable not updated in a Iterative Data Set

the beginning of each superstep). > > Greetings, > Stephan > > > On Mon, May 11, 2015 at 6:36 PM, Ventura Del Monte < > venturadelmo...@gmail.com> wrote: > >> Hello, >> >> I am writing a Flink application whose purpose is to train neural >> netwo

Broadcasted Variable not updated in a Iterative Data Set

Hello, I am writing a Flink application whose purpose is to train neural networks. I have implemented a version of SDG based on mini batches using the IterativeDataSet class. In a nutshell, my code groups the input features in a set called mini batch (i have as many mini batches as the parallelism

Re: Objects deserialization on Jobmanager

e mapper runs with 64 parallel > instances > > > Out of curiosity: The deserialization bug occurs here on the JobManager > (because the JobManager looks into the Inputs), but I assume it would also > occur on the TaskManagers (workers) once the proper execution starts? >

Re: Objects deserialization on Jobmanager

obert Metzger > wrote: > >> Hi, >> >> which version of Flink are you using? >> >> Can you send us the complete stack trace of the error to help us >> understand the exact location where the issue occurs? >> >> On Wed, Apr 22, 2015 at 4:33 PM, Ventura

Objects deserialization on Jobmanager

Hello, I am working on a flink-based deep learning library for my master's thesis. I am experiencing this issue at the moment: I have a java class with a transient field, so I had to write both a kryo custom serializer and a java one. The (de)serialization needs to access another object of my syste