Re: Objects deserialization on Jobmanager

2015-04-22 Thread Ventura Del Monte
I am using Flink 0.9-SNAPSHOT, this is the complete stack trace: org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Cannot initialize task 'DataSource (at (DownpourSDG.java:28) (org.apache.flink.api.java.io.CollectionInputFormat))': Deserializing the InputFor

Re: Objects deserialization on Jobmanager

2015-04-22 Thread Stephan Ewen
Hi Ventura! Flink loads on startup only the Flink classes and all user code classes are loaded dynamically. Each point when a user class is used, or a user class object is deserialized, Flink uses the user code classloader of that specific job. For you as the user, this has the implication that i

Re: Objects deserialization on Jobmanager

2015-04-22 Thread Till Rohrmann
The corresponding code snippet could also help. Cheers, Till On Wed, Apr 22, 2015 at 4:45 PM, Robert Metzger wrote: > Hi, > > which version of Flink are you using? > > Can you send us the complete stack trace of the error to help us > understand the exact location where the issue occurs? > > O

Re: Objects deserialization on Jobmanager

2015-04-22 Thread Robert Metzger
Hi, which version of Flink are you using? Can you send us the complete stack trace of the error to help us understand the exact location where the issue occurs? On Wed, Apr 22, 2015 at 4:33 PM, Ventura Del Monte < venturadelmo...@gmail.com> wrote: > Hello, I am working on a flink-based deep lea

Objects deserialization on Jobmanager

2015-04-22 Thread Ventura Del Monte
Hello, I am working on a flink-based deep learning library for my master's thesis. I am experiencing this issue at the moment: I have a java class with a transient field, so I had to write both a kryo custom serializer and a java one. The (de)serialization needs to access another object of my syste