Re: Flink support for DeepLearning4j or other deep learning library

2017-03-11 Thread Adarsh Jain
Thanks, I guess this issue addresses the same, however it is still unassigned https://issues.apache.org/jira/browse/FLINK-5782 On Sat, Mar 11, 2017 at 12:41 AM, Robert Metzger wrote: > Hi, > I'm not aware of any community efforts into that direction. This is the > only thing google brought u

Re: AWS exception serialization problem

2017-03-11 Thread Robert Metzger
Thank you for analyzing the problem Gordon! We can not upgrade Kryo anytime soon because state in old savepoints is still serialized with the current Kryo version. I would propose to add our own JavaThrowableSerializer to Flink and document how users can register that serializer if they run into t

Re: Streaming Exception

2017-03-11 Thread Robert Metzger
Are you sure you checked the taskmanager with id 383f6af3299793ba73eeb7bdbab0ddc7? It should log something at the time of the error, otherwise, this would be very weird. On Sat, Mar 11, 2017 at 12:01 AM, Govindarajan Srinivasaraghavan < govindragh...@gmail.com> wrote: > This is the exception befo

Re: AWS exception serialization problem

2017-03-11 Thread Tzu-Li (Gordon) Tai
FYI: Here’s the JIRA ticket to track this issue -  https://issues.apache.org/jira/browse/FLINK-6025. On March 11, 2017 at 6:27:36 PM, Tzu-Li (Gordon) Tai (tzuli...@apache.org) wrote: Hi Shannon, Thanks a lot for providing the example, it was very helpful in reproducing the problem. I think t

Re: AWS exception serialization problem

2017-03-11 Thread Tzu-Li (Gordon) Tai
Hi Shannon, Thanks a lot for providing the example, it was very helpful in reproducing the problem. I think this is actually a Kryo bug, that was just recently fixed:  https://github.com/EsotericSoftware/kryo/pull/483 It will be available in Kryo 4.0.1, which unfortunately doesn’t seem to be re