Re: Information regarding RichParallelSourceFunction

2016-12-22 Thread Fabian Hueske
Hi, Flink serializes all user functions (including source functions) with Java Serialization to ship them to the worker processes. That's also why everything in a user function must be Serializable. There is not an easy way to synchronize running tasks. Each task has its own function object and t

Re: clean up jira

2016-12-22 Thread Fabian Hueske
Hi Anton, Thanks a lot for digging through JIRA! I'll do a pass over the issues and close or comment on those issue that I know about. I'll update the FLINK-5384 with the status of the issues. Best, Fabian 2016-12-21 19:01 GMT+01:00 Aljoscha Krettek : > Thanks a lot for going through the issu

[jira] [Created] (FLINK-5387) Lightweight Event Time Window

2016-12-22 Thread Syinchwun Leo (JIRA)
Syinchwun Leo created FLINK-5387: Summary: Lightweight Event Time Window Key: FLINK-5387 URL: https://issues.apache.org/jira/browse/FLINK-5387 Project: Flink Issue Type: Improvement

Information regarding RichParallelSourceFunction

2016-12-22 Thread Saikat Maitra
Hello, I am working on building Apache Ignite connector for Apache flink. I am currently developing the SourceFunction to consume Cache event from Ignite cluster. Here is the PR https://github.com/apache/ignite/pull/870/files I am observing that during unit tests the IgniteSource instances are d