[jira] [Created] (FLINK-3104) Potential null dereference of outStream in FsStateBackend#CheckpointStateOutputStream#closeAndGetHandle()

2015-12-02 Thread Ted Yu (JIRA)
Ted Yu created FLINK-3104: - Summary: Potential null dereference of outStream in FsStateBackend#CheckpointStateOutputStream#closeAndGetHandle() Key: FLINK-3104 URL: https://issues.apache.org/jira/browse/FLINK-3104

[jira] [Created] (FLINK-3103) Accessing closed in FsStateBackend#FsCheckpointStateOutputStream#flush() should be synchronized

2015-12-02 Thread Ted Yu (JIRA)
Ted Yu created FLINK-3103: - Summary: Accessing closed in FsStateBackend#FsCheckpointStateOutputStream#flush() should be synchronized Key: FLINK-3103 URL: https://issues.apache.org/jira/browse/FLINK-3103 Proje

[jira] [Created] (FLINK-3102) Allow reading from multiple topics with one FlinkKafkaConsumer

2015-12-02 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-3102: - Summary: Allow reading from multiple topics with one FlinkKafkaConsumer Key: FLINK-3102 URL: https://issues.apache.org/jira/browse/FLINK-3102 Project: Flink

[jira] [Created] (FLINK-3101) Flink Kafka consumer crashes with NPE when it sees deleted record

2015-12-02 Thread Sanjar Akhmedov (JIRA)
Sanjar Akhmedov created FLINK-3101: -- Summary: Flink Kafka consumer crashes with NPE when it sees deleted record Key: FLINK-3101 URL: https://issues.apache.org/jira/browse/FLINK-3101 Project: Flink

[jira] [Created] (FLINK-3100) Signal handler prints error on normal shutdown of cluster

2015-12-02 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-3100: - Summary: Signal handler prints error on normal shutdown of cluster Key: FLINK-3100 URL: https://issues.apache.org/jira/browse/FLINK-3100 Project: Flink

Re: Task Parallelism in a Cluster

2015-12-02 Thread Kashmar, Ali
There is no shuffle operation in my flow. Mine actually looks like this: Source: Custom Source -> Flat Map -> (Filter -> Flat Map -> Map -> Map -> Map, Filter) Maybe it’s treating this whole flow as one pipeline and assigning it to a slot. What I really wanted was to have the custom source I bui

[jira] [Created] (FLINK-3099) Create Script for Starting WebClient on Windows

2015-12-02 Thread Welly Tambunan (JIRA)
Welly Tambunan created FLINK-3099: - Summary: Create Script for Starting WebClient on Windows Key: FLINK-3099 URL: https://issues.apache.org/jira/browse/FLINK-3099 Project: Flink Issue Type: I

Re: The null in Flink

2015-12-02 Thread Stephan Ewen
Hi Chenliang! I have to dig into this again, it was a while back. I think (vaguely) the reason why this worked was that in the end (at the root of a tree that is a logical expression) if the result is UNKNOWN, it is treated like FALSE. For example a predicate like "WHERE t.a > 10 && t.b == 'pendi

Re: Task Parallelism in a Cluster

2015-12-02 Thread Till Rohrmann
If I'm not mistaken, then the scheduler has already a preference to spread independent pipelines out across the cluster. At least he uses a queue of instances from which it pops the first element if it allocates a new slot. This instance is then appended to the queue again, if it has some resources