Re: Datastream splitter - Confusing behaviour

2017-01-03 Thread madhairsilence
Spot on. Thanks for the explanation and pointing out the bug in the code -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Datastream-splitter-Confusing-behaviour-tp15138p15145.html Sent from the Apache Flink Mailing List archive. mailing list archi

[jira] [Created] (FLINK-5406) add normalization phase for predicate logical plan rewriting between decorrelate query phase and volcano optimization phase

2017-01-03 Thread godfrey he (JIRA)
godfrey he created FLINK-5406: - Summary: add normalization phase for predicate logical plan rewriting between decorrelate query phase and volcano optimization phase Key: FLINK-5406 URL: https://issues.apache.org/jira/

[jira] [Created] (FLINK-5405) Add streaming connection to twitter through a internet proxy

2017-01-03 Thread Luis (JIRA)
Luis created FLINK-5405: --- Summary: Add streaming connection to twitter through a internet proxy Key: FLINK-5405 URL: https://issues.apache.org/jira/browse/FLINK-5405 Project: Flink Issue Type: Improve

Re: Categorize or GroupBy datastream data and process with CEP separately

2017-01-03 Thread Jamie Grier
I think what you want here is to apply CEP processing on a KeyedStream - see the last CEP Example here: https://ci.apache.org/projects/flink/flink-docs-release-1.1/apis/streaming/libs/cep.html#examples On Tue, Jan 3, 2017 at 3:30 AM, madhairsilence wrote: > Assume I have a datastream > > *x:1,

Re: Datastream splitter - Confusing behaviour

2017-01-03 Thread Jark Wu
Hi madhairsilence, 1. The default parallelism of a job is set to the number of cpu cores on your machine, generally is 4. That means all operators’ (except source operator) parallelism is 4. That’s why you get always get 4 files, because there are 4 csv sink tasks. You can change the paral

[DISCUSS] Apache Flink 1.2.0 RC0 (Non-voting testing release candidate)

2017-01-03 Thread Robert Metzger
Hi, First of all, I wish everybody a happy new year 2017. I've set user@flink in CC so that users who are interested in helping with the testing get notified. Please respond only to the dev@ list to keep the discussion there! According to the 1.2 release discussion thread, I've created a first r

Categorize or GroupBy datastream data and process with CEP separately

2017-01-03 Thread madhairsilence
Assume I have a datastream *x:1, y:2 , z:3 , x:7 , y:-1, z:0, z:3 , z:2, y:3 ,x: 2 ,y:6* How do I put x,y,z in their own bucket and apply my CEP rule on it. *x:1, x:7,x: 2 y:2, y:-1, y:3 , y:6 z:3, z:0 , z:3, z:2* Or to put it in other way. How do I split the stream in to these categories(one st

Datastream splitter - Confusing behaviour

2017-01-03 Thread madhairsilence
This is my code /DataStream someIntegers = env.fromElements(1,2,3,4); SplitStream s = someIntegers.split(new OutputSelector() { List out = new ArrayList(); @Override public Iterable select(In