Programatically collect taskmanagers details from Job Manager

2016-08-28 Thread Sreejith S
Hi All, Is there any programmatic way to get the taskmanager details from a flink clluster ? At least the IP of taskmanagers ? Thanks, -- *Sreejith.S* https://github.com/srijiths/ tweet2sree@twitter

Re: Apache siddhi into Flink

2016-08-28 Thread Trevor Grant
Aparup, Was Siddhi recently added as an incubator project? I can't find it in the project directory or or on github.com/apache. The closest thing I can find is this: https://github.com/wso2/siddhi tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3

Re: Apache siddhi into Flink

2016-08-28 Thread Hao Chen
Siddhi is not apache project, but licensed under apache license v2, being open sourced and maintained by wso2. - Hao On Sun, Aug 28, 2016 at 11:11 PM, Trevor Grant wrote: > Aparup, > > Was Siddhi recently added as an incubator project? I can't find it in the > project directory or or on github

different Kafka serialization for keyed and non keyed messages

2016-08-28 Thread rss rss
Hello, why Flink implements different serialization schemes for keyed and non keyed messages for Kafka? I'm using two ways of loading of messages to Kafka. First way is on-fly loading without Flink by Kafka's means only. In this case I'm using something like: props.put("partitioner.class", K

Re: Apache siddhi into Flink

2016-08-28 Thread Trevor Grant
Thank you for confirming Hao, Aparup, please don't refer to it as "Apache Siddhi", that is misleading. Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org *"Fortunate is he, who is able to know the causes of things

Bisecting K-Means - Working with intermediate results as DataSets

2016-08-28 Thread Adrian Bartnik
Hi, I am working on implementing a variant of the k-means algorithm, namely Bisecting K-means [1]. The basic premise is to run the original k-means algorithm on increasingly smaller subsets of the original input data. In each step of the outer loop, it splits the current cluster in 2 new sma

Re: Apache siddhi into Flink

2016-08-28 Thread Aparup Banerjee (apbanerj)
Sorry for the semantic difference. On Aug 28, 2016, at 12:05 PM, Trevor Grant mailto:trevor.d.gr...@gmail.com>> wrote: Thank you for confirming Hao, Aparup, please don't refer to it as "Apache Siddhi", that is misleading. Trevor Grant Data Scientist https://github.com/rawkintrevo http://sta