RE: Flink ML with DataStream

2017-07-21 Thread Branham, Jeremy [IT]
] Sent: Wednesday, July 19, 2017 2:12 PM To: Branham, Jeremy [IT] Cc: user@flink.apache.org Subject: Re: Flink ML with DataStream Hi, unfortunately, it is not possible to convert a DataStream into a DataSet. Flink's DataSet and DataStream APIs are distinct APIs that cannot be used together.

RE: Flink Anomaly Detection

2017-07-20 Thread Branham, Jeremy [IT]
Raj - I'm looking for the same thing. As the ML library doesn't support DataStream api, I'm tossing ideas around maybe using the windowing function to build up a model that changes over time. Jeremy D. Branham Technology Architect - Sprint O: +1 (972) 405-2970 | M: +1 (817) 791-1627 jeremy.d.br

Flink ML with DataStream

2017-07-19 Thread Branham, Jeremy [IT]
Hello - I've been successful working with Flink in Java, but have some trouble trying to leverage the ML library, specifically with KNN. >From my understanding, this is easier in Scala [1] so I've been converting my >code. One issue I've encountered is - How do I get a DataSet[Vector] from a Da

Re: Anomaly Detection with Flink-ML

2017-07-07 Thread Branham, Jeremy [IT]
Great information! Thanks Jonas! -- Original message-- From: Jonas Gröger Date: Fri, Jul 7, 2017 4:12 PM To: user@flink.apache.org; Cc: Subject:Re: Anomaly Detection with Flink-ML Hello Jeremy, it looks like what you are looking for is map (1 in, 1 out) / flatmap (1 in, 0-n out) for pr

Anomaly Detection with Flink-ML

2017-07-07 Thread Branham, Jeremy [IT]
Hello - I'm working on an anomaly detector for some time series monitoring data. I've setup an example project with Flink that reads from Kafka to get the monitoring data. Unfortunately, I'm not sure what to do next. The goal is to perform some clustering on the metric values that Flink is recei