Re: Upserts with Flink-elasticsearch

2016-03-28 Thread Suneel Marthi
Would it be useful to modify the existing Elasticsearch 1x sink to be able to handle Upserts ? On Mon, Mar 28, 2016 at 5:32 PM, Zach Cox wrote: > Hi Madhukar - with the current Elasticsearch sink in Flink 1.0.0 [1], I > don't think an upsert is possible, since IndexRequestBuilder can only > ret

Re: Upserts with Flink-elasticsearch

2016-03-28 Thread Zach Cox
Hi Madhukar - with the current Elasticsearch sink in Flink 1.0.0 [1], I don't think an upsert is possible, since IndexRequestBuilder can only return an IndexRequest. In Flink 1.1, the Elasticsearch 2.x sink [2] provides a RequestIndexer [3] that you can pass an UpdateRequest to do an upsert. Than

Re: DataSet.randomSplit()

2016-03-28 Thread Ufuk Celebi
Hey Gna! I think that it's not on the road map at the moment. Feel free to ping in the linked PR though. Probably Till can chime in there. – Ufuk On Mon, Mar 28, 2016 at 5:16 PM, Sourigna Phetsarath < gna.phetsar...@teamaol.com> wrote: > Ufuk, > > Thank you. Yes, I saw the sampling methods in D

Upserts with Flink-elasticsearch

2016-03-28 Thread Madhukar Thota
Is it possible to do Upsert with existing flink-elasticsearch connector today?

Flink ML 1.0.0 - Saving and Loading Models to Score a Single Feature Vector

2016-03-28 Thread Sourigna Phetsarath
Flinksters, Is there an example of saving a Trained Model, loading a Trained Model and then scoring one or more feature vectors using Flink ML? All of the examples I've seen have shown only sequential fit and predict. Thank you. -Gna -- *Gna Phetsarath*System Architect // AOL Platforms // Da

Re: DataSet.randomSplit()

2016-03-28 Thread Sourigna Phetsarath
Ufuk, Thank you. Yes, I saw the sampling methods in DataSetUtils and they are helpful. Just wanted to see if that particular method is on the road map for a future release. -Gna On Mon, Mar 28, 2016 at 6:22 AM, Ufuk Celebi wrote: > Hey Sourigna, > > that particular method is not part of Flin

AW: Window Support in Flink

2016-03-28 Thread Fabian Hueske
Hopping windows is a term used on the Apache Calcite website [1]. In Flink terms, hopping windows are sliding windows. Cheers, Fabian [1] http://calcite.apache.org/docs/stream.html Von: Ufuk Celebi Gesendet: Montag, 28. März 2016 12:40 An: user@flink.apache.org Betreff: Re: Window Support in

Re: Window Support in Flink

2016-03-28 Thread Ufuk Celebi
Hey! (a) This is not a Flink term. I could not find the term in the slides, but I guess that it is referring to tumbling windows. For more details, check out these pages: https://flink.apache.org/news/2015/12/04/Introducing-windows.html https://ci.apache.org/projects/flink/flink-docs-release-1.0

Re: DataSet.randomSplit()

2016-03-28 Thread Ufuk Celebi
Hey Sourigna, that particular method is not part of Flink yet. Did you have a look at the sampling methods in DataSetUtils? Maybe they can be helpful for what you are trying to achieve. – Ufuk On Wed, Mar 23, 2016 at 5:19 PM, Sourigna Phetsarath < gna.phetsar...@teamaol.com> wrote: > All: > >