Re:Re: ElasticsearchSink on DataSet

2017-05-08 Thread wyphao.2007
Hi Flavio Maybe this is what you want: https://github.com/397090770/flink-elasticsearch2-connector, It can save Flink DataSet to elasticsearch. importscala.collection.JavaConversions._ valconfig=Map("bulk.flush.max.actions"->"1000", "cluster.name"->"elasticsearch")valhosts="www.iteblog.com"val

Re:Re: Re: ElasticsearchSink on DataSet

2017-05-10 Thread wyphao.2007
for it :) It also looks like you’ve adopted most of the current ElasticsearchSink APIs (RequestIndexer, ElasticsearchSinkFunction, etc.) for the ElasticsearchOutputFormat, which is nice to fit into the current code :-D Cheers, Gordon On 9 May 2017 at 1:05:14 PM, wyphao.2007 (wyphao.2...@163.

Registering custom metrics does not work

2017-07-05 Thread wyphao.2007
Hi, all I want to know element's latency before write to Elasticsearch, so I registering a custom metrics as follow: class CustomElasticsearchSinkFunction extends ElasticsearchSinkFunction[EventEntry] { private var metricGroup: Option[MetricGroup] = None private var latency: Long = _ pr

Re:Re: Registering custom metrics does not work

2017-07-05 Thread wyphao.2007
a warning, is the metric not get registered at all or does the value not changing? On 06.07.2017 08:10, wyphao.2007 wrote: Hi, all I want to know element's latency before write to Elasticsearch, so I registering a custom me