Re: Flink the right tool for the job ? Huge Data window lateness

2017-02-26 Thread Timur Shenkao
. As for duplicate messages, it's not a problem of Flink or Cassandra. It's a logical problem, i.e. it's up to you how to achieve exactly once semantics. I advise you to use some storage anyway for reliability and failover. Sincerely yours, Timur Shenkao On Friday, February 24, 20

Re: Speedup of Flink Applications

2017-01-03 Thread Timur Shenkao
Hi, It seems your questions are too abstract & theoretical. The answer is : it depends on several factors. Skewness in data, data volume, reliability requirements, "fatness" of servers, whether one performs look-up in other data sources, etc. The papers you mentioned mean the following: under concr

Re: [DISCUSS] "Who's hiring on Flink" monthly thread in the mailing lists?

2016-12-13 Thread Timur Shenkao
How to subscribe? community-subscr...@flink.apache.org ? On Tue, Dec 13, 2016 at 6:32 PM, Robert Metzger wrote: > The commun...@flink.apache.org has been created :) > > On Tue, Dec 13, 2016 at 10:43 AM, Robert Metzger > wrote: > >> +1. I've requested the community@ mailing list from infra. >> >

Re: [DISCUSS] "Who's hiring on Flink" monthly thread in the mailing lists?

2016-12-09 Thread Timur Shenkao
Hi there, 1) it's a perfect idea 2) as I understand such information can be placed neither on* flink.apache.org * nor on* data-artisans.com * 3) there are tons of sites; who would take care of *dedicated site? *how not to forget about its existence

Re: Elasticsearch Http Connector

2016-10-26 Thread Timur Shenkao
Hi! For ElasticSearch HTTP Conector example, one may look at Flume's ElasticSearchSink https://github.com/apache/flume/tree/trunk/flume-ng-sinks/flume-ng-elasticsearch-sink It uses Apache Commons HTTPComponent On Wed, Oct 26, 2016 at 9:51 AM, Philipp Bussche wrote: > Hi, > yes I wrote an Elast