problem of sharing TCP connection when transferring data

2016-05-22 Thread wangzhijiang999
Hi,      I am confused with sharing tcp connection for the same connectionID, if two tasks share the same connection, and there is no available buffer in the local buffer pool of the first task  , then it will set autoread as false for the channel, but it will effect the second task if it still

Flink's WordCount at scale of 1BLN of unique words

2016-05-22 Thread Xtra Coder
Hello, Question from newbie about how Flink's WordCount will actually work at scale. I've read/seen rather many high-level presentations and do not see more-or-less clear answers for following … Use-case: -- there is huuuge text stream with very variable set of words – let's say 1BLN

Re: Debugging watermarks?

2016-05-22 Thread Stephan Ewen
Hi Niels! It may also be interesting for you to know that with the extension of the metrics and the web frontend, watermarks should be easily trackable in the near future, via JMX metrics, or a tab in the Flink dashboard. Stephan On Sat, May 21, 2016 at 5:15 PM, Aljoscha Krettek wrote: > Hi N