Re: problem of sharing TCP connection when transferring data

2016-05-23 Thread Deepak Sharma
Thanks Ufuk. Sure I would pick some starter issues and get to these low level issues. -Deepak On 23 May 2016 11:21 pm, "Ufuk Celebi" wrote: > On Mon, May 23, 2016 at 7:30 PM, Deepak Sharma > wrote: > > Would it be possible to get involved on this issues and start > contributing > > to Flink com

Re: problem of sharing TCP connection when transferring data

2016-05-23 Thread Ufuk Celebi
On Mon, May 23, 2016 at 7:30 PM, Deepak Sharma wrote: > Would it be possible to get involved on this issues and start contributing > to Flink community? Hey Deepak! Nice to see that you are also interested in this. If you are new to Flink I would recommend to start contributing by looking into o

Re: problem of sharing TCP connection when transferring data

2016-05-23 Thread Deepak Sharma
I am not Flink master or regular user of FLink , but would like to start contributing to Flink. Would it be possible to get involved on this issues and start contributing to Flink community? Thanks Deepak On Mon, May 23, 2016 at 10:49 PM, Ufuk Celebi wrote: > On Mon, May 23, 2016 at 6:55 PM, wa

Re: problem of sharing TCP connection when transferring data

2016-05-23 Thread Ufuk Celebi
On Mon, May 23, 2016 at 6:55 PM, wangzhijiang999 wrote: >In summary, if one task set autoread as false, and when it notify the > available buffer, there are some messages during this time to be processed > first, if one message belongs to another failed task, the autoread for this > channel wo

Re: problem of sharing TCP connection when transferring data

2016-05-23 Thread Ufuk Celebi
Yes, that is a correct description of the state of things. A way to improve this is to introduce flow control in the application layer, where consumers only receive buffers when they have buffers available. They could announce on the channel how many buffers they have before they receive anything.