Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Fan Liya
Hi JingsongLee, Thanks a lot for your feedback. It's nice discussing with you guys :-) My comments below: 1. Sorry I did not clearly state the experimental environment. The evaluations were performed on a cluster with 21 N42 nodes (64 core, 256 GB memory, 10 Gb/s network card). I will add such i

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread JingsongLee
Thank liya for bringing this discussion. As the changes are very big and has a great impact on architecture. I think we should be more clear about the benchmark. We need to be cautious about testing to ensure that we really benefit from it. About the benchmark: 1.Can you make the test report cle

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Fan Liya
@Ji Liu, thanks a lot for your feedback. This work must be performed in a progressive manner, so as not to break existing code. Best, Liya Fan On Tue, Jul 2, 2019 at 3:57 PM Ji Liu wrote: > Hi Liya, > Thanks for opening this discuss. > +1 for this, vectorization makes sense for Flink especially

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Fan Liya
@Jeff Zhang, thanks for your kind reminder. The image can be found from our proposal or the JIRA . Best, Liya Fan On Tue, Jul 2, 2019 at

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Ji Liu
Hi Liya, Thanks for opening this discuss. +1 for this, vectorization makes sense for Flink especially for batch work loads, I think Flink should look into supporting it progressively. Thanks, Ji Liu -- From:Jeff Zhang Send Time:20

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Jeff Zhang
Hi Liya, Displaying image is not supported in apache mail list, you need to put it elsewhere and post link in mail list. Fan Liya 于2019年7月2日周二 下午3:40写道: > Performance chart. FYI. > > Best, > Liya Fan > [image: image.png] > > On Tue, Jul 2, 2019 at 3:37 PM Fan Liya wrote: > >> Hi all, >> >> W

Re: [DISCUSS] Vectorization Support in Flink

2019-07-02 Thread Fan Liya
Performance chart. FYI. Best, Liya Fan [image: image.png] On Tue, Jul 2, 2019 at 3:37 PM Fan Liya wrote: > Hi all, > > We have opened an issue about vectorization in Flink (FLINK-13053 > ). Would you please > give your valuable feedback? Thank