+1
In fact, not only Shuffle can benefit from RDMA. Broadcast modules can also
benefit from this with decent modification, with benefits of less CPU
occupation and better network proformance.
Tencent is evaluating on this in Lab, and we observe a roughly 50% improvemnet
in TeraSort, in 100G
+1
Xiao
On Mon, 9 Oct 2017 at 7:31 PM Reynold Xin wrote:
> +1
>
> One thing with MetadataSupport - It's a bad idea to call it that unless
> adding new functions in that trait wouldn't break source/binary
> compatibility in the future.
>
>
> On Mon, Oct 9, 2017 at 6:07 PM, Wenchen Fan wrote:
>
>
+1
On Thu, Oct 12, 2017 at 10:36 AM, Xiao Li wrote:
> +1
>
> Xiao
>
> On Mon, 9 Oct 2017 at 7:31 PM Reynold Xin wrote:
>
>> +1
>>
>> One thing with MetadataSupport - It's a bad idea to call it that unless
>> adding new functions in that trait wouldn't break source/binary
>> compatibility in the
