时间：2018年10月18日(星期四) 17:47
> 收件人：Zhijiang(wangzhijiang999)
> 抄 送：Nico Kruber ; dev
> 主 题：Re: [DISCUSS] Improve broadcast serialization
>
> Hey,
>
> I also think that 3rd option is the most promising, however logic of “dirty”
> channels might be causing some overheads.
--
发件人：Piotr Nowojski
发送时间：2018年10月18日(星期四) 17:47
收件人：Zhijiang(wangzhijiang999)
抄 送：Nico Kruber ; dev
主 题：Re: [DISCUSS] Improve broadcast serialization
Hey,
I also think that 3rd option is the most promising, however logic of “dirty”
channels might be
hird point
> from current thoughting, which keeps the same behavior like normal "emit"
> mixing with "broadcastEvent".
>
> Best,
> Zhijiang
> --
> 发件人：Piotr Nowojski
> 发送时间：2018年10月17日(星期三) 19:
nt thoughting, which keeps the same behavior like normal "emit"
mixing with "broadcastEvent".
Best,
Zhijiang
----------
发件人：Piotr Nowojski
发送时间：2018年10月17日(星期三) 19:25
收件人：Zhijiang(wangzhijiang999)
抄 送：Nico Kruber ; dev
主 题：Re: [DISCUSS] Improve broadc
-----------------
> 发件人：Piotr Nowojski
> 发送时间：2018年7月19日(星期四) 17:52
> 收件人：Zhijiang(wangzhijiang999)
> 抄 送：Nico Kruber ; dev
> 主 题：Re: [DISCUSS] Improve broadcast serialization
>
> Hi,
>
> I have only noticed your second response after sending my email
Best,
Zhijiang
--
发件人：Zhijiang(wangzhijiang999)
发送时间：2018年7月20日(星期五) 13:21
收件人：Piotr Nowojski
抄 送：Nico Kruber ; dev
主 题：回复：[DISCUSS] Improve broadcast serialization
Ok, that is fine. :)
I will create JIRA today and submit the PR
件人：Piotr Nowojski
发送时间：2018年7月18日(星期三) 20:04
收件人：Zhijiang(wangzhijiang999) ; Nico Kruber
抄 送：dev
主 题：Re: [DISCUSS] Improve broadcast serialization
Hi
1. I want to define a new AbstractRecordWriter as base class which defines some
abstract methods and utility codes. The current RecordWriter
18日(星期三) 20:04
收件人：Zhijiang(wangzhijiang999) ; Nico Kruber
抄 送：dev
主 题：Re: [DISCUSS] Improve broadcast serialization
Hi
1. I want to define a new AbstractRecordWriter as base class which defines some
abstract methods and utility codes. The current RecordWriter used for other
partitioner and
help review PR if have
> time. :)
>
Sure :)
Piotrek
>
> Best,
>
> Zhijiang
> --
> 发件人：Piotr Nowojski
> 发送时间：2018年7月18日(星期三) 16:37
> 收件人：dev ; Zhijiang(wangzhijiang999)
>
> 主 题：Re: [DISCUSS] Improve broadcast serializ
：2018年7月18日(星期三) 18:26
收件人：dev ; Piotr Nowojski
主 题：回复：[DISCUSS] Improve broadcast serialization
Hi Piotr,
Your thoughts bring me more inspirations and possibilities.
1. I want to define a new AbstractRecordWriter as base class which defines some
abstract methods and utility codes. The current
t; Best,
>
> Zhijiang
>
>
> ----------
> 发件人：Piotr Nowojski
> 发送时间：2018年7月17日(星期二) 23:31
> 收件人：dev ; Zhijiang(wangzhijiang999)
>
> 主 题：Re: [DISCUSS] Improve broadcast serialization
>
> Hi
>
> Genera
gt; Zhijiang
>
>
> ------------------
> 发件人：Piotr Nowojski
> 发送时间：2018年7月17日(星期二) 23:31
> 收件人：dev ; Zhijiang(wangzhijiang999)
>
> 主 题：Re: [DISCUSS] Improve broadcast serialization
>
> Hi
>
> Generally speaking t
发送时间：2018年7月17日(星期二) 23:31
收件人：dev ; Zhijiang(wangzhijiang999)
主 题：Re: [DISCUSS] Improve broadcast serialization
Hi
Generally speaking this would be a nice optimisation, however it might be
tricky to implement. The thing to keep in mind is that currently interface
allow to interleave broadcasti
Hi
Generally speaking this would be a nice optimisation, however it might be
tricky to implement. The thing to keep in mind is that currently interface
allow to interleave broadcasting and normal sending, because of that at any
given time some serialisers can have more data then others. For exa
Hi all,
In current implementation, the RecordSerializer is created separately for each
subpartition in RecordWriter, that means the number of serializers equals to
the number of subpartitions.
For broadcast partitioner, every record will be serialized many times in all
the subpartitions, and th
15 matches
Mail list logo
