You can only know the actual data size of your RDD in memory if you
serialize your data objects to binaries. Otherwise you can only estimate
the size of the data objects in JVM.
On Tue, Dec 3, 2019 at 5:58 AM zhangliyun wrote:
>
>
>
>
>
>
> 转发邮件信息
> 发件人："zhangliyun"
> 发送日期：201
转发邮件信息
发件人："zhangliyun"
发送日期：2019-12-03 05:56:55
收件人："Wenchen Fan"
主题：Re:Re: A question about radd bytes size
Hi Fan:
thanks for reply, I agree that the how the data is stored decides the total
bytes of the table file.
In my experiment, I found that
sequenc
