Re: Broadcast big dataset

2016-10-01 Thread Anastasios Zouzias
Hey, Is the driver running OOM? Try 8g on the driver memory. Speaking of which, how do you estimate that your broadcasted dataset is 500M? Best, Anastasios Am 29.09.2016 5:32 AM schrieb "WangJianfei" : > First thank you very much! > My executor memeory is also 4G, but my spark version is 1.5.

Re: Broadcast big dataset

2016-09-28 Thread Takeshi Yamamuro
Hi, # I dropped dev and added user because this is more suitable in user-mailinglist. I think you need to describe more about your environments, e.g. spark version, executor memory, and so on. // maropu On Wed, Sep 28, 2016 at 11:03 PM, WangJianfei < wangjianfe...@otcaix.iscas.ac.cn> wrote: >