ye, you're right, thanks for your patience:)
Sourav Chandra wrote
> Apart from user defined broadcast variable, there are others which is
> being
> created by spark. This could be one of those.
>
>
>
> As I had mentioned you can do a small program where you create a broadcast
> variable. Check
Apart from user defined broadcast variable, there are others which is being
created by spark. This could be one of those.
As I had mentioned you can do a small program where you create a broadcast
variable. Check the broadcast variable id(say its x). Then go to the /tmp
to open broadcast_x file.
thank you for your help, Sourav.
i found broadcast_0 binary file in /tmp directory. it's size is 33.4kB, not
equal to estimated size 135.6 KB.
i opened it and found it's content has no relations with my read in file. i
guess broadcast_0 is a config
file about spark, is that right?
--
View this m
xhsdp wrote:
> Hi, guys
>
> when i read in a file on spark shell, the console shows that broadcast_0 is
> stored to memory. i guess it's
> related to the file, but broadcast_0 is not the file itself, because they
> have different size. what does broadcast_0 stand for?
>
&
Hi, guys
when i read in a file on spark shell, the console shows that broadcast_0 is
stored to memory. i guess it's
related to the file, but broadcast_0 is not the file itself, because they
have different size. what does broadcast_0 stand for?
logs:
14/04/28 18:02:50 INFO Memory
