ye, you're right, thanks for your patience:)
Sourav Chandra wrote
> Apart from user defined broadcast variable, there are others which is
> being
> created by spark. This could be one of those.
>
>
>
> As I had mentioned you can do a small program where you create a broadcast
> variable. Check
Apart from user defined broadcast variable, there are others which is being
created by spark. This could be one of those.
As I had mentioned you can do a small program where you create a broadcast
variable. Check the broadcast variable id(say its x). Then go to the /tmp
to open broadcast_x file.
thank you for your help, Sourav.
i found broadcast_0 binary file in /tmp directory. it's size is 33.4kB, not
equal to estimated size 135.6 KB.
i opened it and found it's content has no relations with my read in file. i
guess broadcast_0 is a config
file about spark, is that right?
--
View this m
In case HttpBroadcast is used, spark creates a jetty server and uses http
protocol for trasporting the broadcast variables to all workers. To do so
it write the serialized broadcast variable into their corresponding files,
and file names denote the broadcast id of the variable.
So broadcast_0 is t
