On Tue, Feb 21, 2017 at 2:35 PM, Vadim Vararu <[email protected]> wrote: > Basically, i have a big dictionary of reference data that has to be > accessible from all the nodes (in order to do some joins of log line with > reference line).
If the dictionary is small you can make it part of the closures that are send to the task managers. Just make it part of your function. If it is large, I'm not sure what the best way is to do it is right now. I've CC'd Aljoscha who can probably help...
