Can someone help take a look at my questions? Thanks.
bit1...@163.com From: bit1...@163.com Date: 2015-05-29 18:57 To: user Subject: How Broadcast variable works Hi, I have a spark streaming application. SparkContext uses broadcast vriables to broadcast Configuration information that each task will be used I have following two questions: 1. Will the broadcast variable be broadcasted every time when driver sends tasks to workers in each batch interval? 2. If the above question is true, then if the broadcast variable is modified between the batch interval(The configuration information is updated over time) and Spark Context broadcasts it again, will tasks see the updated variable? Thanks. bit1...@163.com
