mapWithState handle timeout
I go an error: Cannot update the state that is timing out Because I set the timeout: val newStateDstream = newActionDstream.mapWithState(StateSpec.function(mappingFunc).timeout(Seconds(3600)).initialState(initialRDD)) In the spark code : https://github.com/apache/spark/blob/master/streaming/src/
Spark yarn use IP instead hostname
Hi: spark submit task by yarn-cluster, and the node info show hostname : [image: Inline images 4] how to make it show ips: [image: Inline images 2] --