Clean up app folders in worker nodes

of app id of my application. I tried to get master object in code but it is throwing actor error. 4) Is there any correction required on below configuration SPARK_WORKER_OPTS="-Dspark.worker.cleanup.enabled=true -Dspark.worker.cleanup.interval=10" Thanks in advance Hutashan. --

Re: Spark Streaming

Yes.. I solved this problem using fileStream instead of textfile StreamingContext scc = new StreamingContext(conf, new Duration(1)); ClassTag k = ClassTag$.MODULE$.apply(LongWritable.class); ClassTag v = ClassTag$.MODULE$.apply(Text.class);