Is it possible to do this:\ JavaRDD<String> parttionedRdds = input.map(new Split()).sortByKey().partitionBy(new HashPartitioner(k)).values(); parttionedRdds.saveAsTextFile(args[2]); //Then run my SingletonFunction (My app depends on the saved Files....) parttionedRdds.map(new SingletonFunc());
The parttionedRdds.map(new SingletonFunc()); is never called do i need to set ctx.setJobGroup or what i am trying to implement will not work ? What is a usecase for ctx.setJobGroup is there any example? Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Running-a-task-once-on-each-executor-tp3203p3427.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
