Hello Mixtou, if you want to look at partition ID, I believe you want to use
mapPartitionsWithIndex
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Newbie-Question-on-How-Tasks-are-Executed-tp21064p21228.html
Sent from the Apache Spark User List mailing
;
}
def estimateGuaranteedFrequentWords(): Unit = {
frequent_words_counters.foreach{tuple =>
if (tuple._2(0) - tuple._2(1) < words_no*fi) {
guaranteed_words -= tuple._1;
}
else {
System.out.println("Guaranteed Word : "+tuple._1+" with co
