Re: problem with using mapPartitions

I solved the problem. It was caused by using spark-core_2.11 mvn repository. When I compiled with spark-core_2.10, the problem doesn't show up again. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/problem-with-using-mapPartitions-tp12514p

Re: problem with using mapPartitions

Thank you for your reply. But the typo is not reason for the problem. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/problem-with-using-mapPartitions-tp12514p12520.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com

Re: problem with using mapPartitions

ventProcessLoop.onReceive(DAGScheduler.scala:1354) > at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) > 15/05/30 10:41:21 ERROR SparkDeploySchedulerBackend: Asked to remove > non-existent executor

problem with using mapPartitions

AGScheduler.scala:1354) at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) 15/05/30 10:41:21 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 1 Anybody can help me? Thx -- View this message in context: http://apache-spark-developers-list.1001551.n3.n