With end no in sight.
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
With end no in sight.
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
NO SHAME
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Same here (using vanilla spark-ec2), I believe this started when I moved
from 1.3.0 to 1.3.1. Only thing unusual with the setup is a few extra
security parameters on EC2 but was the same as in 1.3.0. Did you solve this
problem?
On Thu, Apr 2, 2015 at 8:02 AM, Ganon Pierce wrote:
> Now I am recei
ideas?
Thanks a lot,
Nelson.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Batch-timestamp-in-spark-streaming-tp20786.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
As simple as that. Indeed, the spark jar i was linking to wasn't the mapr
version. I just added spark-assembly-0.9.1-hadoop1.0.3-mapr-3.0.3.jar to the
lib directory of my project as a unmanaged dependency for sbt.
Thank you Cafe au Lait and to all of you guys.
Regards,
Nelson.
--
View
r")
val mlist = sc.parallelize(list)
mlist.saveAsTextFile("maprfs:///user/nelson/test")/
and the stack trace:
/14/05/26 16:02:54 WARN scheduler.TaskSetManager: Loss was due to
java.lang.NullPointerException
java.lang.NullPointerException
at org.apache.hadoop.fs.
thanks for replying guys.
Mayur:
Indeed i tried the local mode (sparkmaster: local[5]) before and the
application runs well, no serialization problem. The problem arises as soon
as i try to run the app over the cluster.
Surendranauth:
I just double checked my spark_classpath from spark_env.sh and
2.jar
- json-20140107.jar
- maprfs-1.0.3-mapr-3.0.2.jar
Finally, i add those jars with conf.setJars so that they are distributed on
the cluster.
Am I compiling with the wrong dependencies? Should i get a "mapr version" of
spark-core?
Regards, Nelson
--
View this message in context:
13 matches
Mail list logo