Re: Using Hadoop InputFormat in Python

2014-08-14 Thread TJ Klein
Yes, thanks great. This seems to be the issue. At least running with spark-submit works as well. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Using-Hadoop-InputFormat-in-Python-tp12067p12126.html Sent from the Apache Spark User List mailing list archive

Re: Using Hadoop InputFormat in Python

2014-08-14 Thread Kan Zhang
--jars > > and then using sc.newAPIHadoopFile(path, > , .) > > However, that didn't work as it couldn't find the class. > > Any other idea? > > Thanks so far, > -Tassilo > > > > -- > View this message in context: > http://apache-spark-us

Re: Using Hadoop InputFormat in Python

2014-08-13 Thread Tassilo Klein
using sc.newAPIHadoopFile(path, , .) However, that didn't work as it couldn't find the class. Any other idea? Thanks so far, -Tassilo -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Using-Hadoop-InputFormat-in-Python-tp12067p12092.html Sent from the Ap

Re: Using Hadoop InputFormat in Python

2014-08-13 Thread Kan Zhang
>> Tassilo >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Using-Hadoop-InputFormat-in-Python-tp12067.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >&g

Re: Using Hadoop InputFormat in Python

2014-08-13 Thread Tassilo Klein
p://apache-spark-user-list.1001560.n3.nabble.com/Using-Hadoop-InputFormat-in-Python-tp12067p12069.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apac

Re: Using Hadoop InputFormat in Python

2014-08-13 Thread Sunny Khatri
DD function. However, I > am > not sure how to use that in combination with my custom InputFormat. > Does anybody have a short snipped of code how to do it? > Thanks in advance. > Best, > Tassilo > > > > -- > View this message in context: > http://apache-spark-us

Using Hadoop InputFormat in Python

2014-08-13 Thread Tassilo Klein
, I am not sure how to use that in combination with my custom InputFormat. Does anybody have a short snipped of code how to do it? Thanks in advance. Best, Tassilo -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Using-Hadoop-InputFormat-in-Python-tp12067.html