Re: Confusing behavior of newAPIHadoopFile

2014-07-28 Thread chang cheng
github: http://www.github.com/uronce-cc -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Confusing-behavior-of-newAPIHadoopFile-tp10764p10779.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Confusing behavior of newAPIHadoopFile

2014-07-28 Thread Sean Owen
ing3", "string4") > > your solution may not handle this. > > > > - > Senior in Tsinghua Univ. > github: http://www.github.com/uronce-cc > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Confusing-behavior-of-newAPIHadoopFile-tp10764p10777.html > Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Confusing behavior of newAPIHadoopFile

2014-07-28 Thread chang cheng
ring1", "string2", "string3", "string4") your solution may not handle this. - Senior in Tsinghua Univ. github: http://www.github.com/uronce-cc -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Confusing-behavior-of-newAPIHadoopFile-tp10764p10777.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Confusing behavior of newAPIHadoopFile

2014-07-28 Thread Sean Owen
, chang cheng (myai...@gmail.com) 写到: > > the value in (key, value) returned by textFile is exactly one line of the > input. > > But what I want is the field between the two “!!”, hope this makes sense. > > > > - > Senior in Tsinghua Univ. > github: http://www.github

Re: Confusing behavior of newAPIHadoopFile

2014-07-28 Thread gmail
eld between the two “!!”, hope this makes sense. - Senior in Tsinghua Univ. github: http://www.github.com/uronce-cc -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Confusing-behavior-of-newAPIHadoopFile-tp10764p10768.html Sent from the Apache

Re: Confusing behavior of newAPIHadoopFile

2014-07-28 Thread chang cheng
ithub: http://www.github.com/uronce-cc -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Confusing-behavior-of-newAPIHadoopFile-tp10764p10773.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Confusing behavior of newAPIHadoopFile

2014-07-28 Thread chang cheng
.1001560.n3.nabble.com/Confusing-behavior-of-newAPIHadoopFile-tp10764p10768.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Confusing behavior of newAPIHadoopFile

2014-07-28 Thread gmail
String)* > > rdd.take(3).foreach(println) > > Then, the results are: > > filed1 > key1 value1 > key2 value2 > > field2 > > As expected. > > I'm confused by the first code snippet's behavior. > Hope you can offe

Re: Confusing behavior of newAPIHadoopFile

2014-07-28 Thread Sean Owen
gt; key1 value1 > key2 value2 > > field2 > > As expected. > > I'm confused by the first code snippet's behavior. > Hope you can offer an explanation. Thanks! > > > > - > Senior in Tsinghua Univ. > github: http://www.github.com/uronce-cc > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Confusing-behavior-of-newAPIHadoopFile-tp10764.html > Sent from the Apache Spark User List mailing list archive at Nabble.com.

Confusing behavior of newAPIHadoopFile

2014-07-28 Thread chang cheng
key2 value2 field2 As expected. I'm confused by the first code snippet's behavior. Hope you can offer an explanation. Thanks! - Senior in Tsinghua Univ. github: http://www.github.com/uronce-cc -- View this message in context: http://apache-spark-user-list.1001