Re: RDD Manipulation in Scala.

2014-03-04 Thread trottdw
Thanks Sean, I think that is doing what I needed. It was much simpler than what I had been attempting. Is it possible to do an OR statement filter? So, that for example column 2 can be filtered by "A2" appearances and column 3 by "A4"? -- View this message in context: http://apache-spark-u

Re: RDD Manipulation in Scala.

2014-03-04 Thread Sean Owen
data.filter(_.split("\t")(1) == "A2") ? -- Sean Owen | Director, Data Science | London On Tue, Mar 4, 2014 at 1:06 PM, trottdw wrote: > Hello, I am using Spark with Scala and I am attempting to understand the > different filtering and mapping capabilities available. I haven't found an > exampl