Re: Processing multiple files in parallel

2014-08-19 Thread SK
zableArray$class.foreach(ResizableArray.scala:59) thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Processing-multiple-files-in-parallel-tp12336p12428.html Sent from the Apache Spark User List mailing list archive at

Re: Processing multiple files in parallel

2014-08-19 Thread Sean Owen
sure if that is how Spark schedules the above code. > > thanks > > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Processing-multiple-files-in-parallel-tp12336.html > Sent from the Apache Spark User List mail

Processing multiple files in parallel

2014-08-18 Thread SK
extracting the first 2 columns from each file) can be done in parallel, but I am not sure if that is how Spark schedules the above code. thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Processing-multiple-files-in-parallel-tp12336.html Sent fro