Re: Spark job uses only one Worker

2016-01-08 Thread Prem Sure
imple enough, reading data from two S3 files, joining records > on > a shared field, filtering out some records and writing the result back to > S3. > > Tried all kinds of stuff, but could not make it work. I did find similar > questions, but had already tried the solutions that wo

Re: Spark job uses only one Worker

2016-01-08 Thread Michael Pisula
he >>> result back to >>> S3. >>> >>> Tried all kinds of stuff, but could not make it work. I did >>> find similar >>> questions, but had already tried the solutions that worked >>>

Re: Spark job uses only one Worker

2016-01-07 Thread Annabel Melongo
d the solutions that worked in those cases. Would be really happy about any pointers. Cheers, Michael -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-uses-only-one-Worker-tp25909.html Sent from the Apache Spark User List mailing list a

Re: Spark job uses only one Worker

2016-01-07 Thread Michael Pisula
ng data from two S3 >>> files, joining records on >>> a shared field, filtering out some records and writing >>> the result back to >>> S3. >>> >>> Tried all kinds of stuff, but could not make it wo

Re: Spark job uses only one Worker

2016-01-07 Thread Igor Berman
me records and writing the result back to >>> S3. >>> >>> Tried all kinds of stuff, but could not make it work. I did find similar >>> questions, but had already tried the solutions that worked in those >>> cases. >>&

Re: Spark job uses only one Worker

2016-01-07 Thread Michael Pisula
s of stuff, but could not make it work. I did >> find similar >> questions, but had already tried the solutions that worked in >> those cases. >> Would be really happy about any pointers. >> >>

Re: Spark job uses only one Worker

2016-01-07 Thread Igor Berman
worked in those cases. >> Would be really happy about any pointers. >> >> Cheers, >> Michael >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-uses-only-one-Worker-tp25909.ht

Re: Spark job uses only one Worker

2016-01-07 Thread Michael Pisula
d the solutions that worked in > those cases. > Would be really happy about any pointers. > > Cheers, > Michael > > > > -- > View this message in context: > > http://apache-spark-user-list.1001560.n3.nabble

Re: Spark job uses only one Worker

2016-01-07 Thread Igor Berman
uff, but could not make it work. I did find similar > questions, but had already tried the solutions that worked in those cases. > Would be really happy about any pointers. > > Cheers, > Michael > > > > -- > View this message in context: > http://apache-spark-user-list.1001

Spark job uses only one Worker

2016-01-07 Thread Michael Pisula
message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-uses-only-one-Worker-tp25909.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr