Re: Reading Hive tables Parallel in Spark

2017-07-18 Thread Matteo Cossu
t;> > longer time to finish. >> > >> > I tired submitting 4 different Spark jobs ( each having set of tables >> to be >> > converted), it did give me some parallelism , but i would like to do >> this in >> > single Spark job due to few limitation o

Re: Reading Hive tables Parallel in Spark

2017-07-17 Thread Fretz Nuson
jobs ( each having set of tables > to be > > converted), it did give me some parallelism , but i would like to do > this in > > single Spark job due to few limitation of our cluster and process > > > > Any help will be greatly appreciated > > > > > > > >

Re: Reading Hive tables Parallel in Spark

2017-07-17 Thread Fretz Nuson
to >> be >> converted), it did give me some parallelism , but i would like to do this >> in >> single Spark job due to few limitation of our cluster and process >> >> Any help will be greatly apprecia

Re: Reading Hive tables Parallel in Spark

2017-07-17 Thread Rick Moritz
gt; > > I tired submitting 4 different Spark jobs ( each having set of tables > to be > > converted), it did give me some parallelism , but i would like to do > this in > > single Spark job due to few limitation of our cluster and process > > > > Any help will be greatl

Re: Reading Hive tables Parallel in Spark

2017-07-17 Thread Simon Kitching
our cluster and process > > Any help will be greatly appreciated > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Reading-Hive-tables-Parallel

Re: Reading Hive tables Parallel in Spark

2017-07-17 Thread Pralabh Kumar
nd process > > Any help will be greatly appreciated > > > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/Reading-Hive-tables-Parallel-in-Spark-tp28869.html > Sent from the Apache Spark User List mailing list archive

Re: Reading Hive tables Parallel in Spark

2017-07-17 Thread Matteo Cossu
t i would like to do this > in > single Spark job due to few limitation of our cluster and process > > Any help will be greatly appreciated > > > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/Reading-Hive-table

Reading Hive tables Parallel in Spark

2017-07-17 Thread FN
this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Reading-Hive-tables-Parallel-in-Spark-tp28869.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail