Thanks for your reply Akhil.
How do you multithread it?
Sincerely,
Ashish Dutt
On Wed, Jul 8, 2015 at 3:29 PM, Akhil Das <ak...@sigmoidanalytics.com>
wrote:
> Whats the point of creating them in parallel? You can multi-thread it run
> it in parallel though.
>
> Thanks
> Best Regards
>
> On Wed, Jul 8, 2015 at 5:34 AM, Brandon White <bwwintheho...@gmail.com>
> wrote:
>
>> Say I have a spark job that looks like following:
>>
>> def loadTable1() {
>> val table1 = sqlContext.jsonFile(s"s3://textfiledirectory/")
>> table1.cache().registerTempTable("table1")}
>> def loadTable2() {
>> val table2 = sqlContext.jsonFile(s"s3://testfiledirectory2/")
>> table2.cache().registerTempTable("table2")}
>>
>> def loadAllTables() {
>> loadTable1()
>> loadTable2()}
>>
>> loadAllTables()
>>
>> How do I parallelize this Spark job so that both tables are created at
>> the same time or in parallel?
>>
>
>
