I am joining two tables as below, the program stalls at below log line and
never proceeds.
What might be the issue and possible solution?
>>> INFO SparkContext: Starting job: RangePartitioner at Exchange.scala:79
Table 1 has 450 columns
Table2 has 100 columns
Both tables have few million rows
val table1= myTable1.as('table1)
val table2= myTable2.as('table2)
val results= table1.join(table2,LeftOuter,Some("table1.Id".attr ===
"table2.id".attr ))
println(results.count())
Thanks and Regards,
Rishi
@meditativesoul