Re: Scala left join with multiple columns Join condition is missing or trivial. Use the CROSS JOIN syntax to allow cartesian products between these relations.

Thanks Andrew. I completely missed that. It worked by removing the null safe join condition. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Scala-left-join-with-multiple-columns-Join-condition-is-missing-or-trivial-Use-the-CROSS-JOIN-syntax-tp21297p2

Scala left join with multiple columns Join condition is missing or trivial. Use the CROSS JOIN syntax to allow cartesian products between these relations.

The join condition with && is throwing an exception: val df = baseDF.join(mccDF, mccDF("medical_claim_id") <=> baseDF("medical_claim_id") && mccDF("medical_claim_detail_id") <=> baseDF("medical_claim_detail_id"), "left") .join(revCdDF, revCdDF("revenue_code_padded_str") <=> mccDF("