nted.
Thanks, any help is appreciated
--
*Aviad Klein*
Director of Data Science
Hi Owen, it's omitted from what I pasted but I'm using spark 2.4.4 on both.
On Mon, Aug 17, 2020 at 4:37 PM Sean Owen wrote:
> Looks like you are building vs Spark 3 and running on Spark 2, or
> something along those lines.
>
> On Mon, Aug 17, 2020 at 4:02 AM Aviad Klein
&
Hey Chris and Sean, thanks for taking the time to answer.
Perhaps my installation of pyspark is off, although I did use version 2.4.4
When developing in scala and pyspark how do you setup your environment?
I used sbt for scala spark
libraryDependencies ++= Seq(
"org.apache.spark" %% "spark-cor
