From: Silvio Fiorito [mailto:silvio.fior...@granturing.com]
Sent: Wednesday, August 26, 2015 8:54 PM
To: Ellafi, Saif A.; user@spark.apache.org
Subject: Re: Help! Stuck using withColumn
Hi Saif,
In both cases you’re referencing columns that don’t exist in the current
DataFrame.
The first email
saif.a.ell...@wellsfargo.com<mailto:saif.a.ell...@wellsfargo.com>"
Date: Wednesday, August 26, 2015 at 6:06 PM
To: "saif.a.ell...@wellsfargo.com<mailto:saif.a.ell...@wellsfargo.com>",
"user@spark.apache.org<mailto:user@spark.apache.org>"
Subject: RE: Help! Stuck usi
I can reproduce this even simpler with the following:
val gf = sc.parallelize(Array(3,6,4,7,3,4,5,5,31,4,5,2)).toDF("ASD")
val ff = sc.parallelize(Array(4,6,2,3,5,1,4,6,23,6,4,7)).toDF("GFD")
gf.withColumn("DSA", ff.col("GFD"))
org.apache.spark.sql.AnalysisException: resolved attribute(s) GFD#42
