Here is a simple example that reproduces the problem. This code has a
missing attribute('kk') error. Is it a bug? Note that if the `select`
in line B is removed, this code would run.
import pyspark.sql.functions as F
df =
spark.createDataFrame([{'score':1.0,'ID':'abc','LABEL':True,'k':2},{'s
Hi Spark-users:
I have a dataframe "df_t" which was generated from other dataframes by
several transformations. And then I did something very simple, just
counting the rows, that is the following code:
(A)
df_t_1 = df_t.groupby(["Id","key"]).count().withColumnRenamed("count",
"cnt1")
df_t_2 = d
