Re: Spark 2 - Creating datasets from dataframes with extra columns

2017-02-08 Thread Don Drake
2017/2/7 01:26:59 > *To:* "user"; > *Subject:* Re: Spark 2 - Creating datasets from dataframes with extra > columns > > This seems like a bug to me, the schemas should match. > > scala> import org.apache.spark.sql.Encoders > import org.apache.spark.s

Re: Spark 2 - Creating datasets from dataframes with extra columns

2017-02-08 Thread ??????????
i checked it, it seems is a bug. do you create a jira now plesae? ---Original--- From: "Don Drake" Date: 2017/2/7 01:26:59 To: "user"; Subject: Re: Spark 2 - Creating datasets from dataframes with extra columns This seems like a bug to me, the schemas should m

Re: Spark 2 - Creating datasets from dataframes with extra columns

2017-02-06 Thread Don Drake
This seems like a bug to me, the schemas should match. scala> import org.apache.spark.sql.Encoders import org.apache.spark.sql.Encoders scala> val fEncoder = Encoders.product[F] fEncoder: org.apache.spark.sql.Encoder[F] = class[f1[0]: string, f2[0]: string, f3[0]: string] scala> fEncoder.schema