ok so the problem really was I was compiling with 2.1.0 jars and at run
time supplying 2.1.1. once I changed to 2.1.1 at compile time as well it
seem to work fine and I can see all my 75 fields.
On Thu, May 18, 2017 at 2:39 AM, kant kodali wrote:
> Hi All,
>
> Here is my code.
>
> Dataset df =
Hi All,
Here is my code.
Dataset df = ds.select(functions.from_json(new
Column("value").cast("string"), getSchema()).as("payload"));
Dataset df1 = df.selectExpr("payload.data.*");
StreamingQuery query =
df1.writeStream().outputMode("append").option("truncate",
"false").format("console").start()
