On Thu, 7 Dec 2017 at 11:37 am, ayan guha <guha.a...@gmail.com> wrote:
> You can use get_json function > > On Thu, 7 Dec 2017 at 10:39 am, satyajit vegesna < > satyajit.apas...@gmail.com> wrote: > >> Does spark support automatic detection of schema from a json string in a >> dataframe. >> >> I am trying to parse a json string and do some transofrmations on to it >> (would like append new columns to the dataframe) , from the data i stream >> from kafka. >> >> But i am not very sure, how i can parse the json in structured streaming. >> And i would not be interested in creating a schema, as the data form kafka >> is going to maintain different schema objects in value column. >> >> Any advice or help would be appreciated. >> >> Regards, >> Satyajit. >> > -- > Best Regards, > Ayan Guha > -- Best Regards, Ayan Guha