Re: Dataframe Transformation with Inner fields in Complex Datatypes.

2016-07-19 Thread java bigdata
Hi Ayan, Thanks for your update. All i am trying is to update an inner field in one of the dataframe's complex type column. withColumn method adds or replaces existing column. In my case column is a nested column. Please see the below example i mentioned in the mail. I dont have to add a new colu

Re: Dataframe Transformation with Inner fields in Complex Datatypes.

2016-07-17 Thread ayan guha
Hi withColumn adds the column. If you want different name, please use .alias() function. On Mon, Jul 18, 2016 at 2:16 AM, java bigdata wrote: > Hi Team, > > I am facing a major issue while transforming dataframe containing complex > datatype columns. I need to update the inner fields of complex