RE: How to Parse & flatten JSON object in a text file using Spark&Scala into Dataframe

2015-12-24 Thread Bharathi Raja
Thanks Eran, I'll check the solution. Regards, Raja -Original Message- From: "Eran Witkon" Sent: ‎12/‎24/‎2015 4:07 PM To: "Bharathi Raja" ; "Gokula Krishnan D" Cc: "user@spark.apache.org" Subject: Re: How to Parse & flatten J

Re: How to Parse & flatten JSON object in a text file using Spark &Scala into Dataframe

2015-12-24 Thread Eran Witkon
an D >> Sent: ‎12/‎24/‎2015 2:44 AM >> To: Eran Witkon >> Cc: raja kbv ; user@spark.apache.org >> >> Subject: Re: How to Parse & flatten JSON object in a text file using >> Spark &Scala into Dataframe >> >> You can try this .. But slightly modifi

RE: How to Parse & flatten JSON object in a text file using Spark &Scala into Dataframe

2015-12-23 Thread Bharathi Raja
k.apache.org" Subject: Re: How to Parse & flatten JSON object in a text file using Spark &Scala into Dataframe You can try this .. But slightly modified the input structure since first two columns were not in Json format. Thanks & Regards, Gokula Krishnan (Gokul) On We

RE: How to Parse & flatten JSON object in a text file using Spark &Scala into Dataframe

2015-12-23 Thread Bharathi Raja
Hi Eran, I didn't get the solution yet. Thanks, Raja -Original Message- From: "Eran Witkon" Sent: ‎12/‎23/‎2015 8:17 PM To: "raja kbv" ; "user@spark.apache.org" Subject: Re: How to Parse & flatten JSON object in a text file using Spark &S

Re: How to Parse & flatten JSON object in a text file using Spark & Scala into Dataframe

2015-12-23 Thread Gokula Krishnan D
You can try this .. But slightly modified the input structure since first two columns were not in Json format. [image: Inline image 1] Thanks & Regards, Gokula Krishnan* (Gokul)* On Wed, Dec 23, 2015 at 9:46 AM, Eran Witkon wrote: > Did you get a solution for this? > > On Tue, 22 Dec 2015 at

Re: How to Parse & flatten JSON object in a text file using Spark & Scala into Dataframe

2015-12-23 Thread Eran Witkon
Did you get a solution for this? On Tue, 22 Dec 2015 at 20:24 raja kbv wrote: > Hi, > > I am new to spark. > > I have a text file with below structure. > > > (employeeID: Int, Name: String, ProjectDetails: JsonObject{[{ProjectName, > Description, Duriation, Role}]}) > Eg: > (123456, Employee1, {“

How to Parse & flatten JSON object in a text file using Spark & Scala into Dataframe

2015-12-22 Thread raja kbv
Hi, I am new to spark. I have a text filewith below structure.  (employeeID: Int, Name: String, ProjectDetails:JsonObject{[{ProjectName, Description, Duriation, Role}]})Eg:(123456, Employee1, {“ProjectDetails”:[     {“ProjectName”: “Web Develoe

How to Parse & flatten JSON object in a text file using Spark & Scala into Dataframe

2015-12-22 Thread raja kbv
Hi, I am new to Spark. I have a text filewith below structure.  (employeeID: Int, Name: String, ProjectDetails:JsonObject{[{ProjectName, Description, Duriation, Role}]})Eg:(123456, Employee1, {“ProjectDetails”:[     {“ProjectName”: “Web Develo