park.sql.DataFrame
>
> (path: String)org.apache.spark.sql.DataFrame
>
> cannot be applied to (org.apache.spark.sql.ColumnName)
>
> val xmlDF_flattened =
> xmlDF.withColumn("xmlcomment",explode(sqlContext.read.format("com.databricks.spark.xml").opt
Thanks so much Zhang. This definitely helps.
From: Yong Zhang [mailto:java8...@hotmail.com]
Sent: Thursday, June 29, 2017 4:59 PM
To: Talap, Amol; Judit Planas; user@spark.apache.org
Subject: Re: SparkSQL to read XML Blob data to create multiple rows
scala>spark.version
res6: String = 2.
+---++
|Description_1.1|Title1.1|
|Description_1.2|Title1.2|
|Description_1.3|Title1.3|
+---++
From: Talap, Amol
Sent: Thursday, June 29, 2017 9:38 AM
To: Judit Planas; user@spark.apache.org
Subject: RE: SparkSQL to read XML Blo
nt, Corets, Eva
Regards,
Amol
*From:*Judit Planas [mailto:judit.pla...@epfl.ch]
*Sent:* Thursday, June 29, 2017 3:46 AM
*To:* user@spark.apache.org
*Subject:* Re: SparkSQL to read XML Blob data to create multiple rows
Hi Amol,
Not sure I understand completely your question, but the SQL fun
: Judit Planas [mailto:judit.pla...@epfl.ch]
Sent: Thursday, June 29, 2017 3:46 AM
To: user@spark.apache.org
Subject: Re: SparkSQL to read XML Blob data to create multiple rows
Hi Amol,
Not sure I understand completely your question, but the SQL function "explode"
may help you:
http://s
Hi Amol,
Not sure I understand completely your question, but the SQL function
"explode" may help you:
http://spark.apache.org/docs/latest/api/python/pyspark.sql.html#pyspark.sql.functions.explode
Here you can find a nice example:
https://stackoverflow.com/questions/38210507/explode-in-pyspark
Hi
Not sure if I follow your issue. Can you please post output of
books_inexp.show()?
On Thu, Jun 29, 2017 at 2:30 PM, Talap, Amol
wrote:
> Hi:
>
>
>
> We are trying to parse XML data to get below output from given input
> sample.
>
> Can someone suggest a way to pass one DFrames output into lo
