Re: Nested Query With Spark SQL(1.0.1)

2014-07-14 Thread anyweil
Yes, just as my last post, using [] to access array data and "." to access nested fields seems not work. BTW, i have deeped into the code of the current master branch. spark / sql / catalyst / src / main / scala / org / apache / spark / sql / catalyst / plans / logical / LogicalPlan.scala from l

Re: Nested Query With Spark SQL(1.0.1)

2014-07-14 Thread Michael Armbrust
In general this should be supported using [] to access array data and "." to access nested fields. Is there something you are trying that isn't working? On Mon, Jul 14, 2014 at 11:25 PM, anyweil wrote: > I mean the query on the nested data such as JSON, not the nested query, > sorry > for the

Re: Nested Query With Spark SQL(1.0.1)

2014-07-14 Thread anyweil
I mean the query on the nested data such as JSON, not the nested query, sorry for the misunderstanding. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Query-the-nested-JSON-data-With-Spark-SQL-1-0-1-tp9544p9726.html Sent from the Apache Spark User List mail

Re: Nested Query With Spark SQL(1.0.1)

2014-07-14 Thread Michael Armbrust
What sort of nested query are you talking about? Right now we only support nested queries in the FROM clause. I'd like to add support for other cases in the future. On Sun, Jul 13, 2014 at 4:11 AM, anyweil wrote: > Or is it supported? I know I could doing it myself with filter, but if SQL > c

Re: Nested Query With Spark SQL(1.0.1)

2014-07-13 Thread anyweil
Or is it supported? I know I could doing it myself with filter, but if SQL could support, would be much better, thx! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Nested-Query-With-Spark-SQL-1-0-1-tp9544p9547.html Sent from the Apache Spark User List mai