here to look for how data types are evaluated and
serialized/deserialized would be super helpful as well.
Thanks
On Thu, May 28, 2015 at 12:30 AM Reynold Xin wrote:
> I think it is fairly hard to support recursive data types. What I've seen
> in one other proprietary system in the pas
emy:
>
> Row is a collect of 'Any'. So, you can be used as a recursive data type.
> Is this what you were looking for?
>
> Example:
> val x = sc.parallelize(Array.range(0,10)).map(x => Row(Row(x),
> Row(x.toString)))
>
> Rakesh
>
>
>
> On Wed, May 20, 20
Spark SQL has proven to be quite useful in applying a partial schema to
large JSON logs and being able to write plain SQL to perform a wide variety
of operations over this data. However, one small thing that keeps coming
back to haunt me is the lack of support for recursive data types, whereby a
me
