By doing so, I got the following error :
Exception in thread "main" org.apache.spark.sql.AnalysisException: GetField
is not valid on fields
Seems that it doesn't like image.data expression.
On Wed, Feb 25, 2015 at 12:37 AM, Xiangrui Meng <men...@gmail.com> wrote:
> Btw, the correct syntax for alias should be
> `df.select($"image.data".as("features"))`.
>
> On Tue, Feb 24, 2015 at 3:35 PM, Xiangrui Meng <men...@gmail.com> wrote:
> > If you make `Image` a case class, then select("image.data") should work.
> >
> > On Tue, Feb 24, 2015 at 3:06 PM, Jaonary Rabarisoa <jaon...@gmail.com>
> wrote:
> >> Hi all,
> >>
> >> I have a DataFrame that contains a user defined type. The type is an
> image
> >> with the following attribute
> >>
> >> class Image(w: Int, h: Int, data: Vector)
> >>
> >> In my DataFrame, images are stored in column named "image" that
> corresponds
> >> to the following case class
> >>
> >> case class LabeledImage(label: Int, image: Image)
> >>
> >> How can I select image.data attribute of my image object and view it as
> a
> >> column of a DataFrame ?
> >>
> >> I'd like to do something like
> >>
> >> val featureDF = imagesDF.select("image.data").as("features")
> >>
> >>
> >> Cheers,
> >>
> >> Jao
>
