Ah I got it - Seq[(Int, Float)] is actually represented as Seq[Row] (seq of
struct type) internally.
So a further extraction is required, e.g. row => row.getSeq[Row](1).map { r
=> r.getInt(0) }
On Wed, 6 Apr 2016 at 13:35 Nick Pentreath wrote:
> Hi there,
>
> In writing some tests for a PR I'm
Hi there,
In writing some tests for a PR I'm working on, with a more complex array
type in a DF, I ran into this issue (running off latest master).
Any thoughts?
*// create DF with a column of Array[(Int, Double)]*
val df = sc.parallelize(Seq(
(0, Array((1, 6.0), (1, 4.0))),
(1, Array((1, 3.0),