Re: Java: Return type of RDDFunctions.sliding(int, int)

2016-05-13 Thread Tom Godden
rg/docs/latest/api/scala/index.html#org.apache.spark.mllib.rdd.RDDFunctions > > An RDD of T produces an RDD of T[]. > > On Fri, May 13, 2016 at 12:10 PM, Tom Godden wrote: >> I assumed the "fixed size blocks" mentioned in the documentation >> (https://spark.apache.org/docs/1.6.

Re: Java: Return type of RDDFunctions.sliding(int, int)

2016-05-13 Thread Tom Godden
you're trying there. The return type is an RDD of > arrays, not of RDDs or of ArrayLists. There may be another catch but > that is not it. > > On Fri, May 13, 2016 at 11:50 AM, Tom Godden wrote: >> I believe it's an illegal cast. This is the line of code: >>> R

Re: Java: Return type of RDDFunctions.sliding(int, int)

2016-05-13 Thread Tom Godden
I believe it's an illegal cast. This is the line of code: > RDD>> windowed = > RDDFunctions.fromRDD(vals.rdd(), vals.classTag()).sliding(20, 1); with vals being a JavaRDD>. Explicitly casting doesn't work either: > RDD>> windowed = (RDD>>) > RDDFunctions.fromRDD(vals.rdd(), vals.classTag()).slidin