flatmap pair

2016-12-08 Thread im281
The class 'Detector' has a function 'detectFeature(cluster) However, the method has changed to return a list of features as opposed to one feature as it is below. How do I change this so it returns a list of feature objects instead // creates key-value pairs for Isotope cluster ID and Isotope c

Running spark from Eclipse and then Jar

2016-12-07 Thread im281
Hello, I have a simple word count example in Java and I can run this in Eclipse (code at the bottom) I then create a jar file from it and try to run it from the cmd java -jar C:\Users\Owner\Desktop\wordcount.jar Data/testfile.txt But I get this error? I think the main error is: *Exception in t

RDD flatmap to multiple key/value pairs

2016-12-02 Thread im281
Here is a MapReduce Example implemented in Java. It reads each line of text and for each word in the line of text determines if it starts with an upper case. If so, it creates a key value pair public class CountUppercaseMapper extends Mapper { @Override protected void map(LongWritable li

TallSkinnyQR

2016-11-07 Thread im281
I am getting the correct rows but they are out of order. Is this a bug or am I doing something wrong? public class CoordinateMatrixDemo { public static void main(String[] args) { //boiler plate needed to run locally SparkConf conf = new SparkConf().se

Re: mLIb solving linear regression with sparse inputs

2016-11-06 Thread im281
er example because that would give a trivial result. --- Robin East *Spark GraphX in Action* Michael Malak and Robin East Manning Publications Co. http://www.manning.com/books/spark-graphx-in-action On 3 Nov 2016, at 18:12, im281 [via Ap

Re: mLIb solving linear regression with sparse inputs

2016-11-06 Thread im281
e you give the b’s are exactly the same as col 2 > in the A matrix. I presume this is just a quick hacked together example > because that would give a trivial result. > > > --- > Robin East > *Spark GraphX in Action* Michael Malak and Robin Eas

Re: mLIb solving linear regression with sparse inputs

2016-11-06 Thread im281
--Robin EastSpark GraphX in Action Michael Malak and Robin EastManning Publications Co.http://www.manning.com/books/spark-graphx-in-action On 3 Nov 2016, at 18:12, im281 [via Apache Spark User List] <[hidden email]> wrote: I would like to use it. But how do I do