Re: readCsvFile

2016-10-09 Thread Alberto Ramón
yes ¡ I didn't see this :( Thanks 2016-10-09 23:23 GMT+02:00 Fabian Hueske : > Shouldn't "val counts4 = text3" be "val counts4 = text4"? > > > 2016-10-09 23:14 GMT+02:00 Alberto Ramón : > >> I think The char delimited its OK >> (I attached CSV) >> >> val text4 = env.readCsvFile [Tuple1[String]

Re: readCsvFile

2016-10-09 Thread Fabian Hueske
Shouldn't "val counts4 = text3" be "val counts4 = text4"? 2016-10-09 23:14 GMT+02:00 Alberto Ramón : > I think The char delimited its OK > (I attached CSV) > > val text4 = env.readCsvFile [Tuple1[String]]("file://data.csv" > ,fieldDelimiter = "," > ,includedFields = Array(2)) > val counts4 =

Re: readCsvFile

2016-10-09 Thread Alberto Ramón
I think The char delimited its OK (I attached CSV) val text4 = env.readCsvFile [Tuple1[String]]("file://data.csv" ,fieldDelimiter = "," ,includedFields = Array(2)) val counts4 = text3 .map { (_, 1) } .groupBy(0) .sum(1) counts4.print() The result is: [image: Imágenes integradas 1] Can

Re: readCsvFile

2016-10-07 Thread Fabian Hueske
I would check that the field delimiter is correctly set. With the correct delimiter your code would give ((a),1) ((aa),1) because the single field is wrapped in a Tuple1. You have to unwrap it in the map function: .map { (_._1, 1) } 2016-10-07 18:08 GMT+02:00 Alberto Ramón : > Humm > > Your so

Re: readCsvFile

2016-10-07 Thread Alberto Ramón
Humm Your solution compile with out errors, but IncludedFields Isn't working: [image: Imágenes integradas 1] The output is incorrect: [image: Imágenes integradas 2] The correct result must be only 1º Column (a,1) (aa,1) 2016-10-06 21:37 GMT+02:00 Fabian Hueske : > Hi Alberto, > > if you want t

Re: readCsvFile

2016-10-06 Thread Fabian Hueske
Hi Alberto, if you want to read a single column you have to wrap it in a Tuple1: val text4 = env.readCsvFile[Tuple1[String]]("file:data.csv" ,includedFields = Array(1)) Best, Fabian 2016-10-06 20:59 GMT+02:00 Alberto Ramón : > I'm learning readCsvFile > (I discover if the file ends on "/n", yo