RE: SequenceFile and object reuse

2015-11-19 Thread andrew.rowson
ng Cc: dev@spark.apache.org Subject: RE: SequenceFile and object reuse You're not seeing the issue because you perform one additional "map". map{case (k,v) => (k.get(), v.toString)} Instead of being able to use the read Text you had to create a tuple (single) out of the string of

RE: SequenceFile and object reuse

2015-11-18 Thread jeff saremi
You're not seeing the issue because you perform one additional "map". map{case (k,v) => (k.get(), v.toString)}Instead of being able to use the read Text you had to create a tuple (single) out of the string of the text. That is exactly why I asked this question.Why do we have t do this additional