Re: Creating RDD with key and Subkey

2015-08-19 Thread Ranjana Rajendran
tructure and then do lookup on subkey which is the key in the > HashMap returned > > > > _________ > From: Silas Davis > Sent: Wednesday, August 19, 2015 10:34 pm > Subject: Re: Creating RDD with key and Subkey > To: Ratika Prasad , > > > > This should be sent to the user mailing li

Re: Creating RDD with key and Subkey

2015-08-19 Thread Ratika Prasad
davis.net>> Sent: Wednesday, August 19, 2015 10:34 pm Subject: Re: Creating RDD with key and Subkey To: Ratika Prasad mailto:rpra...@couponsinc.com>>, mailto:dev@spark.apache.org>> This should be sent to the user mailing list, I think. It depends what you want to do with the

Re: Creating RDD with key and Subkey

2015-08-19 Thread Silas Davis
This should be sent to the user mailing list, I think. It depends what you want to do with the RDD, so yes you could throw around (String, HashMap>) tuples or perhaps you'd like to be able to groupByKey, reduceByKey on the key and sub-key as a composite in which case JavaPairRDD, List> might be mo

Creating RDD with key and Subkey

2015-08-19 Thread Ratika Prasad
Hi, We have a need where we need the RDD with the following format JavaPairRDD>>, mostly RDD with a Key and Subkey kind of a structure, how is that doable in Spark ? Thanks R