Are you doing a directory-based partition with Hive, or are you letting Hive's RCFile partition data for you?
Russell Jurney http://datasyndrome.com On Dec 18, 2012, at 4:12 PM, abhishek <[email protected]> wrote: > Hi Russell, > > Thanks for the reply.How RCFile loader is related to partitions? > > I did not get your point in this. > > Regards > Abhi > > Sent from my iPhone > > On Dec 18, 2012, at 6:13 PM, Russell Jurney <[email protected]> wrote: > >> This is what HCatalog and Pig's HCatStorage is for, to access data >> from Hive from Pig. Unfortunately you are running CDH, which doesn't >> support the Apache HCatalog project. HDP includes Apache HCatalog: >> http://hortonworks.com/hdp/hdp-hcatalog-metadata-services/ More info >> on Apache HCatalog is available here: >> http://www.infoq.com/articles/HadoopMetadata >> >> However, there is an RCFile loader in Piggybank: >> http://svn.apache.org/viewvc/pig/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/HiveColumnarLoader.java?view=markup >> >> Russell Jurney http://datasyndrome.com >> >> On Dec 18, 2012, at 2:39 PM, abhishek <[email protected]> wrote: >> >>> Hi all, >>> >>> I have a use case which is implemented in hive with partitions. >>> >>> Say >>> Customer_data/2012-12-18/.... >>> /2012-12-17/.... >>> /2012-12-16/.... >>> / >>> / >>> >>> I want implement this in pig. >>> >>> How will partitions work in pig? >>> >>> Regards >>> Abhishek
