This is what HCatalog and Pig's HCatStorage is for, to access data from Hive from Pig. Unfortunately you are running CDH, which doesn't support the Apache HCatalog project. HDP includes Apache HCatalog: http://hortonworks.com/hdp/hdp-hcatalog-metadata-services/ More info on Apache HCatalog is available here: http://www.infoq.com/articles/HadoopMetadata
However, there is an RCFile loader in Piggybank: http://svn.apache.org/viewvc/pig/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/HiveColumnarLoader.java?view=markup Russell Jurney http://datasyndrome.com On Dec 18, 2012, at 2:39 PM, abhishek <[email protected]> wrote: > Hi all, > > I have a use case which is implemented in hive with partitions. > > Say > Customer_data/2012-12-18/.... > /2012-12-17/.... > /2012-12-16/.... > / > / > > I want implement this in pig. > > How will partitions work in pig? > > Regards > Abhishek
