It will work like so: http://stackoverflow.com/questions/3515481/pig-latin-load-multiple-files-from-a-date-range-part-of-the-directory-structur
Russell Jurney http://datasyndrome.com On Dec 18, 2012, at 4:27 PM, abhishek <[email protected]> wrote: > Directory based partition in hive. > > Partition by date > > Thanks > Abhi > > Sent from my iPhone > > On Dec 18, 2012, at 7:20 PM, Russell Jurney <[email protected]> wrote: > >> Are you doing a directory-based partition with Hive, or are you >> letting Hive's RCFile partition data for you? >> >> Russell Jurney http://datasyndrome.com >> >> On Dec 18, 2012, at 4:12 PM, abhishek <[email protected]> wrote: >> >>> Hi Russell, >>> >>> Thanks for the reply.How RCFile loader is related to partitions? >>> >>> I did not get your point in this. >>> >>> Regards >>> Abhi >>> >>> Sent from my iPhone >>> >>> On Dec 18, 2012, at 6:13 PM, Russell Jurney <[email protected]> >>> wrote: >>> >>>> This is what HCatalog and Pig's HCatStorage is for, to access data >>>> from Hive from Pig. Unfortunately you are running CDH, which doesn't >>>> support the Apache HCatalog project. HDP includes Apache HCatalog: >>>> http://hortonworks.com/hdp/hdp-hcatalog-metadata-services/ More info >>>> on Apache HCatalog is available here: >>>> http://www.infoq.com/articles/HadoopMetadata >>>> >>>> However, there is an RCFile loader in Piggybank: >>>> http://svn.apache.org/viewvc/pig/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/HiveColumnarLoader.java?view=markup >>>> >>>> Russell Jurney http://datasyndrome.com >>>> >>>> On Dec 18, 2012, at 2:39 PM, abhishek <[email protected]> wrote: >>>> >>>>> Hi all, >>>>> >>>>> I have a use case which is implemented in hive with partitions. >>>>> >>>>> Say >>>>> Customer_data/2012-12-18/.... >>>>> /2012-12-17/.... >>>>> /2012-12-16/.... >>>>> / >>>>> / >>>>> >>>>> I want implement this in pig. >>>>> >>>>> How will partitions work in pig? >>>>> >>>>> Regards >>>>> Abhishek
