Re: Predicate pushdown optimisation not working for ORC

2014-04-03 Thread Abhay Bansal
7;t have to spend alot time searching for that. Interesting that > the default isn't true for this one. > > > On Wed, Apr 2, 2014 at 11:00 PM, Abhay Bansal > wrote: > >> I was able to resolve the issue by setting "hive.optimize.index.filter" >> to true. &g

Re: Predicate pushdown optimisation not working for ORC

2014-04-03 Thread Abhay Bansal
ted only by running hive query on staging > table and inserting into ORC table. If there is option to generate ORC file > at client side by using java code then can you share that code or links > related to that? > > Thanks, > > Chandra > > > > *From:* Abhay Bansa

Re: Predicate pushdown optimisation not working for ORC

2014-04-02 Thread Abhay Bansal
3, 2014 at 11:14 AM, Stephen Boesch wrote: > HI Abhay, > What is the DDL for your "test" table? > > > 2014-04-02 22:36 GMT-07:00 Abhay Bansal : > > I am new to Hive, apologise for asking such a basic question. >> >> Following exercise was done with hi

Predicate pushdown optimisation not working for ORC

2014-04-02 Thread Abhay Bansal
I am new to Hive, apologise for asking such a basic question. Following exercise was done with hive .12 and hadoop 0.20.203 I created a ORC file form java, and pushed it into a table with the same schema. I checked the conf property hive.optimize.ppdtrue which should ideally use the ppd optimisat