Re: delay before query starts processing

2013-02-01 Thread Marc Limotte
Ariel, set hive.optimize.s3.query=true seems to help. But I'm surprised, because the information I can find online about that config suggests that it is related to tables with a large number of partitions. I have a lot of files, but only one partition. But it seems to help anyway. Abdelrahman, Tha

Re: delay before query starts processing

2013-01-30 Thread Ariel Marcus
>From the archives: http://mail-archives.apache.org/mod_mbox/hive-user/201110.mbox/%3CCAC9SPjuQtxOK1KtEmReD6OanNTgNM_uLkGQD+=n7krcjcal...@mail.gmail.com%3E TL;DR set hive.optimize.s3.query=true; - Ariel Marcus, Consultant www.openbi.com | ariel.mar...@openbi.com 15

Re: delay before query starts processing

2013-01-30 Thread Abdelrahman Shettia
Hi Marc, You can try running the hive client with debug mode on and see what is trying to do on the JT level. hive -hiveconf hive.root.logger=ALL,console -e " DDL;" hive -hiveconf hive.root.logger=ALL,console -f ddl.sql ; Hope this helps . Thanks -Abdelrahman On Wed, Jan 30, 2013 at 3:16 PM, M