Ariel,
set hive.optimize.s3.query=true seems to help. But I'm surprised, because
the information I can find online about that config suggests that it is
related to tables with a large number of partitions. I have a lot of files,
but only one partition. But it seems to help anyway.
Abdelrahman,
Tha
>From the archives:
http://mail-archives.apache.org/mod_mbox/hive-user/201110.mbox/%3CCAC9SPjuQtxOK1KtEmReD6OanNTgNM_uLkGQD+=n7krcjcal...@mail.gmail.com%3E
TL;DR set hive.optimize.s3.query=true;
-
Ariel Marcus, Consultant
www.openbi.com | ariel.mar...@openbi.com
15
Hi Marc,
You can try running the hive client with debug mode on and see what is
trying to do on the JT level.
hive -hiveconf hive.root.logger=ALL,console -e " DDL;"
hive -hiveconf hive.root.logger=ALL,console -f ddl.sql ;
Hope this helps .
Thanks
-Abdelrahman
On Wed, Jan 30, 2013 at 3:16 PM, M