Re: CDH3 U1 Hive Job-commit very slow

2011-08-11 Thread air
cleus.store.rdbms.RDBMSStoreManager$ClassAdder.performTablesValidation(RDBMSStoreManager.java:2702) > at > org.datanucleus.store.rdbms.RDBMSStoreManager$ClassAdder.addClassTablesAndValidate(RDBMSStoreManager.java:2503) > at > org.datanucleus.store.rdbms.RDBMSStoreManager$ClassA

Re: CDH3 U1 Hive Job-commit very slow

2011-08-10 Thread air
; proportional to number of partitions. > > > > There is a patch I submitted recently as an attempt to alleviate this > problem: > > > > https://issues.apache.org/jira/browse/HIVE-2299 > > > > If that is not the case, even I would be

RE: CDH3 U1 Hive Job-commit very slow

2011-08-10 Thread Aggarwal, Vaibhav
] Sent: Wednesday, August 10, 2011 3:40 AM To: user@hive.apache.org Subject: Re: CDH3 U1 Hive Job-commit very slow there is only 10186 partitions in the metadata store (select count(1) from PARTITIONS; in mysql), I think it is not the problem. 2011/8/10 Aggarwal, Vaibhav mailto:vagg...@amazon.com

Re: CDH3 U1 Hive Job-commit very slow

2011-08-10 Thread air
e interested in root cause of large > query startup time. > > ** ** > > *From:* air [mailto:cnwe...@gmail.com] > *Sent:* Tuesday, August 09, 2011 1:19 AM > *To:* user@hive.apache.org > *Subject:* Fwd: CDH3 U1 Hive Job-commit very slow > > ** ** > > ** *

RE: CDH3 U1 Hive Job-commit very slow

2011-08-09 Thread Steven Wong
You can tail the Hive log and see what it is doing at the time. From: air [mailto:cnwe...@gmail.com] Sent: Tuesday, August 09, 2011 1:19 AM To: user@hive.apache.org Subject: Fwd: CDH3 U1 Hive Job-commit very slow -- Forwarded message -- From: air mailto:cnwe...@gmail.com>>

RE: CDH3 U1 Hive Job-commit very slow

2011-08-09 Thread Aggarwal, Vaibhav
the case, even I would be interested in root cause of large query startup time. From: air [mailto:cnwe...@gmail.com] Sent: Tuesday, August 09, 2011 1:19 AM To: user@hive.apache.org Subject: Fwd: CDH3 U1 Hive Job-commit very slow -- Forwarded message -- From: air mailto:cnwe

Fwd: CDH3 U1 Hive Job-commit very slow

2011-08-09 Thread air
-- Forwarded message -- From: air Date: 2011/8/9 Subject: CDH3 U1 Hive Job-commit very slow To: CDH Users when I submit a ql to hive, it is a very long time until it really submit the job to the hadoop cluster, what may cause this problem ?* *thank you for your help.* hive