Re: Big Lock in Driver.compileInternal

2015-05-28 Thread Loudongfeng
Glad to know it. I have tested it yesterday on a 7 nodes cluster, with 100 concurrent clients running for about 8 hours and haven't seen any issue. The workload is TPC-H style with both DDLs and queries. The 100 clients use different tables from each other and use different sessions. My Hive vers

Re: Big Lock in Driver.compileInternal

2015-05-27 Thread Sergey Shelukhin
Hi. As luck would have it, we are currently looking at this issue :) I have a small patch up at https://issues.apache.org/jira/browse/HIVE-4239; I tested it a bit w/a unit test and some manual cluster testing. Would you be willing to test it on your setup? On 15/5/25, 20:54, "Loudongfeng" wrote:

Big Lock in Driver.compileInternal

2015-05-25 Thread Loudongfeng
Hi, All I notice that there is a big lock in org.apache.hadoop.hive.ql.Driver Following is a piece of code from Apache Hive 1.2.0 private static final Object compileMonitor = new Object(); private int compileInternal(String command) { int ret; synchronized (compileMonitor) { ret = compil