Re: HiveHistoryViewer concurrency problem

2013-01-04 Thread Qiang Wang
Maybe it's not. But this exception happens when I create an *HiveHistoryViewer* instance, in which case only reading, parsing file is invloved and it's not intended to be shared between threads. So the exception surprised me and I wonder why a static buffer was used instead of a local buffer whic

Re: HiveHistoryViewer concurrency problem

2013-01-04 Thread Qiang Wang
Hi Jie: As I know, hive history log is structured and class *HiveHistory* is used to write and read hive history log. *HiveHistoryViewer* serves as a listener to listen and store parsed log data. It has two members: HashMap *jobInfoMap*, which stores QueryInfo related with hive query and HashM

Re: HiveHistoryViewer concurrency problem

2013-01-04 Thread Edward Capriolo
It is likely an oversight. The Majority of hive code was not written to be multi-threaded. On Fri, Jan 4, 2013 at 10:41 PM, Jie Li wrote: > Hi Qiang, > > Could you describe how HiveHistoryViewer is used? I'm also looking for > a tool to understand the Hive log. > > Thanks, > Jie > > On Sat, Jan

Re: HiveHistoryViewer concurrency problem

2013-01-04 Thread Jie Li
Hi Qiang, Could you describe how HiveHistoryViewer is used? I'm also looking for a tool to understand the Hive log. Thanks, Jie On Sat, Jan 5, 2013 at 9:54 AM, Qiang Wang wrote: > Does Anybody have an idea about this? > > https://issues.apache.org/jira/browse/HIVE-3857 > > > 2013/1/4 Qiang Wang

Re: HiveHistoryViewer concurrency problem

2013-01-04 Thread Qiang Wang
Does Anybody have an idea about this? https://issues.apache.org/jira/browse/HIVE-3857 2013/1/4 Qiang Wang > new HiveHistoryViewer() throws ConcurrentModificationException when called > concurrently by several threads. > > According to the stack trace, HiveHistory.parseLine use *private static