Re: OrcFile writing failing with multiple threads

2013-06-11 Thread Andrew Psaltis
ley mailto:omal...@apache.org>> Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Date: Friday, May 24, 2013 2:15 PM To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Su

Re: OrcFile writing failing with multiple threads

2013-06-11 Thread Owen O'Malley
ow(); > } > > Am I missing something here about the synchronized(this) ? Perhaps I am > looking in the wrong place. > > Thanks, > agp > > > From: Owen O'Malley > Reply-To: "user@hive.apache.org" > Date: Friday, May 24, 2013 2:15 PM > T

Re: OrcFile writing failing with multiple threads

2013-05-24 Thread Andrew Psaltis
o:user@hive.apache.org>" mailto:user@hive.apache.org>> Date: Friday, May 24, 2013 2:15 PM To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Subject: Re: OrcFile writing failing with multiple threads Currently, ORC writers, like t

Re: OrcFile writing failing with multiple threads

2013-05-24 Thread Owen O'Malley
Currently, ORC writers, like the Java collections API don't lock themselves. You should synchronize on the writer before adding a row. I'm open to making the writers synchronized. -- Owen On Fri, May 24, 2013 at 11:39 AM, Andrew Psaltis < andrew.psal...@webtrends.com> wrote: > All, > I have a

OrcFile writing failing with multiple threads

2013-05-24 Thread Andrew Psaltis
All, I have a test application that is attempting to add rows to an OrcFile from multiple threads, however, every time I do I get exceptions with stack traces like the following: java.lang.IndexOutOfBoundsException: Index 4 is outside of 0..5 at org.apache.hadoop.hive.ql.io.orc.DynamicIntArray.g