Re: Intermittent ArrayIndexOutOfBoundsException on Hive Merge

2020-07-15 Thread Bernard Quizon
; > > > Thanks, > > Aaron > > > > > > *From:* Bernard Quizon > *Sent:* Tuesday, July 14, 2020 9:57 AM > *To:* user@hive.apache.org > *Subject:* Re: Intermittent ArrayIndexOutOfBoundsException on Hive Merge > > > > Hi. >

RE: Intermittent ArrayIndexOutOfBoundsException on Hive Merge

2020-07-14 Thread Aaron Grubb
Sent: Tuesday, July 14, 2020 9:57 AM To: user@hive.apache.org Subject: Re: Intermittent ArrayIndexOutOfBoundsException on Hive Merge Hi. I see that this piece of code is the source of the error: final int maxSize = (vectorizedTestingReducerBatchSize > 0 ? Math.

Re: Intermittent ArrayIndexOutOfBoundsException on Hive Merge

2020-07-14 Thread Bernard Quizon
Hi. I see that this piece of code is the source of the error: final int maxSize = (vectorizedTestingReducerBatchSize > 0 ? Math.min(vectorizedTestingReducerBatchSize, batch.getMaxSize()) : batch.getMaxSize()); Preconditions.checkState(maxSize > 0); int rowIdx = 0; int batchByt