@ravin...@dremio.com @prav...@dremio.com
thoughts?
On Tue, Jul 28, 2020 at 3:39 PM Wes McKinney wrote:
> Perhaps Gandiva does not handle sliced arrays properly? This would be
> worth investigating
>
> On Mon, Jul 27, 2020 at 7:43 PM Matt Youill
> wrote:
> >
> > Managed to track down the issue
Perhaps Gandiva does not handle sliced arrays properly? This would be
worth investigating
On Mon, Jul 27, 2020 at 7:43 PM Matt Youill wrote:
>
> Managed to track down the issue (sort of).
>
> I removed a call to set_chunksize on TableBatchReader where the chunk
> size was less than the number of
Managed to track down the issue (sort of).
I removed a call to set_chunksize on TableBatchReader where the chunk
size was less than the number of rows in a table being read. Runs fine
now (tested with 100s threads over mils of rows).
Strangely, Gandiva fails if I don't call set_chunksize for
Crashing when running from multiple threads doesn't sound right,
perhaps there are some missing synchronizations in internal data
structures. Could you open a JIRA issue and show the backtraces of any
crashes or other clues about how to reproduce the issues?
On Sun, Jul 26, 2020 at 8:12 PM Matt Yo
