Thank you all for your congratulations!
Max Gekk
On Tue, Mar 30, 2021 at 2:29 PM Jacek Laskowski wrote:
> Hi,
>
> Congrats to all of you committers! Wishing you all the best (commits)!
>
> Pozdrawiam,
> Jacek Laskowski
>
> https://about.me/JacekLaskowski
> "The Internals Of" Online Books <
Hi!
have you tried spark.sql.files.maxRecordsPerFile ?
As a workaround you could try to see how many rows are 128MB and then set
that number in that property.
Best
On Thu, 1 Apr 2021 at 00:38, mhawes wrote:
> Okay from looking closer at some of the code, I'm not sure that what I'm
> asking f
