;
>
> https://en.everybodywiki.com/Mich_Talebzadeh
>
>
>
> *Disclaimer:* The information provided is correct to the best of my
> knowledge but of course cannot be guaranteed . It is essential to note
> that, as with any advice, quote "one test result is worth one-thousand
> e
On Thu, Dec 5, 2024 at 8:21 AM Matteo Moci wrote:
> Thanks a lot Mich,
> 1) you mean coalescing partitions that are about to write? I don't think
> this will take less time, because all partitions have data. It seems the
> problem is that it asks HMS all partitions, even if it&#
ec 5, 2024 at 8:17 AM Matteo Moci wrote:
> Thanks Mich,
> 1)
>
> On Thu, Dec 5, 2024 at 1:16 AM Mich Talebzadeh
> wrote:
>
>> Hi Matteo,
>>
>> 1) You have an incompatible Metastore: The Hive Metastore version used by
>> the EMR cluster (2.3.9) doesn't
t of my
> knowledge but of course cannot be guaranteed . It is essential to note
> that, as with any advice, quote "one test result is worth one-thousand
> expert opinions (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von
> Braun <https://en.wikipedia.org/wiki/Wer
Hello Community,
The Spark 3.5 application I am working on shows slowness, right at the time
of writing to a Hive table.
I'd like to ask you some hints on how to mitigate this behaviour, if
possible.
The same application using Spark 2.4 ran "fine" within reasonable times,
with minimal cluster idl
