Hello Spark Dev/users,Any one has any clue why and how a better version have performance issue .I will be happy to raise JIRA .Sent from my iPhoneOn Mar 24, 2025, at 4:20 PM, Prem Sahoo wrote:The problem is on the writer's side. It takes longer to write to Minio with Spark 3.5.2 and Hadoop 3.4.1
If you've never used network motifs to explore and evaluate a graph or
relational dataset, there is a new tutorial out for GraphFrames that
demonstrates the process thoroughly:
https://graphframes.github.io/graphframes/docs/_site/motif-tutorial.html
Thanks,
Russell Jurney | rjur...@graphlet.ai |
The problem is on the writer's side. It takes longer to write to Minio with
Spark 3.5.2 and Hadoop 3.4.1 . so it seems there are some tech changes
between hadoop 2.7.6 to 3.4.1 which made the write process faster.
On Sun, Mar 23, 2025 at 12:09 AM Ángel Álvarez Pascua <
angel.alvarez.pas...@gmail.c
