Hello Team,
I was working with Spark 3.2 and Hadoop 2.7.6 and writing to MinIO object
storage . It was slower when compared to write to MapR FS with above tech
stack. Then moved on to later upgraded version of Spark 3.5.2 and Hadoop 4.3.1
which started writing to MinIO with V2 fileoutputcommitter and check ed the
performance which is worse than old tech stack. Then tried using magic
committer and it came out slower than V2 so with the latest tech stack the
performance is down graded. Could some please assist .
Sent from my iPhone
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
