you may need a large cluster memory and fast disk IO.
Sachit Murarka wrote:
Can anyone please suggest if there is any property to improve the parallel reads? I am reading more than 25000 files .
-- Simple Mail https://simplemail.co.in/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org