Re: Reading too many files

you may need a large cluster memory and fast disk IO. Sachit Murarka wrote: Can anyone please suggest if there is any property to improve the parallel reads? I am reading more than 25000 files . -- Simple Mail https://simplemail.co.in/

Re: WARN ProcfsMetricsGetter: Exception

you should be able to check details from spark logs. Surya Gopisetty wrote: I am getting this warning I tried to solve this but not sure of the solution, -- Simple Mail https://simplemail.co.in/ - To unsubscribe e-mail: user-