"Can normal hardware benifit from this RDMA optimization? 100G network is
very expensive and I think only a few Spark clusters are running on it."
Hi Wenchen,
Yes, also RDMA supported network adapters with lower speeds - as low as 10G
will show improvement in transfer time.
Actually, in most cases
hi
We have integrated spark with yarn cluster.
To test for long running cluster, we ran below script to launch application,
an example programme as given at bottom.
#Script which runs example infinitely
/while true
do
echo "start $times"
/opt/ficlient/Spark/spark/bin/spark-submit --class
com.examp
