How to use Fair Scheduler Pools

sparkContext.setLocalProperty("spark.scheduler.pool", "pool2") rdd.foreachAsync(x => { println("2==start==" + new SimpleDateFormat("HH:mm:ss").format(new Date()))Thread.sleep(1) println("2==end==" + new SimpleDateFormat(

How to use Fair Scheduler Pools

leDateFormat("HH:mm:ss").format(new Date())) }) }).start() TimeUnit.MINUTES.sleep(2) sparkContext.stop() } } fairscheduler.xml FAIR 100 0 FAIR 1 0 input.txt aa bb | | 李杰 | | leedd1...@163.com |