wanglijie95 commented on a change in pull request #18757: URL: https://github.com/apache/flink/pull/18757#discussion_r809738524
########## File path: docs/content/docs/deployment/elastic_scaling.md ########## @@ -151,5 +151,45 @@ The behavior of Adaptive Scheduler is configured by [all configuration options c - **Unused slots**: If the max parallelism for slot sharing groups is not equal, slots offered to Adaptive Scheduler might be unused. - Scaling events trigger job and task restarts, which will increase the number of Task attempts. +## Adaptive Batch Scheduler + +The Adaptive Batch Scheduler can automatically decide parallelisms of operators for batch jobs. If an operator is not set with a parallelism, the scheduler will decide parallelism for it according to the size of its consumed datasets. This can bring many benefits: +- Batch job users can be relieved from parallelism tuning +- Automatically tuned parallelisms can better fit consumed datasets which have a varying volume size every day +- Operators from SQL batch jobs can be assigned with different parallelisms which are automatically tuned + +### Usage + +To automatically decide parallelisms for operators with Adaptive Batch Scheduler, you need to: +- Configure to use Adaptive Batch Scheduler. +- Set the parallelism of operators to `-1`. + +#### Configure to use Adaptive Batch Scheduler +To use Adaptive Batch Scheduler, you need to: +- Set the [`jobmanager.scheduler`]({{< ref "docs/deployment/config" >}}#jobmanager-scheduler) to `AdaptiveBatch` +- Set the [`execution.batch-shuffle-mode`]({{< ref "docs/deployment/config" >}}#execution-batch-shuffle-mode) to `ALL-EXCHANGES-BLOCKING`(default value) due to ["ALL-EXCHANGES-BLOCKING jobs only"](#Limitations). Review comment: > Maybe use the anchor to the subsection`#all-exchanges-blocking-jobs-only`? `#all-exchanges-blocking-jobs-only` is not title, so can't link. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org