Adaptive Batch Scheduler: Automatically Decide Parallelism of Flink Batch Jobs

Deciding proper parallelisms of operators is not an easy work for many users. For batch jobs, a small parallelism may result in long execution time and big failover regression. While an unnecessary large parallelism may result in resource waste and more overhead cost in task deployment and network shuffling.

View 66 Technology lddgo Shared on 2022-09-13