How We Improved Scheduler Performance for Large-scale Jobs - Part Two
Source :
flink.apache.org
Author :
Zhilong Hong , Zhu Zhu , Daisy Tsang , & Till Rohr
Part one of this blog post briefly introduced the optimizations we’ve made to improve the performance of the scheduler; compared to Flink 1.12, the time cost and memory usage of scheduling large-scale jobs in Flink 1.14 is significantly reduced. In part two, we will elaborate on the details of these optimizations.