How does Flink decide when to take a checkpoint?

扶醉桌前 提交于 2020-03-23 08:22:13

问题


I'd like to understand what determines when checkpoints are taken. How does this relate to the checkpointing interval?


回答1:


To a first approximation, the Checkpoint Coordinator (part of the Job Manager) uses the checkpoint interval to determine when to start a new checkpoint. This interval is passed when you enable checkpointing, e.g., here is it set wait for 10 seconds between checkpoints:

env.enableCheckpointing(10000L);

or it can also be set via execution.checkpointing.interval.

However, the Checkpoint Coordinator will wait however long is necessary to avoid violating either the setting for execution.checkpointing.max-concurrent-checkpoints or for execution.checkpointing.min-pause (which defines how much time must elapse between the completion of one checkpoint and the start of the next one).



来源:https://stackoverflow.com/questions/60671954/how-does-flink-decide-when-to-take-a-checkpoint

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!