Optimize checkpointing in your Amazon Managed Service for Apache Flink applications with buffer debloating and unaligned checkpoints – Part 2
AWS Big Data
SEPTEMBER 14, 2023
We’ve already discussed how checkpoints, when triggered by the job manager, signal all source operators to snapshot their state, which is then broadcasted as a special record called a checkpoint barrier. Then it broadcasts the barrier downstream. However, it continues to process partitions that are behind the barrier.
Let's personalize your content