You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When the task recovery from the cluster failure, the maxTS is initialized with Long.MinValue and the task manager will call getCurrentWatermark method which will - 60 * 1000 and make the maxTS to 9223372036854715808. This invalid ts will block the stream work with the web Dashboard all green but actually they will never push the watermark forward. I know this is just a example but maybe a little warning about this example's job recovery behiver will make the reader less frustrated with their code?
The text was updated successfully, but these errors were encountered:
dispensable
changed the title
Chapter 6 example 6-3
Chapter 6 example 6-3 watermark ts will overflow when job recovery from failure
Jul 17, 2020
examples-scala/src/main/scala/io/github/streamingwithflink/chapter6/WatermarkGeneration.scala
Lines 45 to 62 in c188681
When the task recovery from the cluster failure, the
maxTS
is initialized withLong.MinValue
and the task manager will callgetCurrentWatermark
method which will- 60 * 1000
and make the maxTS to9223372036854715808
. This invalid ts will block the stream work with the web Dashboard all green but actually they will never push the watermark forward. I know this is just a example but maybe a little warning about this example's job recovery behiver will make the reader less frustrated with their code?The text was updated successfully, but these errors were encountered: