At what stage does Dataflow/Apache Beam ack a pub/sub message?

前端 未结 1 1076
北恋
北恋 2021-01-13 16:56

I have a dataflow streaming job with Pub/Sub subscription as an unbounded source. I want to know at what stage does dataflow acks the incoming pub/sub message. It appears to

1条回答
  •  走了就别回头了
    2021-01-13 17:28

    The Dataflow Streaming Runner acks pubsub messages received by a bundle after the bundle has succeeded and results of the bundle (outputs and state mutations etc) have been durably committed. Failed bundles are retried until they succeed, and don't cause data loss. If you believe that data loss may be happening, please include details (job id and your reasoning that lead you to conclude that data has been dropped because of the failures) and we'll investigate.

    0 讨论(0)
提交回复
热议问题