Hello Beam Community, We are using a streaming Dataflow job writing to Google Pub Sub through PubsubIO.Write. Does anybody know how we can log IDs which Pub Sub assigns to messages? We need that to localize where messages might be lost. Case 1. A Pub Sub topic is used as an interface between two projects. We are working on the sending side and do not control the receiving side. When the job was deployed the first time, Pub Sub did not accept messages (because of a permission problem), the job got stuck, but we did not get any errors in Dataflow logs. Neither were we able to tell if the messages were accepted by Pub Sub. Case 2. We suspect some messages are lost while going end-to-end through our system, we do not know exactly where. We would like to know IDs of messages which were actually accepted by Pub Sub to trace missing messages.
Thank you, Andrei Litvinov
