Re: PubsubIO. How to log IDs of messages sent to Google Pub Sub.

2020-11-25 Thread Andrei Litvinov
That explains a lot. For example, why I was able to intercept calls to PubsubJsonClient by AspectJ locally but not in Dataflow. And why custom changes in the beam-sdks-java-io-google-cloud-platform artifact are ignored in Dataflow. Thank you, Boyuan Zhang! [image: Brandmark_small.jpg] Andrei L

Re: PubsubIO. How to log IDs of messages sent to Google Pub Sub.

2020-11-24 Thread Boyuan Zhang
Hi Andrei, Dataflow doesn't execute the pubsub write transform on the user worker but as an internal operation. In that way, it is not possible to log messages when pubsub write happens. But you can use --experiments=enable_custom_pubsub_sink to enforce the Dataflow to use the expansion