Hello. I found a similar example code.
You can use `Wait` PTransform.
https://beam.apache.org/releases/javadoc/2.13.0/org/apache/beam/sdk/transforms/Wait.html

Hope this helps.

https://github.com/Jimmyst/stateful-beam-realtime/blob/2cc16a9cf8460c5b0e4d749e81654273c14ffb00/pipeline/src/main/java/org/stjimmy/beam/LtvPipelineSqlLookup.java#L92
stateful-beam-realtime/pipeline/src/main/java/org/stjimmy/beam/LtvPipelineSqlLookup.java
 at 2cc16a9cf8460c5b0e4d749e81654273c14ffb00 · Jimmyst/stateful-beam-realtime
github.com


> 2024. 8. 1. 오전 11:52, Jaehyeon Kim <[email protected]> 작성:
> 
> Hello,
> 
> I'm looking into side input patterns especially slowly updating global window 
> side inputs - https://beam.apache.org/documentation/patterns/side-inputs/
> 
> It'd be useful if we need to enrich eg) order records with customer details 
> where customer details would be taken as a side input.
> 
> Let's say we have two Kafka topics, one for client records and the other for 
> order records. For the enrichment to work properly, consumption of order 
> records should wait until all customer records are read.
> 
> Can you please inform me if it is achievable?
> 
> Cheers,
> Jaehyeon

Reply via email to