Re: KafkaIO write in case on topic name present in PCollection

Hi Mohil, In Java SDK you can use “KafkaIO.writeRecords()” for that. So, you will need to provide a PCollection> as an input collection where you set a desired output topic for every record inside ProducerRecord metadata. It could look something like this: PCollection> teams = ...; PCollectio

Re: Need suggestion/help for use case (usage of the side input pattern and sliding window)

Using side inputs is fine and is a common pattern. You should take a look at "slowly changing side inputs"[1] as there is some example code there. 1: https://beam.apache.org/documentation/patterns/side-inputs/#slowly-updating-side-input-using-windowing On Mon, Jun 1, 2020 at 8:27 PM Mohil Khare

Beam First Steps Workshop - 9 June

Hi Beam Users, Wanted to share the Workshop that I'll give at Berlin Buzzword's next week: https://berlinbuzzwords.de/session/first-steps-apache-beam-writing-portable-pipelines-using-java-python-go Do consider joining if you are able and interested (if you're here and already using, then the wor

New Addition to the Katas Family: Kotlin

Hi all, You may remember an e-mail across the mailing lists a few weeks back that informed everyone of the wonderful Beam Katas available on Stepik for learning more about writing Beam applications, working with its various APIs, all from the comfort of your favorite IDEs.

Re: KafkaIO write in case on topic name present in PCollection

Hey Alexey, Thanks a lot for your quick response. This worked for me :). Awesome. Regards Mohil On Tue, Jun 2, 2020 at 6:31 AM Alexey Romanenko wrote: > Hi Mohil, > > In Java SDK you can use “KafkaIO.writeRecords()” for that. So, you will > need to provide a PCollection> as an input collectio

Re: New Addition to the Katas Family: Kotlin

Finally the Kotlin Katas course is now live 🙌 Thanks for your contribution and submission Rion! On Wed, Jun 3, 2020 at 5:20 AM Rion Williams wrote: > Hi all, > > You may remember an e-mail across the mailing lists a few weeks back that > informed everyone of the wonderful Beam Katas available