At present, there's no way to write an unbounded datasource with the Go
SDK, which would require DoFn Self Checkpointing (
https://issues.apache.org/jira/browse/BEAM-11104) and Watermark Estimation
(https://issues.apache.org/jira/browse/BEAM-11105).
Daniel is working on wrapping the Java kafka co
On Wed, Mar 24, 2021 at 4:24 AM Đức Trần Tiến
wrote:
>
> And the last question: Could I write that pipeline in Java and invoke that
> pipeline from Go? :D
>
That is exactly the story we're trying to pursue for getting the large set
of Java connectors available to Go:
https://cloud.google.com/bl
+Robert Burke any advice here?
On Wed, Mar 24, 2021 at 4:24 AM Đức Trần Tiến
wrote:
> Hi,
>
> I am very very new to Go and Apache Beam too! This is my situation:
> - I have a kafka running
> - I want to write an etl pipeline that consuming data from the kafka in Go
>
> Because there is no Kaf
Hi,
I am very very new to Go and Apache Beam too! This is my situation:
- I have a kafka running
- I want to write an etl pipeline that consuming data from the kafka in Go
Because there is no Kafka support in the Go SDK, only Java SDK. I had been
looking for a way to create an unbounded collect
