Hi Lina,
Unfortunately I don't have specific answers to Q1. For Q2 and Q3 we've been in
a similar situation and detailing our approach might be helpful. We're using
the Go SDK and are streaming, but it should still be equally applicable.
We have so far ended up with a custom transform that uses
Hi,
I've have this simple pipeline to test the kafka IO. It reads from kafka
and log it.
```
(
pipeline
| ReadFromKafka(
consumer_config={
"bootstrap.servers": bootstrap_servers,
"security.protocol": "SASL_SSL",