Re: [Question] How to best handle load to Bigtable from Beam (Python)

2022-09-30 Thread Hannes Gustafsson
Hi Lina, Unfortunately I don't have specific answers to Q1. For Q2 and Q3 we've been in a similar situation and detailing our approach might be helpful. We're using the Go SDK and are streaming, but it should still be equally applicable. We have so far ended up with a custom transform that uses

ReadFromKafka doesn't progress

2022-09-30 Thread Lydian
Hi, I've have this simple pipeline to test the kafka IO. It reads from kafka and log it. ``` ( pipeline | ReadFromKafka( consumer_config={ "bootstrap.servers": bootstrap_servers, "security.protocol": "SASL_SSL",