Re: Connect task configuration limits?

2022-05-21 Thread Urbán Dániel
Hi Ryan, There are some limits, as the configs are stored inside an internal topic of Connect. So the usual message size and producer request size limitations apply. You can reconfigure the internal topic to allow larger messages than the default (I think it's 1MB), and the producer max reques

Re: What role plays transactional.id after KIP-447?

2022-05-21 Thread Guozhang Wang
Hello Gabriel, What you're asking is a very fair question :) In fact, for Streams where the partition-assignment to producer-consumer pairs are purely flexible, we think the new EOS would not have hard requirement on transactional.id: https://issues.apache.org/jira/browse/KAFKA-9453 I you impleme