Re: Request for adding to contributors list

2020-05-26 Thread Luke Chen
Hi Guruprasad, What Matthias was asking, is what your JIRA account username is? So that he or other committer can help you grant you the permission to assign JIRA tickets. If you haven't got the JIRA account yet, you can sign up here: https://issues.apache.org/jira/secure/Signup!default.jspa Thank

Re: Request for adding to contributors list

2020-05-26 Thread Guruprasad Tahasildar
Link to Jira I would like to address: https://issues.apache.org/jira/browse/KAFKA-10047 Thanks, On 2020/05/26 17:26:06, "Matthias J. Sax" wrote: > What is your Jira ID? > > -Matthias > > On 5/24/20 8:31 PM, Guruprasad Tahasildar wrote: > > Request for adding to contributors list. > > > > Tha

Re: swagger/openapi spec for Kafka-Connect REST API?

2020-05-26 Thread Aki Yoshida
I know that there is a documentation for humans. But I needed a machine readable spec so that I could send requests from somewhere without a specific client library. So, I created a spec document from the jaxrs resources used by Kafka Connector. If there are interests in the community, I can attac

Re: can kafka state stores be used as a application level cache by application to modify it from outside the stream topology?

2020-05-26 Thread Matthias J. Sax
For example it could be some "static" information, like a mapping from zip code to city name. Something that does usually not change over time. -Matthias On 5/25/20 9:55 PM, Pushkar Deole wrote: > Matthias, > > I am wondering what you mean by "Global store hold "axially" data that is > provide

RE: Kafka Timeout Exception

2020-05-26 Thread JOHN, BIBIN
Team, Could you please help on my below query? -Original Message- From: JOHN, BIBIN Sent: Monday, May 25, 2020 11:48 PM To: users@kafka.apache.org Subject: Kafka Timeout Exception *** Security Advisory: This Message Originated Outside of AT&T ***. Reference http://cso.att.com/EmailSec

Re: Request for adding to contributors list

2020-05-26 Thread Matthias J. Sax
What is your Jira ID? -Matthias On 5/24/20 8:31 PM, Guruprasad Tahasildar wrote: > Request for adding to contributors list. > > Thanks, > Guru T > signature.asc Description: OpenPGP digital signature

Re: Kafka Connect Connector Tasks Uneven Division

2020-05-26 Thread Robin Moffatt
The KIP for the current rebalancing protocol is probably a good reference: https://cwiki.apache.org/confluence/display/KAFKA/KIP-415:+Incremental+Cooperative+Rebalancing+in+Kafka+Connect -- Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff On Tue, 26 May 2020 at 14:25, D

Re: Kafka Connect Connector Tasks Uneven Division

2020-05-26 Thread Deepak Raghav
Hi Robin Thanks for the clarification. As you suggested, that task allocation between the workers is nondeterministic. I have shared the same information within in my team but there are some other parties, with whom I need to share this information as explanation for the issue raised by them and

Re: Broker side partition round robin

2020-05-26 Thread Vinicius Scheidegger
Yes, I checked it. The issue is that RoundRobbinPartitioner is bound to the producer. In a scenario with multiple producers it doesn't guarantee equal distribution - from what I understood and from my tests, the following situation happens with it: [image: image.png] Of course, the first partitio

Re: Broker side partition round robin

2020-05-26 Thread M. Manna
Hey Vinicius, On Tue, 26 May 2020 at 10:27, Vinicius Scheidegger < vinicius.scheideg...@gmail.com> wrote: > In a scenario with multiple independent producers (imagine ephemeral > dockers, that do not know the state of each other), what should be the > approach for the messages being sent to be e

Broker side partition round robin

2020-05-26 Thread Vinicius Scheidegger
In a scenario with multiple independent producers (imagine ephemeral dockers, that do not know the state of each other), what should be the approach for the messages being sent to be equally distributed over a topic partition? >From what I understood the partition election is always on the Produce