Re: Anyone interested in helping out a little brother Apache project with their Kafka integration?

Hi Chris, I can help you in writing Kafka connector code. Regards, Abhimanyu On Wed, Aug 15, 2018 at 8:13 PM Christofer Dutz wrote: > Hi all, > > I am one of the Apache PLC4X (incubating) committers and am looking for > people willing to help out with a little thing. > > PLC4X is aiming at ind

Re: Anyone interested in helping out a little brother Apache project with their Kafka integration?

Chris, Can you point at the starting point for your Connector? Happy to do a quick review of code. I'll admit, I'm a bit confused by the PLC4X positioning -- it seems to claim to be universal IoT protocol, but then I see, e.g., nothing about MQTT on the front page, a protocol that Kafka Connect a

Anyone interested in helping out a little brother Apache project with their Kafka integration?

Hi all, I am one of the Apache PLC4X (incubating) committers and am looking for people willing to help out with a little thing. PLC4X is aiming at industrial programmable logic controllers. So what we are doing is similar what JDBC did in the late 90s. We’ve implemented a universal API with wh

Re: Helping out

Yes. We will need to think a bit more for the more general case when there are messages for multiple topics. Thanks, Jun On Wed, Jul 3, 2013 at 11:18 AM, S Ahmed wrote: > > https://github.com/apache/kafka/blob/0.8/core/src/main/scala/kafka/producer/async/DefaultEventHandler.scala#L152 > > > >

Re: Helping out

Yes. And as you can see in that function, when no key is specified, it chooses a partition for each message in a round-robin manner, while we want to make all the messages in the same batch with the same topic to be sent to one partition. So if the message is the first seen with the topic in the b

Re: Helping out

https://github.com/apache/kafka/blob/0.8/core/src/main/scala/kafka/producer/async/DefaultEventHandler.scala#L152 On Wed, Jul 3, 2013 at 2:18 PM, S Ahmed wrote: > Jun, > > Looks like the update would happen around here? > > > > > On Wed, Jul 3, 2013 at 12:53 PM, Jun Rao wrote: > >> Sam, >> >>

Re: Helping out

Jun, Looks like the update would happen around here? On Wed, Jul 3, 2013 at 12:53 PM, Jun Rao wrote: > Sam, > > Interested in taking a look at > KAFKA-959 > ? > > Thanks, > > Jun > > > On Sun, Jun 23, 2013 at 11:01 PM, Sam Meder >wrote: > > >

Re: Helping out

Sam, Interested in taking a look at KAFKA-959 ? Thanks, Jun On Sun, Jun 23, 2013 at 11:01 PM, Sam Meder wrote: > Hey, > > I now have roughly a day a week I can dedicate to working on Kafka, so I > am looking for issues in the 0.8.1 batch that y

Re: Helping out

I actually don't think quotas really needs to do cross-broker communication. I think we can just enforce it at the topic-partition level and have the leader do the check (even if the user expresses the quota at the topic level we will just turn it into a per-partition limit by dividing by the numbe

Re: Helping out

Actually the intern ended up working on offset storage (https://cwiki.apache.org/confluence/display/KAFKA/Offset+Management) in case any one is still interested in quotas. -Jay On Tue, Jun 25, 2013 at 8:54 PM, Jun Rao wrote: > As for offset management, we have a summer intern starting this week

Re: Helping out

Sam, Also, just want to say thank you for fixing kafka-938. That's an awesome fix! Jun On Sun, Jun 23, 2013 at 11:01 PM, Sam Meder wrote: > Hey, > > I now have roughly a day a week I can dedicate to working on Kafka, so I > am looking for issues in the 0.8.1 batch that you think might be good

Re: Helping out

As for offset management, we have a summer intern starting this week and our plan is to have the intern work on this. Thanks, Jun On Tue, Jun 25, 2013 at 7:53 AM, Sam Meder wrote: > On Jun 24, 2013, at 9:41 AM, Jay Kreps wrote: > > Hey Sam, > > > > That's great. I would be happy to act as a p

Re: Helping out

Quotas is a cool idea, is it going to do cross broker communication or it doesn't need to talk to other brokers? On Mon, Jun 24, 2013 at 12:41 PM, Jay Kreps wrote: > Hey Sam, > > That's great. I would be happy to act as a point of contact if any > questions come up or you need a reviewer for pa

Re: Helping out

Yeah I can take a look at those. The plan for branching is to do all development off trunk and cut branches for releases. 0.8 was sort of a one-off in this respect. Going forward the idea is that all new code will go against trunk. Topic delete would also be a great one. I would recommend we hol

Re: Helping out

On Jun 24, 2013, at 9:41 AM, Jay Kreps wrote: > Hey Sam, > > That's great. I would be happy to act as a point of contact if any > questions come up or you need a reviewer for patches. > Great, I have a few patches outstanding, so if you could take a look: https://issues.apache.org/jira/browse/

Re: Helping out

Hey Sam, That's great. I would be happy to act as a point of contact if any questions come up or you need a reviewer for patches. We haven't had an official discussion of roadmap but trunk already has support for keyed messages and log compaction and a cleanup of the log code. I think the goal wo

Helping out

Hey, I now have roughly a day a week I can dedicate to working on Kafka, so I am looking for issues in the 0.8.1 batch that you think might be good starting points. Input would be much appreciated. Speaking of issues, I think it would be good to either fix https://issues.apache.org/jira/browse