[VOTE] KIP-381 Connect: Tell about records that had their offsets flushed in callback

2019-01-18 Thread Per Steffensen
Please vote!

[VOTE] KIP-381 Connect: Tell about records that had their offsets flushed in callback

2018-12-12 Thread Per Steffensen
Hope for your votes

Permissions to edit KIP page and ...

2018-12-12 Thread Per Steffensen
permissions again. Username: steff1193 Kind regards, Per Steffensen

Re: [DISCUSS] KIP-381 Connect: Tell about records that had their offsets flushed in callback

2018-10-21 Thread Per Steffensen
mmit" that lies in its JavaDoc, and that essentially cannot be used for anything, except for making you confused. You know nothing about the state when it is called. But as long as you do not oppose the proposed solution, we probably should not spend too much time arguing back and forth about opinions. Ryanne Regards, and thanks for participating in the discussion Per Steffensen

Re: [DISCUSS] KIP-381 Connect: Tell about records that had their offsets flushed in callback

2018-10-18 Thread Per Steffensen
On 17/10/2018 18.17, Ryanne Dolan wrote: > this does not guarantee that the > offsets of R have been written/flushed at the next commit() call True, but does it matter? So long as you can guarantee the records are delivered to the downstream Kafka cluster, it shouldn't matter if they have been

Re: [DISCUSS] KIP-381 Connect: Tell about records that had their offsets flushed in callback

2018-10-17 Thread Per Steffensen
On 17/10/2018 16.43, Ryanne Dolan wrote: I see, thanks. On the other hand, the commitRecord() callback provides the functionality you require in this case. In commitRecord() your SourceTask can track the offsets of records that have been ack'd by the producer client, and then in commit() you can

Re: [DISCUSS] KIP-381 Connect: Tell about records that had their offsets flushed in callback

2018-10-17 Thread Per Steffensen
P. This way we also have at least two persons who really understands what this is about. Some times you only really understand what something is about, when you are forced to write about it (at least that is my excuse ). Regards, Per Steffensen On 16/10/2018 05.57, Konstantine Karantasi

Re: [DISCUSS] KIP-381 Connect: Tell about records that had their offsets flushed in callback

2018-10-17 Thread Per Steffensen
() is invoked by the framework. Is that not the case? Ryanne On Wed, Oct 10, 2018 at 8:50 AM Per Steffensen <mailto:perst...@gmail.com>> wrote: Please help make the proposed changes in KIP-381 become reality. Please comment. KIP: https://cwiki.apache.org/conflue

[DISCUSS] KIP-381 Connect: Tell about records that had their offsets flushed in callback

2018-10-10 Thread Per Steffensen
Please help make the proposed changes in KIP-381 become reality. Please comment. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-381%3A+Connect%3A+Tell+about+records+that+had+their+offsets+flushed+in+callback JIRA: https://issues.apache.org/jira/browse/KAFKA-5716 PR: https://githu

[jira] [Created] (KAFKA-6505) Add simple raw "offset-commit-failures", "offset-commits" and "offset-commit-successes" count metric

2018-01-30 Thread Per Steffensen (JIRA)
Per Steffensen created KAFKA-6505: - Summary: Add simple raw "offset-commit-failures", "offset-commits" and "offset-commit-successes" count metric Key: KAFKA-6505 URL: https://issue

[jira] [Created] (KAFKA-6504) Connect: Some per-task-metrics not working

2018-01-30 Thread Per Steffensen (JIRA)
Per Steffensen created KAFKA-6504: - Summary: Connect: Some per-task-metrics not working Key: KAFKA-6504 URL: https://issues.apache.org/jira/browse/KAFKA-6504 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-6503) Connect: Plugin scan is very slow

2018-01-30 Thread Per Steffensen (JIRA)
Per Steffensen created KAFKA-6503: - Summary: Connect: Plugin scan is very slow Key: KAFKA-6503 URL: https://issues.apache.org/jira/browse/KAFKA-6503 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-5716) Connect: When SourceTask.commit it is possible not everthing from SourceTask.poll has been sent

2017-08-09 Thread Per Steffensen (JIRA)
Per Steffensen created KAFKA-5716: - Summary: Connect: When SourceTask.commit it is possible not everthing from SourceTask.poll has been sent Key: KAFKA-5716 URL: https://issues.apache.org/jira/browse/KAFKA-5716

Re: kafka connect questions

2017-07-05 Thread Per Steffensen
Well I guess there is one: https://github.com/dhanuka84/kafka-connect-tcp Maybe you can use or build on top of that. On 05/07/17 05:45, Gwen Shapira wrote: I don't remember seeing one. There is no reason not to write one (let us know if you do, so we can put it on the connector hub!). Few thing

[jira] [Created] (KAFKA-5505) Connect: Do not restart connector and existing tasks on task-set change

2017-06-23 Thread Per Steffensen (JIRA)
Per Steffensen created KAFKA-5505: - Summary: Connect: Do not restart connector and existing tasks on task-set change Key: KAFKA-5505 URL: https://issues.apache.org/jira/browse/KAFKA-5505 Project

Re: Kafka Connect: To much restarting with a SourceConnector with dynamic set of tasks

2017-05-23 Thread Per Steffensen
Thanks a lot for responding, Randall! See my comments below. Regards, Per Steffensen On 22/05/17 22:36, Randall Hauch wrote: You're not doing anything wrong, but I suspect you're requesting task reconfiguration more frequently than was originally envisioned, which means that t

Kafka Connect: To much restarting with a SourceConnector with dynamic set of tasks

2017-05-16 Thread Per Steffensen
the SourceConnector, just because it has a changed task-config-set Or am I doing something wrong in my SourceConnector? Are there a different way that I should maintain a dynamic set of tasks? Thanks!!! Regards, Per Steffensen