[jira] [Resolved] (KAFKA-10176) kafka-topics command requires --zookeeper for --alter --topic --config

2020-06-18 Thread Piotr Smolinski (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Smolinski resolved KAFKA-10176. - Resolution: Won't Fix Closing, as the feature has been deprecated in Kafka 0.9 and the p

Build failed in Jenkins: kafka-trunk-jdk11 #1583

2020-06-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10141; Add more detail to log segment delete messages (#8850) -- [...truncated 3.17 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Build failed in Jenkins: kafka-trunk-jdk14 #230

2020-06-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10113; Specify fetch offsets correctly in `LogTruncationException` -- [...truncated 6.35 MB...] org.apache.kafka.streams.TopologyTestDriverTe

Build failed in Jenkins: kafka-trunk-jdk8 #4654

2020-06-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10113; Specify fetch offsets correctly in `LogTruncationException` -- [...truncated 6.30 MB...] org.apache.kafka.streams.TopologyTestDriverT

Re: [VOTE] KIP-626: Rename StreamsConfig config variable name

2020-06-18 Thread John Roesler
Thanks Matthias, I’m +1 (binding) -John On Thu, Jun 18, 2020, at 02:21, Navinder Brar wrote: > Hi Matthias, > > +1 non-binding. Thanks for the KIP. > > Thanks, > Navinder  > > On Tuesday, 16 June, 2020, 06:34:19 pm IST, Bruno Cadonna > wrote: > > Hi Matthias, > > Thank you for th

回复: [DISCUSS]: KIP-628: ConsumerPerformance's multi-thread implementation

2020-06-18 Thread Jiamei Xie
Sorry for sending this email to disturb you. I think I sent this email from the wrong place. So I sent it again using my gmail. So this email is abandoned -邮件原件- 发件人: Jiamei Xie 发送时间: 2020年6月19日 11:29 收件人: dev@kafka.apache.org 主题: [DISCUSS]: KIP-628: ConsumerPerformance's multi-thread i

[DISCUSS]: KIP-628: ConsumerPerformance's multi-thread implementation

2020-06-18 Thread jiamei xie
Hi, I'd like to start a discussion on KIP-628: ConsumerPerformance's multi-thread implementation. https://cwiki.apache.org/confluence/display/KAFKA/KIP-628%3A+ConsumerPerformance%27s+multi-thread+implementation It's about making option [threads] work in ConsumerPerformance whose implementation

[DISCUSS]: KIP-628: ConsumerPerformance's multi-thread implementation

2020-06-18 Thread Jiamei Xie
Hi, I'd like to start discussion on KIP-628: ConsumerPerformance's multi-thread implementation. https://cwiki.apache.org/confluence/display/KAFKA/KIP-628%3A+ConsumerPerformance%27s+multi-thread+implementation It's about making option [threads] work in ConsumerPerformance whose implementati

Build failed in Jenkins: kafka-trunk-jdk11 #1582

2020-06-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10113; Specify fetch offsets correctly in `LogTruncationException` -- [...truncated 3.18 MB...] org.apache.kafka.streams.TopologyTestDriverT

[jira] [Resolved] (KAFKA-10113) LogTruncationException sets fetch offsets incorrectly

2020-06-18 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10113. - Fix Version/s: 2.6.0 Resolution: Fixed > LogTruncationException sets fetch offset

Build failed in Jenkins: kafka-trunk-jdk11 #1581

2020-06-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10167: use the admin client to read end-offset (#8876) -- [...truncated 6.35 MB...] org.apache.kafka.streams.TestTopicsTest > testWithHeaders

Re: First time patch submitter advice

2020-06-18 Thread Michael Carter
Hi Gwen and Luke, Sorry, I’ve probably misunderstood something again. Since KAFKA-10155 and KAFKA-10147 have now been resolved, I merged the trunk back into my branch and added to comment “retest this please” to my pull request (https://github.com/apache/kafka/pull/8844

[jira] [Resolved] (KAFKA-10167) Streams EOS-Beta should not try to get end-offsets as read-committed

2020-06-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-10167. --- Resolution: Fixed > Streams EOS-Beta should not try to get end-offsets as read-committed > -

Jenkins build is back to normal : kafka-trunk-jdk8 #4653

2020-06-18 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-10186) Aborting transaction with pending data should throw non-fatal exception

2020-06-18 Thread Sophie Blee-Goldman (Jira)
Sophie Blee-Goldman created KAFKA-10186: --- Summary: Aborting transaction with pending data should throw non-fatal exception Key: KAFKA-10186 URL: https://issues.apache.org/jira/browse/KAFKA-10186

Jenkins build is back to normal : kafka-2.6-jdk8 #55

2020-06-18 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk14 #229

2020-06-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10167: use the admin client to read end-offset (#8876) -- [...truncated 3.17 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldP

[jira] [Created] (KAFKA-10185) Streams should log summarized restoration information at info level

2020-06-18 Thread John Roesler (Jira)
John Roesler created KAFKA-10185: Summary: Streams should log summarized restoration information at info level Key: KAFKA-10185 URL: https://issues.apache.org/jira/browse/KAFKA-10185 Project: Kafka

Re: [VOTE] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

2020-06-18 Thread Ismael Juma
Hi Boyang, Sorry for being late on this. I'm generally in favor of the KIP, but it seems like it has two missing things: 1. It doesn't cover how this new channel will be configured. That's a critical part of having a KIP that comprises all that is needed to merge the relevant PR. 2. It doesn't st

Build failed in Jenkins: kafka-2.4-jdk8 #227

2020-06-18 Thread Apache Jenkins Server
See Changes: [konstantine] MINOR: Upgrade ducktape to 0.7.8 (#8879) -- [...truncated 7.79 MB...] at org.apache.kafka.test.TestUtils.tempDirectory(TestUtils.java:235)

Re: [External] Kafka broker architecture overview

2020-06-18 Thread Brian Sang
You can try taking a look at https://jaceklaskowski.gitbooks.io/apache-kafka/ , not sure if it is the same level you want but I've used it for some reference before. On Thu, Jun 18, 2020 at 6:39 AM Alexander Sibiryakov < sibirya...@scrapinghub.com> wrote: > Hello, > > could anyone please point me

[jira] [Created] (KAFKA-10184) Flaky HighAvailabilityTaskAssignorIntegrationTest.shouldScaleOutWithWarmupTasksAndPersistentStores

2020-06-18 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-10184: - Summary: Flaky HighAvailabilityTaskAssignorIntegrationTest.shouldScaleOutWithWarmupTasksAndPersistentStores Key: KAFKA-10184 URL: https://issues.apache.org/jira/browse/KAFKA-101

Re: [VOTE] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

2020-06-18 Thread Boyang Chen
Thanks everyone for the vote! We already got 3 binding votes (Colin, Guozhang, Rajini) and 2 non-binding votes (Jose, David). The KIP is now approved. Best, Boyang On Thu, Jun 18, 2020 at 1:43 AM Rajini Sivaram wrote: > +1 (binding) > > Thanks for the KIP, Boyang! > > Regards, > > Rajini > > >

[jira] [Created] (KAFKA-10183) MirrorMaker creates duplicate messages in target cluster

2020-06-18 Thread Liraz Sharaby (Jira)
Liraz Sharaby created KAFKA-10183: - Summary: MirrorMaker creates duplicate messages in target cluster Key: KAFKA-10183 URL: https://issues.apache.org/jira/browse/KAFKA-10183 Project: Kafka Is

Jenkins build is back to normal : kafka-2.5-jdk8 #155

2020-06-18 Thread Apache Jenkins Server
See

Kafka broker architecture overview

2020-06-18 Thread Alexander Sibiryakov
Hello, could anyone please point me to a document or blog post describing Kafka broker internal architecture: threads, data flows, startup/shutdown routine? Unfortunately, I wasn't able to find anything quickly in Google. Thank you. A.

Kafka - Failed to clean up log for __consumer_offsets-10 in dir

2020-06-18 Thread Nag Y
I am seeing the following exception in one of the broker log files. Set up contains 3 brokers. Environment - Windows I am ok to remove the files c:\tmp directory. However, I'm a little curious to know why this broker got into this state and if there is a way to rectify the issue without deleting

Re: [DISCUSS] KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter

2020-06-18 Thread Badai Aqrandista
David Thank you for replying 1. It seems that `print.partition` is already implemented. Do you confirm? BADAI: Yes, you are correct. I have removed it from the KIP. 2. Will `null.literal` be only used when the value of the message is NULL or for any fields? Also, it seems that we print out "null

Build failed in Jenkins: kafka-2.3-jdk8 #216

2020-06-18 Thread Apache Jenkins Server
See Changes: [konstantine] MINOR: Upgrade ducktape to 0.7.8 (#8879) -- [...truncated 2.93 MB...] kafka.api.SaslPlainSslEndToEndAuthorizationTest > testNoDescribeProduceOrC

Build failed in Jenkins: kafka-2.2-jdk8 #48

2020-06-18 Thread Apache Jenkins Server
See Changes: [konstantine] MINOR: Upgrade ducktape to 0.7.8 (#8879) -- [...truncated 2.55 MB...] kafka.api.AuthorizerIntegrationTest > testOffsetFetchWithNoTopicAccess PASSE

Re: [VOTE] KIP-597: MirrorMaker2 internal topics Formatters

2020-06-18 Thread Mickael Maison
Hi, Thanks all for the feedback and votes. I'm closing the vote. It has passed with 3 binding votes (Konstantine, Manikumar and Mickael) and 6 non-binding votes (Andrew, Edoardo, Christopher, Ryanne, Maulin and David). On Thu, Jun 18, 2020 at 10:07 AM David Jacot wrote: > > Hi Mickael, > > Th

Re: [DISCUSS] KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter

2020-06-18 Thread David Jacot
Hi Badai, Thanks for resuming this. I have few small comments: 1. It seems that `print.partition` is already implemented. Do you confirm? 2. Will `null.literal` be only used when the value of the message is NULL or for any fields? Also, it seems that we print out "null" today when the key or the

Re: [VOTE] KIP-597: MirrorMaker2 internal topics Formatters

2020-06-18 Thread David Jacot
Hi Mickael, Thanks for your answer. Understood. +1 (non-binding) Best, David On Thu, Jun 18, 2020 at 10:15 AM Mickael Maison wrote: > Hi David, > > Thanks again for your feedback! > > 2) I think it makes sense to use Configurable to make this interface > consistent with all the other interfac

Re: [VOTE] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

2020-06-18 Thread Rajini Sivaram
+1 (binding) Thanks for the KIP, Boyang! Regards, Rajini On Thu, Jun 18, 2020 at 8:15 AM David Jacot wrote: > +1 (non-binding) > > Thanks for the KIP! > > On Thu, Jun 18, 2020 at 12:00 AM Jose Garcia Sancio > wrote: > > > +1. > > > > Thanks for the KIP and looking forward to the improveme

Re: [VOTE] KIP-597: MirrorMaker2 internal topics Formatters

2020-06-18 Thread Mickael Maison
Hi David, Thanks again for your feedback! 2) I think it makes sense to use Configurable to make this interface consistent with all the other interfaces Kafka exposes. Yes it's unfortunate it introduces a deprecated method in the new interface but I don't think it's a big deal. It allows users to

Build failed in Jenkins: kafka-2.6-jdk8 #54

2020-06-18 Thread Apache Jenkins Server
See Changes: [konstantine] MINOR: Upgrade ducktape to 0.7.8 (#8879) -- [...truncated 3.14 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldNotUpdateStoreForSma

Jenkins build is back to normal : kafka-2.1-jdk8 #268

2020-06-18 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-1.1-jdk8 #292

2020-06-18 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk11 #1580

2020-06-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Upgrade ducktape to 0.7.8 (#8879) -- [...truncated 3.18 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest > shouldCreateNullK

Build failed in Jenkins: kafka-2.5-jdk8 #154

2020-06-18 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-10123; Fix incorrect value for AWAIT_RESET#hasPosition (#8841) -- [...truncated 2.93 MB...] org.apache.kafka.streams.MockProcessorContextTest > sh

Build failed in Jenkins: kafka-2.0-jdk8 #320

2020-06-18 Thread Apache Jenkins Server
See Changes: [konstantine] MINOR: Upgrade ducktape to 0.7.8 (#8879) -- [...truncated 437.87 KB...] kafka.log.LogCleanerTest > testBasicTransactionAwareCleaning PASSED kafk

Re: [DISCUSS] KIP-513: Distinguish between Key and Value serdes in scala wrapper library for kafka streams

2020-06-18 Thread Yuriy Badalyantc
Hi everybody, I just want to ping this discussion. Any thoughts? - Yuriy On Fri, Jun 5, 2020 at 10:22 AM Yuriy Badalyantc wrote: > Hi Matthias, > > I think you misunderstood my diagram. I wanted to show the next > relationships: > - Serde is KeySerde and ValueSerde > - KeySerde is KeySerialize

Re: [VOTE] KIP-626: Rename StreamsConfig config variable name

2020-06-18 Thread Navinder Brar
Hi Matthias, +1 non-binding. Thanks for the KIP. Thanks, Navinder  On Tuesday, 16 June, 2020, 06:34:19 pm IST, Bruno Cadonna wrote: Hi Matthias, Thank you for the KIP. I am +1 (non-binding). Said that, you have a typo in the "Public Interface" section. TOPLOGY_OPTIMIZATION_CONFIG

Build failed in Jenkins: kafka-trunk-jdk14 #228

2020-06-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9896: fix flaky StandbyTaskEOSIntegrationTest (#8883) [github] KAFKA-10123; Fix incorrect value for AWAIT_RESET#hasPosition (#8841) [github] MINOR: Upgrade ducktape to 0.7.8 (#8879)

Re: [VOTE] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

2020-06-18 Thread David Jacot
+1 (non-binding) Thanks for the KIP! On Thu, Jun 18, 2020 at 12:00 AM Jose Garcia Sancio wrote: > +1. > > Thanks for the KIP and looking forward to the improvement implementation. > > On Wed, Jun 17, 2020 at 2:24 PM Guozhang Wang wrote: > > > > Thanks for the KIP Boyang, +1 from me. > > > > >

Build failed in Jenkins: kafka-trunk-jdk8 #4652

2020-06-18 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10123; Fix incorrect value for AWAIT_RESET#hasPosition (#8841) [github] MINOR: Upgrade ducktape to 0.7.8 (#8879) -- [...truncated 5.37 MB...]