Re: [ANNOUNCE] New Kafka PMC Member: Mickael Maison

Thanks everyone! Regards On Mon, Aug 3, 2020 at 12:42 AM Matthias J. Sax wrote: > > Congrats Mickael! > > > -Matthias > > On 8/1/20 3:46 PM, Ismael Juma wrote: > > Congratulations Mickael! > > > > Ismael > > > > On Fri, Jul 31, 2020, 8:15 AM Jun Rao wrote: > > > >> Hi, Everyone, > >> > >> Micka

best approach to rotate the logs and archive on Kubernetes

Hi All, We have Kafka cluster deployed in Kubernetes and running with docker image (solsson/kafka:2.4.0) I have below logging configuration: config/log4j.properties # Unspecified loggers and loggers with additivity=true output to server.log and stdout # Note that INFO only applies to unspecified

Re: New Website Layout

Thanks, Guozhang. I'm sure we can get that small change in. Jorge, I think we're stuck with different UX for the docs page in this first release. The docs are such a goliath they need it but we'll address this in the next version. If anyone else has final comments before this merges now's the tim

[jira] [Created] (KAFKA-10354) Kafka Bug

Eeranna Kuruva created KAFKA-10354: -- Summary: Kafka Bug Key: KAFKA-10354 URL: https://issues.apache.org/jira/browse/KAFKA-10354 Project: Kafka Issue Type: Bug Reporter: Eeranna K

[jira] [Resolved] (KAFKA-10353) Trogdor - Fix RoundTripWorker to not fail when the topic it's trying to create already exists

[ https://issues.apache.org/jira/browse/KAFKA-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Kozlovski resolved KAFKA-10353. - Resolution: Duplicate > Trogdor - Fix RoundTripWorker to not fail when the topic

Re: [VOTE] 2.5.1 RC0

+1 (non-binding) I’m closing the vote now, since it has met the release criteria. Thanks to all who voted. -John On Mon, Aug 3, 2020, at 04:51, Mickael Maison wrote: > +1 (binding) > > - built from source with Scala 2.12 and Java 8 > - ran quickstart > - verified signatures > > Thanks John f

Re: [DISCUSS] KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter

Hi all I have made additional changes to the PR as per review from David Jacot. Please review. Regards Badai On Wed, Jul 29, 2020 at 11:17 PM Badai Aqrandista wrote: > Hi all > > I have created a PR for KIP-431 against the latest trunk: > https://github.com/apache/kafka/pull/9099 > > Please re

[RESULTS] [VOTE] Release Kafka version 2.5.1

Hello all, This vote passes with four +1 votes (3 binding) and no 0 or -1 votes. +1 votes PMC Members (in voting order): * Ismael Juma * Manikumar Reddy * Mickael Maison Committers (in voting order): * John Roesler Community: * No votes 0 votes * No votes -1 votes * No votes Vote thread: ht

[GitHub] [kafka-site] ijuma commented on a change in pull request #277: 2.6.0 release

ijuma commented on a change in pull request #277: URL: https://github.com/apache/kafka-site/pull/277#discussion_r465133944 ## File path: 26/upgrade.html ## @@ -19,6 +19,48 @@

Build failed in Jenkins: kafka-trunk-jdk14 #337

See Changes: [github] KAFKA-10308: Fix flaky core/round_trip_fault_test.py (#9079) -- [...truncated 3.21 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldP

Re: best approach to rotate the logs and archive on Kubernetes

I think if you just log to the console, kubernetes will manage the log rotation for you. https://kubernetes.io/docs/concepts/cluster-administration/logging/ You can use "kubectl logs" command to fetch the logs or use some logging agent to move the logs centrally. On Tue, Aug 4, 2020 at 8:15 PM Sri

Build failed in Jenkins: kafka-trunk-jdk8 #4761

See Changes: [github] KAFKA-10308: Fix flaky core/round_trip_fault_test.py (#9079) -- [...truncated 3.18 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shoul

[GitHub] [kafka-site] guozhangwang commented on pull request #277: 2.6.0 release

guozhangwang commented on pull request #277: URL: https://github.com/apache/kafka-site/pull/277#issuecomment-668706478 LGTM modulo Ismael's comments. This is an automated message from the Apache Git Service. To respond to the

Re: best approach to rotate the logs and archive on Kubernetes

Thank you Sachin, this solution is very helpful.. ~Srinivas On Tue, 4 Aug, 2020, 21:31 Sachin Mittal, wrote: > I think if you just log to the console, kubernetes will manage the log > rotation for you. > https://kubernetes.io/docs/concepts/cluster-administration/logging/ > You can use "kubec

Build failed in Jenkins: kafka-trunk-jdk11 #1687

See Changes: [github] KAFKA-10308: Fix flaky core/round_trip_fault_test.py (#9079) -- [...truncated 6.41 MB...] org.apache.kafka.streams.TopologyTestDriverTest > should

Re: [VOTE] KIP-614: Add Prefix Scan support for State Stores

Thanks Sagar! +1 (non-binding) Sophie On Sun, Aug 2, 2020 at 11:37 PM Sagar wrote: > Hi All, > > Just thought of bumping this voting thread again to see if we can form any > consensus around this. > > Thanks! > Sagar. > > > On Mon, Jul 20, 2020 at 4:21 AM Adam Bellemare > wrote: > > > LGTM > >

[jira] [Created] (KAFKA-10355) Handle accidental deletion of source-topics as exceptional failure

Guozhang Wang created KAFKA-10355: - Summary: Handle accidental deletion of source-topics as exceptional failure Key: KAFKA-10355 URL: https://issues.apache.org/jira/browse/KAFKA-10355 Project: Kafka

[jira] [Created] (KAFKA-10356) Handle accidental deletion of sink-topics as exceptional failure

Guozhang Wang created KAFKA-10356: - Summary: Handle accidental deletion of sink-topics as exceptional failure Key: KAFKA-10356 URL: https://issues.apache.org/jira/browse/KAFKA-10356 Project: Kafka

[jira] [Created] (KAFKA-10357) Handle accidental deletion of repartition-topics as exceptional failure

Guozhang Wang created KAFKA-10357: - Summary: Handle accidental deletion of repartition-topics as exceptional failure Key: KAFKA-10357 URL: https://issues.apache.org/jira/browse/KAFKA-10357 Project: Ka

[jira] [Created] (KAFKA-10358) Remove the 2.12 sitedocs

Randall Hauch created KAFKA-10358: - Summary: Remove the 2.12 sitedocs Key: KAFKA-10358 URL: https://issues.apache.org/jira/browse/KAFKA-10358 Project: Kafka Issue Type: Task Compone

[jira] [Created] (KAFKA-10359) Test failure during verification build of AK 2.6.0 RC2

Randall Hauch created KAFKA-10359: - Summary: Test failure during verification build of AK 2.6.0 RC2 Key: KAFKA-10359 URL: https://issues.apache.org/jira/browse/KAFKA-10359 Project: Kafka Issu

Re: [VOTE] 2.6.0 RC2

I wanted to follow up on two non-blocking issues Gwen mentioned earlier. I didn't find any similar items, so I logged the following: https://issues.apache.org/jira/browse/KAFKA-10358 - Remove the 2.12 sitedocs https://issues.apache.org/jira/browse/KAFKA-10359 - AgentTest unit test failure during v

Contributing to Kafka

Hi Team, I've used Kafka at my workplace and am very impressed with it. I would like to contribute to the Kafka project and have started taking a pass at some simple #newbie bugs where I can help. I'm trying to take a pass at https://issues.apache.org/jira/browse/KAFKA-10186 Can you please add

[jira] [Created] (KAFKA-10360) Disabling JmxReporter registration

Romain Quinio created KAFKA-10360: - Summary: Disabling JmxReporter registration Key: KAFKA-10360 URL: https://issues.apache.org/jira/browse/KAFKA-10360 Project: Kafka Issue Type: New Feature

Re: Contributing to Kafka

Gokul, you should be all set on Jira and the Wiki. However, I am not sure what email addresses you refer to? I am not aware that a Jira or Wiki account is associated with an email address and if so, I would not know if it's possible to change anything about it. -Matthias On 8/4/20 12:49 PM, g.

[GitHub] [kafka-site] guozhangwang merged pull request #269: Kafka nav and hompeage redesign

guozhangwang merged pull request #269: URL: https://github.com/apache/kafka-site/pull/269 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [DISCUSS] KIP-630: Kafka Raft Snapshot

Thanks for your feedback Jason. I'll have a more detailed reply and update to the KIP by EOD today. On Mon, Aug 3, 2020 at 1:57 PM Jason Gustafson wrote: > > Hi Jose, > > Thanks for the proposal. I think there are three main motivations for > snapshotting over the existing compaction semantics. >

[jira] [Created] (KAFKA-10361) Windows batch files that use /bin/windows/kafka-run-class.bat fail with a class path error on fresh installation

Nick Pirocanac created KAFKA-10361: -- Summary: Windows batch files that use /bin/windows/kafka-run-class.bat fail with a class path error on fresh installation Key: KAFKA-10361 URL: https://issues.apache.org/jira

Re: [VOTE] KIP-595: A Raft Protocol for the Metadata Quorum

On Mon, Aug 3, 2020, at 20:55, Jason Gustafson wrote: > Hi Colin, > > Thanks for the responses. > > > I have a few lingering questions. I still don't like the fact that the > > leader epoch / fetch epoch is 31 bits. What happens when this rolls over? > > Can we just make this 63 bits now so tha

Re: [VOTE] KIP-595: A Raft Protocol for the Metadata Quorum

Thanks for the KIP Jason, +1 (binding) from me as well for sure :) On Tue, Aug 4, 2020 at 2:46 PM Colin McCabe wrote: > On Mon, Aug 3, 2020, at 20:55, Jason Gustafson wrote: > > Hi Colin, > > > > Thanks for the responses. > > > > > I have a few lingering questions. I still don't like the fact

Re: [DISCUSS] KIP-651 - Support PEM format for SSL certificates and private key

Yes, Rajinit, it looks good -- an excellently-written KIP. Thanks! Ron On Mon, Aug 3, 2020 at 9:17 AM Andrew Otto wrote: > Yes please! I had to build custom tooling to automate generation and > distribution of java truststore and keystore files at Wikimedia for Kafka > brokers and clients. P

Build failed in Jenkins: kafka-trunk-jdk14 #338

See Changes: [github] MINOR: change Streams integration test log levels (#9024) -- [...truncated 6.42 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldPun

[jira] [Resolved] (KAFKA-10341) Add version 2.6 to streams and systems tests

[ https://issues.apache.org/jira/browse/KAFKA-10341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-10341. --- Reviewer: Matthias J. Sax Resolution: Fixed Merged the PR to the `trunk` branch, and d

Build failed in Jenkins: kafka-trunk-jdk8 #4762

See Changes: [github] MINOR: change Streams integration test log levels (#9024) -- [...truncated 6.36 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldPun

Build failed in Jenkins: kafka-2.6-jdk8 #105

See Changes: [github] Bump dev version to 2.6.1-SNAPSHOT (#9115) -- [...truncated 3.15 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shouldFailIfValueIsDiffere

[GitHub] [kafka-site] rhauch commented on a change in pull request #277: 2.6.0 release

rhauch commented on a change in pull request #277: URL: https://github.com/apache/kafka-site/pull/277#discussion_r465425450 ## File path: 26/upgrade.html ## @@ -19,6 +19,48 @@

[GitHub] [kafka-site] rhauch commented on a change in pull request #277: 2.6.0 release

rhauch commented on a change in pull request #277: URL: https://github.com/apache/kafka-site/pull/277#discussion_r465425702 ## File path: 26/upgrade.html ## @@ -19,6 +19,48 @@

Jenkins build is back to normal : kafka-trunk-jdk14 #339

See

Build failed in Jenkins: kafka-trunk-jdk11 #1688

See Changes: [github] MINOR: change Streams integration test log levels (#9024) [github] MINOR: Update jackson to latest 2.10.5 (#9058) -- [...truncated 5.05 MB...] ka

Jenkins build is back to normal : kafka-trunk-jdk8 #4763

See

[jira] [Created] (KAFKA-10362) When resuming Streams active task with EOS, the checkpoint file should be deleted

Guozhang Wang created KAFKA-10362: - Summary: When resuming Streams active task with EOS, the checkpoint file should be deleted Key: KAFKA-10362 URL: https://issues.apache.org/jira/browse/KAFKA-10362 P

Build failed in Jenkins: kafka-trunk-jdk14 #340

See Changes: [github] KAFKA-10341: Add 2.6.0 to system tests and streams upgrade tests (#9116) -- [...truncated 3.21 MB...] org.apache.kafka.streams.TopologyTestDriverTe

Build failed in Jenkins: kafka-trunk-jdk11 #1689

See Changes: [github] KAFKA-10341: Add 2.6.0 to system tests and streams upgrade tests (#9116) -- [...truncated 3.21 MB...] org.apache.kafka.streams.TopologyTestDriverT

Re: [DISCUSS] KIP-616: Rename implicit Serdes instances in kafka-streams-scala

Hi John! I understand your point. But, I'm still not sure that having a Unit serde is a good idea because it could be ambiguous for the user. In a KStream [Long, Unit] valid value could mean one the following: 1. Empty byte array 2. null 3. Any value (value ignored) As a user of a library, I thin