[jira] [Resolved] (KAFKA-1130) "log.dirs" is a confusing property name

[ https://issues.apache.org/jira/browse/KAFKA-1130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-1130. - Resolution: Won't Fix Due to the age of the last comment on this issue and the fact that there has

Re: [DISCUSS] KIP-212: Enforce set of legal characters for connector names

@Randall: are you happy with the KIP as it stands so I can call for a vote, or are there any outstanding items still to discuss? Same question to anybody else who'd like to participate of course :) On Thu, Nov 16, 2017 at 5:35 PM, Sönke Liebau wrote: > Sounds good. I've added a few sentences to

[jira] [Created] (KAFKA-6237) stream stopped working after exception: Cannot execute transactional method because we are in an error state

DHRUV BANSAL created KAFKA-6237: --- Summary: stream stopped working after exception: Cannot execute transactional method because we are in an error state Key: KAFKA-6237 URL: https://issues.apache.org/jira/browse/KAFK

Re: SessionKeySchema#segmentsToSearch()

w.r.t `SessionKeySchema` MAX_VALUE is correct. This is because we use the end time (rather than the start time) of the session to define which segment the session is in. So it could be in any segment starting from `from` time. On Sun, 19 Nov 2017 at 20:27 Ted Yu wrote: > For `getMinSegmentGreate

kafka schema registry problem

Hi i have a problem, i would like to create an avro schema on schema registry of kafka that references a type that is declared in a different avro schema, the places under an example: First avro schema with reference UserAction {"namespace": "com.myorg.other", "type": "record", "name": "SearchS

[jira] [Created] (KAFKA-6238) Issues with protocol version when applying a rolling upgrade to 1.0.0

Diego Louzán created KAFKA-6238: --- Summary: Issues with protocol version when applying a rolling upgrade to 1.0.0 Key: KAFKA-6238 URL: https://issues.apache.org/jira/browse/KAFKA-6238 Project: Kafka

Re: [jira] [Created] (KAFKA-6238) Issues with protocol version when applying a rolling upgrade to 1.0.0

what should I do? 2017-11-20 12:06 GMT+01:00 Diego Louzán (JIRA) : > Diego Louzán created KAFKA-6238: > --- > > Summary: Issues with protocol version when applying a rolling > upgrade to 1.0.0 > Key: KAFKA-6238 > URL:

Re: [DISCUSS] KIP-225 - Use tags for consumer “records.lag” metrics

Hi, Any dev could comment on this? I'd quite like to launch the vote for this soon. Thanks! On Fri, Nov 17, 2017 at 6:40 AM, James Cheng wrote: > Ah, that's a great point. KIP-153 didn't *rename* the metric but changed > its meaning, yet we didn't seem to discuss compatibility much when we mad

Re: [DISCUSS] Kafka 2.0.0 in June 2018

Thanks for the update Onur. Are you and the other committers and contributors from LinkedIn planning to push this over the line? Ismael On Fri, Nov 10, 2017 at 9:53 PM, Onur Karaman wrote: > Hey everyone. Regarding the status of KIP-125, just a heads up: I have an > implementation of KIP-125 (K

[jira] [Created] (KAFKA-6239) Consume group hung into rebalancing state, now stream not able to poll data

DHRUV BANSAL created KAFKA-6239: --- Summary: Consume group hung into rebalancing state, now stream not able to poll data Key: KAFKA-6239 URL: https://issues.apache.org/jira/browse/KAFKA-6239 Project: Kafk

[jira] [Created] (KAFKA-6240) Support dynamic updates of frequently updated broker configs

Rajini Sivaram created KAFKA-6240: - Summary: Support dynamic updates of frequently updated broker configs Key: KAFKA-6240 URL: https://issues.apache.org/jira/browse/KAFKA-6240 Project: Kafka

[jira] [Created] (KAFKA-6241) Enable dynamic reconfiguration of SSL keystores

Rajini Sivaram created KAFKA-6241: - Summary: Enable dynamic reconfiguration of SSL keystores Key: KAFKA-6241 URL: https://issues.apache.org/jira/browse/KAFKA-6241 Project: Kafka Issue Type: S

[jira] [Created] (KAFKA-6242) Enable resizing various broker thread pools

Rajini Sivaram created KAFKA-6242: - Summary: Enable resizing various broker thread pools Key: KAFKA-6242 URL: https://issues.apache.org/jira/browse/KAFKA-6242 Project: Kafka Issue Type: Sub-t

[jira] [Created] (KAFKA-6243) Enable reconfiguration of metrics reporters and their custom configs

Rajini Sivaram created KAFKA-6243: - Summary: Enable reconfiguration of metrics reporters and their custom configs Key: KAFKA-6243 URL: https://issues.apache.org/jira/browse/KAFKA-6243 Project: Kafka

[jira] [Created] (KAFKA-6244) Enable dynamic reconfiguration of log cleaners

Rajini Sivaram created KAFKA-6244: - Summary: Enable dynamic reconfiguration of log cleaners Key: KAFKA-6244 URL: https://issues.apache.org/jira/browse/KAFKA-6244 Project: Kafka Issue Type: Su

[jira] [Created] (KAFKA-6245) Enable reconfiguration of default topic configs used by brokers

Rajini Sivaram created KAFKA-6245: - Summary: Enable reconfiguration of default topic configs used by brokers Key: KAFKA-6245 URL: https://issues.apache.org/jira/browse/KAFKA-6245 Project: Kafka

[jira] [Created] (KAFKA-6246) Enable reconfiguration of listeners and security configs

Rajini Sivaram created KAFKA-6246: - Summary: Enable reconfiguration of listeners and security configs Key: KAFKA-6246 URL: https://issues.apache.org/jira/browse/KAFKA-6246 Project: Kafka Iss

[DISCUSS] KIP 226 - Dynamic Broker Configuration

Hi all, I have submitted KIP-226 to enable dynamic reconfiguration of brokers without restart: https://cwiki.apache.org/confluence/display/KAFKA/KIP-226+-+Dynamic+Broker+Configuration The KIP proposes to extend the current dynamic replication quota configuration for brokers to support dynamic re

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

Hi, can you help me? i have a problem, i would like to create an avro schema on schema registry of kafka that references a type that is declared in a different avro schema, the places under an example: First avro schema with reference UserAction {"namespace": "com.myorg.other", "type": "record",

Re: [DISCUSS] Kafka 2.0.0 in June 2018

> > > Personally, I suspect that those who absolutely need a rolling migration > and cannot handle a short period of downtime while doing a migration > probably have in-house experts on Kafka who are familiar with the issues > and willing to figure out a solution. The rest of the world can generall

Re: [DISCUSS] Kafka 2.0.0 in June 2018

It's worth emphasizing that the impact to such users is independent of whether we remove the old high-level consumer in 2.0.0 or not. They are unable to use the message format introduced in 0.11.0 or security features today. Ismael On Mon, Nov 20, 2017 at 4:11 PM, Gwen Shapira wrote: > > > > >

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

bq. (e.g. increase network/IO threads) Would decreasing network/IO threads be supported ? bq. void reconfigure(Map configs); What if some keys in configs are not in the Set returned by reconfigurableConfigs() ? Would exception be thrown ? If so, please specify which exception would be thrown

Re: [DISCUSS] Kafka 2.0.0 in June 2018

Agree. I don't know that it actually matters. They can keep using whatever they are using now since we don't plan on breaking the protocol. But since the issue does keep coming up, I figured we'll need a clear message around what the removal means and what users need to do. Gwen On Mon, Nov 20,

Re: [DISCUSS] Kafka 2.0.0 in June 2018

Yes, makes sense. Ismael On Mon, Nov 20, 2017 at 4:49 PM, Gwen Shapira wrote: > Agree. I don't know that it actually matters. They can keep using whatever > they are using now since we don't plan on breaking the protocol. > > But since the issue does keep coming up, I figured we'll need a clear

Re: Request to add to contributor's list...

Done. Cheers, Guozhang On Sun, Nov 19, 2017 at 11:12 AM, Alex Ott wrote: > Hello > > I have some free time & want to try to contribute to Kafka via resolving > issues, and contributing to documentation. > Please give me access rights for work with issues in JIRA & wiki edit > rights > > My JIRA

[GitHub] kafka pull request #4239: KAFKA-6214: enable use of in-memory store for stan...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/4239 KAFKA-6214: enable use of in-memory store for standby tasks Remove the flag in `ProcessorStateManager` that checks if a store is persistent when registering it as a standby task. Updated the smoke

Kafka schema registry problem

Hi i have a problem, i would like to create an avro schema on schema registry of kafka that references a type that is declared in a different avro schema, the places under an example: First avro schema with reference UserAction {"namespace": "com.myorg.other", "type": "record", "name": "SearchS

Re: [VOTE] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

+1 Make sense. We have a supplier for every other client type :) On Fri, Nov 17, 2017 at 1:33 PM Matthias J. Sax wrote: > +1 > > On 11/17/17 9:35 AM, Ted Yu wrote: > > +1 > > > > On Fri, Nov 17, 2017 at 9:34 AM, Bill Bejeck wrote: > > > >> +1 > >> > >> Thanks, > >> Bill > >> > >> On Fri, Nov 1

Re: [VOTE] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

+1 On Mon, 20 Nov 2017 at 17:52 Gwen Shapira wrote: > +1 > > Make sense. We have a supplier for every other client type :) > > On Fri, Nov 17, 2017 at 1:33 PM Matthias J. Sax > wrote: > > > +1 > > > > On 11/17/17 9:35 AM, Ted Yu wrote: > > > +1 > > > > > > On Fri, Nov 17, 2017 at 9:34 AM, Bill

Re: [VOTE] KIP-224: Add configuration parameters `retries` to Streams API

+1 My understanding is that the KIP is going to take two existing parameters (retries and retries-backoff) and apply them to GlobalKTable implementation where previously the settings were ignored and behavior was hard-coded. If my understanding is incorrect, please disregard my vote. Gwen On Tu

[jira] [Resolved] (KAFKA-6237) stream stopped working after exception: Cannot execute transactional method because we are in an error state

[ https://issues.apache.org/jira/browse/KAFKA-6237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6237. Resolution: Duplicate Thanks for reporting this. It is a duplicate and the issue is fixed in

[jira] [Reopened] (KAFKA-6237) stream stopped working after exception: Cannot execute transactional method because we are in an error state

[ https://issues.apache.org/jira/browse/KAFKA-6237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-6237: > stream stopped working after exception: Cannot execute transactional method > because we are

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

Alright, here are some updates I'm planning to make after thinking on this for awhile: - Given that the "always continue" handler isn't something I'd recommend for production use as is, I'm going to move it into the test namespace and remove it from mention in the public API. - I'm goi

Re: [VOTE] KIP-224: Add configuration parameters `retries` to Streams API

Your understanding is correct and thanks for voting. I am also +1 :) I am closing this vote as accepted with 3 binding (Gwen, Guozhang, Damian) and 3 non-binding (Ted, Bill, Matthias) votes. -Matthias On 11/20/17 9:58 AM, Gwen Shapira wrote: > +1 > > My understanding is that the KIP is goin

[jira] [Created] (KAFKA-6247) Fix system test dependency issues

Colin P. McCabe created KAFKA-6247: -- Summary: Fix system test dependency issues Key: KAFKA-6247 URL: https://issues.apache.org/jira/browse/KAFKA-6247 Project: Kafka Issue Type: Bug

[GitHub] kafka pull request #4240: KAFKA-6247. Fix system test dependency issues

GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/4240 KAFKA-6247. Fix system test dependency issues Fix an omission where Kibosh was not getting installed on Vagrant instances running in AWS. Centralize test dependency versions in tests/ver

Re: [VOTE] KIP-159: Introducing Rich functions to Streams

@Jeyhun, I understand that the discussion about KIP-159 is dragging long, so while we are moving on discussion for whether / hows of KIP-159, maybe you can start implementing the non overlapping part of the APIs of KIP-149 to get you unblocked? Guozhang On Sun, Nov 19, 2017 at 12:12 PM, Guozhang

Re: [VOTE] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

+1 from myself as well. I'm closing this KIP as accepted with 3 binding votes (Gwen, Damian, me) and 3 non-binding votes (Colin, Ted, Matthias). Guozhang On Mon, Nov 20, 2017 at 9:56 AM, Damian Guy wrote: > +1 > > On Mon, 20 Nov 2017 at 17:52 Gwen Shapira wrote: > > > +1 > > > > Make sense.

[GitHub] kafka pull request #4211: KAFKA-6170; KIP-220 Part 1: Add AdminClient to Str...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4211 ---

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

Hi Ted, Thank you for reviewing the KIP. *Would decreasing network/IO threads be supported ?* Yes, As described in the KIP, some connections will be closed if network thread count is reduced (and reconnections will be processed on remaining threads) *What if some keys in configs are not in the S

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

bq. There is a --delete-config option Consider adding a sample with the above option to the KIP. Thanks On Mon, Nov 20, 2017 at 11:36 AM, Rajini Sivaram wrote: > Hi Ted, > > Thank you for reviewing the KIP. > > *Would decreasing network/IO threads be supported ?* > Yes, As described in the KIP

Re: [VOTE] KIP-159: Introducing Rich functions to Streams

On 19.11.2017 21:12, Guozhang Wang wrote: Jan: which approach are you referring to as "the approach that is on the table would be perfect"? The SourcesKStream/Table suggestion. Note that in today's PAPI layer we are already effectively exposing the record context which has the issues that we

Re: 答复: 答复: 答复: [DISCUSS]KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer

Hi, Hu, For the new partition level metrics that you are adding, it seems it's better to just add the topic/partition tag instead of using them in the prefix. For the existing lag metrics, we can fix them in KIP-225. Thanks, Jun On Sun, Nov 19, 2017 at 10:31 PM, Hu Xi wrote: > Jun, > > > Than

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

Ted, Have added an example for --delete-config. On Mon, Nov 20, 2017 at 7:42 PM, Ted Yu wrote: > bq. There is a --delete-config option > > Consider adding a sample with the above option to the KIP. > > Thanks > > On Mon, Nov 20, 2017 at 11:36 AM, Rajini Sivaram > wrote: > > > Hi Ted, > > > > T

Build failed in Jenkins: kafka-trunk-jdk7 #2984

See Changes: [wangguoz] KAFKA-6170; KIP-220 Part 1: Add AdminClient to Streams -- [...truncated 383.84 KB...] kafka.log.LogCleanerIntegrationTest > testCleansCombinedComp

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

Thanks for following up! One thought about an older reply from you: I strongly disagree here. The purpose of this handler isn't *just* to make a decision for streams. There may also be desirable side effects that users wish to cause when production exceptions occur. There may be >>

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

Thanks for the quick response. It seems the config following --delete-config should be quoted. Cheers On Mon, Nov 20, 2017 at 12:02 PM, Rajini Sivaram wrote: > Ted, > > Have added an example for --delete-config. > > On Mon, Nov 20, 2017 at 7:42 PM, Ted Yu wrote: > > > bq. There is a --delete-

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

I am moving this back to the DISCUSS thread... Last 10 emails were sent to VOTE thread. Copying Guozhang's last summary below. Thanks for this summary. Very comprehensive! It seems, we all agree, that the current implementation of the context at PAPI level is ok, but we should not leak it into DS

Re: [DISCUSS] KIP-213 Support non-key joining in KTable

Just list what each thing is: K0: key type of first/this table K1: key type of second/other table KO: key type of result table (concatenation of both input keys ) something like this (not sure it the example above is correct---it's just for illustration) -Matthias On 11/18/17 2:30 PM, Jan Fi

Build failed in Jenkins: kafka-trunk-jdk8 #2223

See Changes: [wangguoz] KAFKA-6170; KIP-220 Part 1: Add AdminClient to Streams -- [...truncated 3.32 MB...] kafka.security.auth.ResourceTypeTest > testJavaConversions STA

[GitHub] kafka pull request #4207: MINOR: Add HttpMetricsReporter for system tests

Github user ewencp closed the pull request at: https://github.com/apache/kafka/pull/4207 ---

[GitHub] kafka pull request #4241: KAFKA-4893: Fix conflict between async topic delet...

GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/4241 KAFKA-4893: Fix conflict between async topic deletion and max topic length With async topic deletion the topic partition folder name is affixed with a '.', a UUID, and '-delete'. If topic nam

Please give me jira access rights

Hello I want to try to contribute to the project. Please give me rights to work with issues in JIRA My Jira name is Panuwat Anawatmongkhon Thank you

[VOTE] KIP-219 - Improve Quota Communication

Hi, We would like to start the voting thread for KIP-219. The KIP proposes to improve the quota communication between the brokers and clients, especially for cases of long throttling time. The KIP wiki is following: https://cwiki.apache.org/confluence/display/KAFKA/KIP-219+-+Improve+quota+ commun

[GitHub] kafka pull request #4242: KAFKA-4857: [WIP] Replace StreamsKafkaClient with ...

GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/4242 KAFKA-4857: [WIP] Replace StreamsKafkaClient with AdminClient in Kafka Streams ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test

Build failed in Jenkins: kafka-0.11.0-jdk7 #338

See Changes: [me] MINOR: Add HttpMetricsReporter for system tests -- [...truncated 904.84 KB...] kafka.producer.AsyncProducerTest > testSerializeEvents STARTED kafka.pro

[GitHub] kafka pull request #4227: MINOR: Log unexpected exceptions in Connect REST c...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4227 ---

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

a remark of mine that got missed during migration: There is this problem that even though we have source.table.filter.join the state-fullness happens at the table step not a the join step. In a filter we still going to present change.oldValue to the filter even though the record context() is fo

Jenkins build is back to normal : kafka-trunk-jdk7 #2985

See

REPLY: [DISCUSS]KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer

Hi Jun, Seems the prefix that is used to be the unique Sensor name cannot be removed, so should we keep the prefix? 发件人: Jun Rao 发送时间: 2017年11月21日 3:55 收件人: dev@kafka.apache.org 主题: Re: 答复: 答复: 答复: [DISCUSS]KIP-223 - Add per-topic min lead and per-partition l

Build failed in Jenkins: kafka-trunk-jdk8 #2224

See Changes: [me] MINOR: Log unexpected exceptions in Connect REST calls that generate -- [...truncated 3.32 MB...] kafka.security.auth.ResourceTypeTest > testJavaConvers