[DISCUSS] KIP-308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides configs

Hi all, I have created a KIP to add support for dynamic update of max.connections.per.ip/max.connections.per.ip.overrides configs *https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=85474993 * Any feedback i

Build failed in Jenkins: kafka-trunk-jdk10 #244

See Changes: [github] KAFKA-7082: Concurrent create topics may throw NodeExistsException [jason] KAFKA-4682; Revise expiration semantics of consumer group offsets -- [...

Build failed in Jenkins: kafka-1.1-jdk7 #153

See Changes: [ismael] KAFKA-7082: Concurrent create topics may throw NodeExistsException -- [...truncated 420.95 KB...] kafka.zookeeper.ZooKeeperClientTest > testGetChildrenE

Jenkins build is back to normal : kafka-trunk-jdk8 #2760

See

[jira] [Resolved] (KAFKA-7082) Concurrent createTopics calls may throw NodeExistsException

[ https://issues.apache.org/jira/browse/KAFKA-7082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-7082. Resolution: Fixed Reviewer: Jun Rao > Concurrent createTopics calls may throw NodeExistsExcep

Jenkins build is back to normal : kafka-0.10.2-jdk7 #220

See

Jenkins build is back to normal : kafka-1.0-jdk7 #211

See

Build failed in Jenkins: kafka-1.0-jdk7 #210

See Changes: [github] MINOR: Upgrade to Gradle 4.8.1 (#5265) -- [...truncated 1.85 MB...] org.apache.kafka.streams.processor.TopologyBuilderTest > testNamedTopicMatchesAlrea

Build failed in Jenkins: kafka-0.10.2-jdk7 #219

See Changes: [github] MINOR: Upgrade to Gradle 4.8.1 (#5267) -- [...truncated 1.31 MB...] org.apache.kafka.streams.processor.internals.StreamThreadTest > shouldNotViolate

Build failed in Jenkins: kafka-trunk-jdk8 #2759

See Changes: [github] MINOR: Upgrade to Gradle 4.8.1 (#5263) -- [...truncated 870.09 KB...] kafka.zookeeper.ZooKeeperClientTest > testBlockOnRequestCompletionFromStateCha

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

I've updated the KIP and draft PR accordingly. On Thu, Jun 21, 2018 at 2:03 PM John Roesler wrote: > Interesting... I did not initially consider it because I didn't want to > have an impact on anyone's Streams apps, but now I see that unless > developers have subclassed `Windows`, the number of

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

bq. propose just to make it private +1 On Thu, Jun 21, 2018 at 12:03 PM, John Roesler wrote: > Interesting... I did not initially consider it because I didn't want to > have an impact on anyone's Streams apps, but now I see that unless > developers have subclassed `Windows`, the number of segme

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

Hi Ted, Ok, I also prefer it, and I find this reasoning compelling. Thanks, -John On Thu, Jun 21, 2018 at 3:40 AM Ted Yu wrote: > Window is a common term used in various streaming processing systems whose > unit is time unit. > > Segment doesn't seem to be as widely used in such context. > I t

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

Interesting... I did not initially consider it because I didn't want to have an impact on anyone's Streams apps, but now I see that unless developers have subclassed `Windows`, the number of segments would always be 3! There's one caveat to this, which I think was a mistake. The field `segments` i

Jenkins build is back to normal : kafka-trunk-jdk10 #243

See

Build failed in Jenkins: kafka-1.1-jdk7 #152

See Changes: [lindong28] MINOR: Upgrade to Gradle 4.8.1 -- [...truncated 419.35 KB...] kafka.server.epoch.LeaderEpochFileCacheTest > shouldNotClearAnythingIfOffsetToFirstOf

[jira] [Created] (KAFKA-7089) Extend `kafka-consumer-groups.sh` to show "beginning offsets"

Matthias J. Sax created KAFKA-7089: -- Summary: Extend `kafka-consumer-groups.sh` to show "beginning offsets" Key: KAFKA-7089 URL: https://issues.apache.org/jira/browse/KAFKA-7089 Project: Kafka

Re: [VOTE] 1.1.1 RC0

Thank you all for helping to test and vote for this release! Ismael: Certainly, I agree we should bump up the gradle version. I will prepare RC1 today. On Thu, Jun 21, 2018 at 7:05 AM, Ismael Juma wrote: > Thanks Dong. One issue that came up is that Gradle dependency resolution no > longer work

Build failed in Jenkins: kafka-0.10.1-jdk7 #138

See Changes: [github] MINOR: Upgrade to Gradle 4.8.1 (#5268) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H30 (ubuntu

Build failed in Jenkins: kafka-trunk-jdk10 #242

See Changes: [github] MINOR: Upgrade to Gradle 4.8.1 (#5263) -- [...truncated 1.53 MB...] kafka.coordinator.transaction.TransactionCoordinatorTest > shouldRespondWithSuc

Re: [DISCUSS] - KIP-314: KTable to GlobalKTable Bi-directional Join

Hi Guozhang *Re: Questions* *1)* I do not yet have a solution to this, but I also did not look that closely at it when I begun this KIP. I admit that I was unaware of exactly how the GlobalKTable worked alongside the KTable/KStream topologies. You mention "It means the two topologies will be merge

[jira] [Created] (KAFKA-7088) Kafka streams thread waits infinitely on transaction init

Lukasz Gluchowski created KAFKA-7088: Summary: Kafka streams thread waits infinitely on transaction init Key: KAFKA-7088 URL: https://issues.apache.org/jira/browse/KAFKA-7088 Project: Kafka

Re: [VOTE] 1.1.1 RC0

Thanks Dong. One issue that came up is that Gradle dependency resolution no longer works with Java 7 due to a minimum TLS version change in Maven Central. Gradle 4.8.1 solves the issue ( https://github.com/apache/kafka/pull/5263). This means that if someone tries to build from source with Java 7, i

Jenkins build is back to normal : kafka-2.0-jdk8 #50

See

[jira] [Created] (KAFKA-7087) Option in TopicCommand to report not preferred leaders

Viktor Somogyi created KAFKA-7087: - Summary: Option in TopicCommand to report not preferred leaders Key: KAFKA-7087 URL: https://issues.apache.org/jira/browse/KAFKA-7087 Project: Kafka Issue

Build failed in Jenkins: kafka-trunk-jdk8 #2758

See Changes: [github] MINOR: Update version for doc to 2.0.0 (#5262) -- [...truncated 434.33 KB...] kafka.zookeeper.ZooKeeperClientTest > testBlockOnRequestCompletionFrom

Re: [VOTE] 2.0.0 RC0

Sorry, the documentation does go live with the RC (thanks to Ismael for pointing this out), so here are the links: * Documentation: http://kafka.apache.org/20/documentation.html * Protocol: http://kafka.apache.org/20/protocol.html Regards, Rajini On Wed, Jun 20, 2018 at 9:08 PM, Rajini

[jira] [Created] (KAFKA-7086) Kafka server process dies after try deleting old log files under Windows 10

Cezary Wagner created KAFKA-7086: Summary: Kafka server process dies after try deleting old log files under Windows 10 Key: KAFKA-7086 URL: https://issues.apache.org/jira/browse/KAFKA-7086 Project: Ka

Build failed in Jenkins: kafka-2.0-jdk8 #49

See Changes: [rajinisivaram] KAFKA-6800: Update SASL/PLAIN and SCRAM docs to use KIP-86 callbacks -- [...truncated 433.19 KB...] kafka.controller.PartitionStateMachineTest >

[jira] [Created] (KAFKA-7085) Producer hangs on TimeoutException: Failed to update metadata after 60000 ms.

Martin Vysny created KAFKA-7085: --- Summary: Producer hangs on TimeoutException: Failed to update metadata after 6 ms. Key: KAFKA-7085 URL: https://issues.apache.org/jira/browse/KAFKA-7085 Project: Ka

Re: [DISCUSS] KIP-317: Transparent Data Encryption

Hi Sönke, Compressing before encrypting has its dangers as well. Suppose you have a known compression format which adds a magic header and you're using a block cipher with a small enough block, then it becomes much easier to figure out the encryption key. For instance you can look at Snappy's stre

Re: [VOTE] 1.1.1 RC0

+1 (non-binding) Using kafka_2.12-1.1.1.tgz, I ran quick start and checked signatures On Thu, Jun 21, 2018 at 10:35 AM, Manikumar wrote: > +1 (non-binding) Ran test, Verified quick start, producer/consumer perf > tests > > On Thu, Jun 21, 2018 at 11:58 AM zhenya Sun wrote: > >> +1 non-binding

Re: [VOTE] 1.1.1 RC0

+1 (non-binding) Ran test, Verified quick start, producer/consumer perf tests On Thu, Jun 21, 2018 at 11:58 AM zhenya Sun wrote: > +1 non-binding > > > 在 2018年6月21日，下午2:18，Andras Beni 写道： > > > > +1 (non-binding) > > > > Built .tar.gz, created a cluster from it and ran a basic end-to-end tes

Re: [VOTE] 1.1.1 RC0

+1 (non-binding) - Ran testAll/releaseTarGzAll on 1.1.0-rc0 tag - Ran through quickstart of core/streams on builds. Thanks, Satish. On Thu, Jun 21, 2018 at 11:51 AM, zhenya Sun wrote: > +1 non-binding > > > 在 2018年6月21日，下午2:18，Andras Beni 写道： > > > > +1 (non-binding) > > > > Built .tar.gz, c

[jira] [Created] (KAFKA-7084) NewTopicBuilder#config should accept Map rather than Map

Chia-Ping Tsai created KAFKA-7084: - Summary: NewTopicBuilder#config should accept Map rather than Map Key: KAFKA-7084 URL: https://issues.apache.org/jira/browse/KAFKA-7084 Project: Kafka Iss

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

Window is a common term used in various streaming processing systems whose unit is time unit. Segment doesn't seem to be as widely used in such context. I think using interval in the method name would clearly convey the meaning intuitively. Thanks On Wed, Jun 20, 2018 at 1:31 PM, John Roesler