Re: [VOTE] KIP-81: Bound Fetch memory usage in the consumer

Hi Mickael, I am +1 on the overall approach of this KIP, but have a couple of comments (sorry, should have brought them up on the discuss thread earlier): 1. Perhaps it would be better to do this after KAFKA-4137 is implemented? At the moment, co

[DISCUSS] KIP-99: Add Global Tables to Kafka Streams

Hi all, I would like to start the discussion on KIP-99: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=67633649 Looking forward to your feedback. Thanks, Damian

[jira] [Created] (KAFKA-4490) Add Global Table support to Kafka Streams

Damian Guy created KAFKA-4490: - Summary: Add Global Table support to Kafka Streams Key: KAFKA-4490 URL: https://issues.apache.org/jira/browse/KAFKA-4490 Project: Kafka Issue Type: New Feature

[jira] [Updated] (KAFKA-4490) Add Global Table support to Kafka Streams

[ https://issues.apache.org/jira/browse/KAFKA-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4490: -- Environment: (was: As per KIP-99 https://cwiki.apache.org/confluence/display/KAFKA/KIP-99%3A+Add+Glo

[jira] [Created] (KAFKA-4491) OOME when Java client can not connect to brokers

Gérald Quintana created KAFKA-4491: -- Summary: OOME when Java client can not connect to brokers Key: KAFKA-4491 URL: https://issues.apache.org/jira/browse/KAFKA-4491 Project: Kafka Issue Type

[jira] [Created] (KAFKA-4492) java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache

Damian Guy created KAFKA-4492: - Summary: java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache Key: KAFKA-4492 URL: https://issues.apache.org/jira/browse/KAFKA-4492 P

[jira] [Updated] (KAFKA-4490) Add Global Table support to Kafka Streams

[ https://issues.apache.org/jira/browse/KAFKA-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4490: -- Description: As per KIP-99 https://cwiki.apache.org/confluence/display/KAFKA/KIP-99%3A+Add+Global+Table

[jira] [Commented] (KAFKA-3038) Speeding up partition reassignment after broker failure

[ https://issues.apache.org/jira/browse/KAFKA-3038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725206#comment-15725206 ] ASF GitHub Bot commented on KAFKA-3038: --- GitHub user resetius opened a pull request:

[GitHub] kafka pull request #2213: KAFKA-3038; Future'based pseudo-async controller

GitHub user resetius opened a pull request: https://github.com/apache/kafka/pull/2213 KAFKA-3038; Future'based pseudo-async controller You can merge this pull request into a Git repository by running: $ git pull https://github.com/resetius/kafka KAFKA-3038-trunk Alternatively

[GitHub] kafka pull request #2214: KAFKA-1595; remove global lock from json parser

GitHub user resetius opened a pull request: https://github.com/apache/kafka/pull/2214 KAFKA-1595; remove global lock from json parser You can merge this pull request into a Git repository by running: $ git pull https://github.com/resetius/kafka KAFKA-1595-trunk Alternatively

[jira] [Commented] (KAFKA-1595) Remove deprecated and slower scala JSON parser from kafka.consumer.TopicCount

[ https://issues.apache.org/jira/browse/KAFKA-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725241#comment-15725241 ] ASF GitHub Bot commented on KAFKA-1595: --- GitHub user resetius opened a pull request:

[jira] [Created] (KAFKA-4493) Connections to Kafka brokers should be validated

Ismael Juma created KAFKA-4493: -- Summary: Connections to Kafka brokers should be validated Key: KAFKA-4493 URL: https://issues.apache.org/jira/browse/KAFKA-4493 Project: Kafka Issue Type: Improv

[jira] [Commented] (KAFKA-4472) offsetRetentionMs miscalculated in GroupCoordinator

[ https://issues.apache.org/jira/browse/KAFKA-4472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725269#comment-15725269 ] ASF GitHub Bot commented on KAFKA-4472: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-4472) offsetRetentionMs miscalculated in GroupCoordinator

[ https://issues.apache.org/jira/browse/KAFKA-4472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4472. Resolution: Fixed Fix Version/s: 0.10.2.0 Issue resolved by pull request 2200 [https://github

[GitHub] kafka pull request #2200: KAFKA-4472: offsetRetentionMs miscalculated in Gro...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2200 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[VOTE] KIP-94: Session Windows

Hi all, I'd like to start the vote for KIP-94: https://cwiki.apache.org/confluence/display/KAFKA/KIP-94+Session+Windows There is a PR for it here: https://github.com/apache/kafka/pull/2166 Thanks, Damian

[jira] [Resolved] (KAFKA-4489) Kafka Consumer throws Java Heap Out of Space Error on failed SSL connections

[ https://issues.apache.org/jira/browse/KAFKA-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4489. Resolution: Duplicate The OOM is not intentional. It's just that the PLAINTEXT protocol assumes a m

[jira] [Comment Edited] (KAFKA-4491) OOME when Java client can not connect to brokers

[ https://issues.apache.org/jira/browse/KAFKA-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725306#comment-15725306 ] Ismael Juma edited comment on KAFKA-4491 at 12/6/16 12:13 PM: --

[jira] [Commented] (KAFKA-4491) OOME when Java client can not connect to brokers

[ https://issues.apache.org/jira/browse/KAFKA-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725306#comment-15725306 ] Ismael Juma commented on KAFKA-4491: See KAFKA-4491. > OOME when Java client can not

[jira] [Commented] (KAFKA-4493) Connections to Kafka brokers should be validated

[ https://issues.apache.org/jira/browse/KAFKA-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725314#comment-15725314 ] Ismael Juma commented on KAFKA-4493: This is sort of a duplicate of KAFKA-2512 althoug

[jira] [Assigned] (KAFKA-3701) Expose KafkaStreams metrics in public API

[ https://issues.apache.org/jira/browse/KAFKA-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reassigned KAFKA-3701: --- Assignee: Eno Thereska > Expose KafkaStreams metrics in public API >

[jira] [Created] (KAFKA-4494) Significant startup delays in KStreams app

j yeargers created KAFKA-4494: - Summary: Significant startup delays in KStreams app Key: KAFKA-4494 URL: https://issues.apache.org/jira/browse/KAFKA-4494 Project: Kafka Issue Type: Bug Affect

[jira] [Work started] (KAFKA-3537) Provide access to low-level Metrics in ProcessorContext

[ https://issues.apache.org/jira/browse/KAFKA-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3537 started by Eno Thereska. --- > Provide access to low-level Metrics in ProcessorContext > ---

[jira] [Work started] (KAFKA-3701) Expose KafkaStreams metrics in public API

[ https://issues.apache.org/jira/browse/KAFKA-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3701 started by Eno Thereska. --- > Expose KafkaStreams metrics in public API > -

Kafka on Ubuntu Core and Snap store

Hello all, My name is Michael Hall, I work at Canonical on the community team, and recently I've been working with the snapcraft[1] developers to help upstreams learn about and start using our new packaging format. Yesterday I spent a couple of hours looking at Kafka and building an example .snap

[GitHub] kafka pull request #2215: KAFKA-3537: Expose metrics registry

GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/2215 KAFKA-3537: Expose metrics registry You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka KAFKA-3537-access-low-level-metrics

[jira] [Commented] (KAFKA-3537) Provide access to low-level Metrics in ProcessorContext

[ https://issues.apache.org/jira/browse/KAFKA-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725596#comment-15725596 ] ASF GitHub Bot commented on KAFKA-3537: --- GitHub user enothereska opened a pull reque

[jira] [Commented] (KAFKA-3537) Provide access to low-level Metrics in ProcessorContext

[ https://issues.apache.org/jira/browse/KAFKA-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725600#comment-15725600 ] Eno Thereska commented on KAFKA-3537: - Note PR only exposes metrics to be consumed as

[jira] [Commented] (KAFKA-3537) Provide access to low-level Metrics in ProcessorContext

[ https://issues.apache.org/jira/browse/KAFKA-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725609#comment-15725609 ] Eno Thereska commented on KAFKA-3537: - [~mdcoon1] could you have a look at PR. Sorry f

[GitHub] kafka pull request #2199: HOTFIX: Temporary suspension of 2 tests

GitHub user enothereska reopened a pull request: https://github.com/apache/kafka/pull/2199 HOTFIX: Temporary suspension of 2 tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka hotfix-streams-test-reset-ignor

[jira] [Commented] (KAFKA-4493) Connections to Kafka brokers should be validated

[ https://issues.apache.org/jira/browse/KAFKA-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725713#comment-15725713 ] Gérald Quintana commented on KAFKA-4493: See also KAFKA-4491 > Connections to Kaf

[GitHub] kafka pull request #2216: MINOR: Upgrade Gradle to 3.2.1 and Scala to 2.12.1

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2216 MINOR: Upgrade Gradle to 3.2.1 and Scala to 2.12.1 There were a couple of important issues fixed in Gradle 3.2.1: * [GRADLE-3582] - Gradle wrapper fails to escape arguments with nested quotes

[GitHub] kafka pull request #2199: HOTFIX: Temporary suspension of 2 tests

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2199 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #1081

See Changes: [ismael] KAFKA-4472; offsetRetentionMs miscalculated in GroupCoordinator -- [...truncated 16005 lines...] org.apache.kafka.connect.runtime.WorkerTest > testAddConnectorByShortAlias

Re: [VOTE] KIP-94: Session Windows

+1 (non-binding) Thanks Eno > On 6 Dec 2016, at 12:09, Damian Guy wrote: > > Hi all, > > I'd like to start the vote for KIP-94: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-94+Session+Windows > > There is a PR for it here: https://github.com/apache/kafka/pull/2166 > > Thanks, > Dam

[jira] [Updated] (KAFKA-4492) java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache

[ https://issues.apache.org/jira/browse/KAFKA-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4492: -- Description: This follows on from https://issues.apache.org/jira/browse/KAFKA-4311 The exception seems

RE: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Is there a way that this functionality could be added as an extension to the Producer API, rather than adding extra complexity to the existing interface for those who don't need it. Maybe introduce a TransactionalProducer interface in addition to the existing Producer interface? Thanks, Jonathan

Build failed in Jenkins: kafka-trunk-jdk7 #1732

See Changes: [ismael] KAFKA-4472; offsetRetentionMs miscalculated in GroupCoordinator -- [...truncated 14247 lines...] org.apache.kafka.streams.processor.TopologyBuilderTest > shouldNotAllowNu

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Hey Guozhang, 1. My point is that it is a bit confusing to have two things called application id that have different meanings, right? Won't the streams user end up specifying two different application ids? 2. Makes sense. My two complaints are 1. At this point we've jumped throu

[jira] [Created] (KAFKA-4495) ThreadCache.maybeEvict can become an infinite loop

Damian Guy created KAFKA-4495: - Summary: ThreadCache.maybeEvict can become an infinite loop Key: KAFKA-4495 URL: https://issues.apache.org/jira/browse/KAFKA-4495 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Hi Jun do we have your vote on this now? Any other concerns? Cheers Mike Sent using OWA for iPhone From: Michael Pearce Sent: Saturday, December 3, 2016 1:37:45 AM To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag Hi J

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

For dealing with exactly once delivery. As an alternative option has it been considered to have a message uuid in the record, that then is deduped on consumption? Similar to https://activemq.apache.org/artemis/docs/1.0.0/duplicate-detection.html Agreed this does not deal with transaction suppor

Re: [VOTE] KIP-94: Session Windows

+1 On 12/6/16 7:40 AM, Eno Thereska wrote: > +1 (non-binding) > > Thanks > Eno >> On 6 Dec 2016, at 12:09, Damian Guy wrote: >> >> Hi all, >> >> I'd like to start the vote for KIP-94: >> https://cwiki.apache.org/confluence/display/KAFKA/KIP-94+Session+Windows >> >> There is a PR for it here: htt

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

Thanks for the KIP, I can see this being useful when investigating consumer issues +1 On Mon, Dec 5, 2016 at 6:16 PM, Vahid S Hashemian wrote: > Happy Monday, > > I'd like to start voting on KIP-88 ( > https://cwiki.apache.org/confluence/display/KAFKA/KIP-88%3A+OffsetFetch+Protocol+Update > ). >

[jira] [Resolved] (KAFKA-4495) ThreadCache.maybeEvict can become an infinite loop

[ https://issues.apache.org/jira/browse/KAFKA-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-4495. --- Resolution: Invalid > ThreadCache.maybeEvict can become an infinite loop > ---

[jira] [Updated] (KAFKA-4492) java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache

[ https://issues.apache.org/jira/browse/KAFKA-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4492: -- Description: This follows on from https://issues.apache.org/jira/browse/KAFKA-4311 The exception seems

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Hi, Michael, 4. Is this updated in the wiki? The text "If the magic byte on message is 2, the broker should use the tombstone bit for log compaction." doesn't seem to have changed. 2. My point is that if we change the message format just for this KIP, we should consider whether it's worth optimiz

[jira] [Created] (KAFKA-4496) LogCleaner thread exits with NoSuchElementException

Mark Figura created KAFKA-4496: -- Summary: LogCleaner thread exits with NoSuchElementException Key: KAFKA-4496 URL: https://issues.apache.org/jira/browse/KAFKA-4496 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Hi Jun, Re 4) That's because we expect the tombstone value to be set correctly if message bit is 2, as such if an older client sends in on old message the message is upcast and the bit is set correctly. And such no longer need to check the value. Mayuresh can you confirm my thinking and underst

[jira] [Updated] (KAFKA-4485) Follower should be in the isr if its FetchRequest has fetched up to the logEndOffset of leader

[ https://issues.apache.org/jira/browse/KAFKA-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-4485: Affects Version/s: 0.10.1.0 Reviewer: Jiangjie Qin Fix Version/s: 0.10.2.0 > Fo

Jenkins build is back to normal : kafka-trunk-jdk7 #1733

See

Build failed in Jenkins: kafka-trunk-jdk8 #1082

See Changes: [ismael] HOTFIX: Temporary suspension of 2 tests -- [...truncated 15921 lines...] org.apache.kafka.connect.runtime.rest.resources.ConnectorPluginsResourceTest > testValidateConfig

Re: [DISCUSS] KIP-82 - Add Record Headers

Hi, Michael, Thanks for the reply. I find it very helpful. Data lineage: 100. I'd like to understand the APM use case a bit more. It sounds like that those APM plugins can generate a transaction id that we could potentially put in the header of every message. How would you typically make use of s

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Hi, Michael, 4. Hmm, does that mean the new client library can never send a null message even to a regular topic? This seems like a change of the existing behavior. Thanks, Jun On Tue, Dec 6, 2016 at 9:51 AM, Michael Pearce wrote: > Hi Jun, > > Re 4) That's because we expect the tombstone val

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Not at all. This only acts on compacted topics just as what occurs today Sent using OWA for iPhone From: Jun Rao Sent: Tuesday, December 6, 2016 6:25:28 PM To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag Hi, Michael,

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

@Jay 1. I totally agree on the naming. The appid for transactions is really an instance id. Any recommendation for a name is appreciated. We had thought of instance id, session id or app id and went with app id. 2. We also discussed about init() method but that could add its own set of confusion t

Re: [VOTE] KIP-96 - Add per partition metrics for in-sync and replica count

KIP-96 passed with +3 binding and +3 non-binding votes. Thanks everyone! On Mon, Dec 5, 2016 at 6:24 AM Bill Bejeck wrote: +1 On Mon, Dec 5, 2016 at 8:07 AM, Ismael Juma wrote: > Thanks for the KIP, +1 (binding). > > Ismael > > On Thu, Dec 1, 2016 at 12:59 PM, Tom Crayford > wrote: > > > +1

[GitHub] kafka pull request #2212: KAFKA-4488: UnsupportedOperationException during i...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2212 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-4488) UnsupportedOperationException during initialization of StandbyTask

[ https://issues.apache.org/jira/browse/KAFKA-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4488. -- Resolution: Fixed Fix Version/s: (was: 0.10.1.1) 0.10.2.0 Issue re

[jira] [Commented] (KAFKA-4488) UnsupportedOperationException during initialization of StandbyTask

[ https://issues.apache.org/jira/browse/KAFKA-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726509#comment-15726509 ] ASF GitHub Bot commented on KAFKA-4488: --- Github user asfgit closed the pull request

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Hi, Michael, 4. Then, I think I misunderstood this point. Could you document the following points in the wiki? 4.1 If producer V3 sets tombstone, but provides a non-null value, does the send() get an error or does the producer automatically set the value to null? 4.2 If producer V3 doesn't set tom

[jira] [Updated] (KAFKA-4488) UnsupportedOperationException during initialization of StandbyTask

[ https://issues.apache.org/jira/browse/KAFKA-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4488: - Fix Version/s: 0.10.1.1 > UnsupportedOperationException during initialization of StandbyTask > ---

Re: [DISCUSS] 0.10.1.1 Plan

Status Update: All tasks marked for 0.10.1.1 as been resolved, will start the release process right away. Guozhang On Fri, Dec 2, 2016 at 1:01 PM, Guozhang Wang wrote: > @Sean, > > There have been some discussions about KAFKA-4250, from Ismael. The main > concern is on backward compatibility

[GitHub] kafka pull request #2217: HOTFIX: Disable test until fixed

GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/2217 HOTFIX: Disable test until fixed You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka hotfix-disable-smoke-test Alternatively

[GitHub] kafka pull request #2218: KAFKA-4480: Report an error in 'kafka-configs' com...

GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/2218 KAFKA-4480: Report an error in 'kafka-configs' command if the config to be removed does not exist You can merge this pull request into a Git repository by running: $ git pull https://g

[jira] [Commented] (KAFKA-4480) kafka-configs will execute the removal of an invalid property and not report an error

[ https://issues.apache.org/jira/browse/KAFKA-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726634#comment-15726634 ] ASF GitHub Bot commented on KAFKA-4480: --- GitHub user vahidhashemian opened a pull re

[jira] [Created] (KAFKA-4497) log cleaner breaks on timeindex

Robert Schumann created KAFKA-4497: -- Summary: log cleaner breaks on timeindex Key: KAFKA-4497 URL: https://issues.apache.org/jira/browse/KAFKA-4497 Project: Kafka Issue Type: Bug C

[jira] [Commented] (KAFKA-4497) log cleaner breaks on timeindex

[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726651#comment-15726651 ] Ismael Juma commented on KAFKA-4497: cc [~becket_qin] > log cleaner breaks on timeind

[jira] [Updated] (KAFKA-4480) kafka-configs will execute the removal of an invalid property and not report an error

[ https://issues.apache.org/jira/browse/KAFKA-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-4480: --- Status: Patch Available (was: Open) > kafka-configs will execute the removal of an invalid pr

[GitHub] kafka pull request #2219: HOTFIX: Disable this test until it's fixed (0.10.1...

GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/2219 HOTFIX: Disable this test until it's fixed (0.10.1) You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka 0.10.1-hotfix-disable

[jira] [Resolved] (KAFKA-4496) LogCleaner thread exits with NoSuchElementException

[ https://issues.apache.org/jira/browse/KAFKA-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4496. Resolution: Fixed The code changed a lot since 0.8.2.1 and it no longer contains an `Iterator.toSeq

Re: Extending KStream DSL in applications

Hi, personally, I do not see a good reason to change it. I guess, the simplest thing for you to do is, to patch the code in a private repo and build the library by yourself. That's the beauty of open source :) -Matthias On 12/3/16 8:44 PM, Mathieu Fenniak wrote: > Hello devs, > > I'd like to

Jenkins build is back to normal : kafka-trunk-jdk8 #1083

See

[GitHub] kafka pull request #2220: MINOR: Update ducktape version to 0.5.3

GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/2220 MINOR: Update ducktape version to 0.5.3 You can merge this pull request into a Git repository by running: $ git pull https://github.com/ewencp/kafka update-ducktape Alternatively you can revie

Re: [DISCUSS] KIP-94: Session Windows

1. Looks good. Thanks for the explanation. We can add some comments in the javadoc that this is normally not needed for app programmers, but only for the framework developers. 2. Thanks! On Mon, Dec 5, 2016 at 2:21 AM, Damian Guy wrote: > Hi Guozhang, > > Thanks for the feedback. > > 1. If we w

Re: [VOTE] KIP-94: Session Windows

+1 (binding) On Tue, Dec 6, 2016 at 9:07 AM, Matthias J. Sax wrote: > +1 > > On 12/6/16 7:40 AM, Eno Thereska wrote: > > +1 (non-binding) > > > > Thanks > > Eno > >> On 6 Dec 2016, at 12:09, Damian Guy wrote: > >> > >> Hi all, > >> > >> I'd like to start the vote for KIP-94: > >> https://cwiki.

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

Thanks for the KIP Damian. Very nice motivating example! A few comments: - why is there no outer-join for GlobalKTables - on bootstrapping GlobalKTable, could it happen that this never finishes if the application fails before bootstrapping finishes and new data gets written at the same time? Do

[GitHub] kafka pull request #2220: MINOR: Update ducktape version to 0.5.3

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2220 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #2201: KAFKA-4306: Shutdown distributed herder with a tim...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2201 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-4306) Connect workers won't shut down if brokers are not available

[ https://issues.apache.org/jira/browse/KAFKA-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4306. -- Resolution: Fixed Fix Version/s: 0.10.2.0 Issue resolved by pull request

[jira] [Commented] (KAFKA-4306) Connect workers won't shut down if brokers are not available

[ https://issues.apache.org/jira/browse/KAFKA-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726940#comment-15726940 ] ASF GitHub Bot commented on KAFKA-4306: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-4154) Kafka Connect fails to shutdown if it has not completed startup

[ https://issues.apache.org/jira/browse/KAFKA-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4154. -- Resolution: Fixed Reviewer: Ewen Cheslack-Postava Fix Version/s:

Re: [DISCUSS] KIP-95: Incremental Batch Processing for Kafka Streams

Thanks for the input Jay. From my understanding, your question boils down to how fuzzy the stop point can/should be, and what guarantees we want to provide to the user. This has multiple dimension: 1. Using a timestamp has the main issue, that if an input topic has no data with this timestamp, t

[jira] [Commented] (KAFKA-4442) Controller should grab lock when it is being initialized to avoid race condition

[ https://issues.apache.org/jira/browse/KAFKA-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726975#comment-15726975 ] ASF GitHub Bot commented on KAFKA-4442: --- Github user lindong28 closed the pull reque

[GitHub] kafka pull request #2167: KAFKA-4442; Controller should grab lock when it is...

Github user lindong28 closed the pull request at: https://github.com/apache/kafka/pull/2167 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[jira] [Resolved] (KAFKA-4442) Controller should grab lock when it is being initialized to avoid race condition

[ https://issues.apache.org/jira/browse/KAFKA-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-4442. - Resolution: Invalid This patch is not needed because controller already has the lock when it is executing

Re: [VOTE] KIP-94: Session Windows

+1 On Tue, Dec 6, 2016 at 4:55 PM, Guozhang Wang wrote: > +1 (binding) > > On Tue, Dec 6, 2016 at 9:07 AM, Matthias J. Sax > wrote: > > > +1 > > > > On 12/6/16 7:40 AM, Eno Thereska wrote: > > > +1 (non-binding) > > > > > > Thanks > > > Eno > > >> On 6 Dec 2016, at 12:09, Damian Guy wrote: > >

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Thanks for this! I'm looking forward to going through the full proposal in detail soon; a few early questions: First: what happens when a consumer rebalances in the middle of a transaction? The full documentation suggests that such a transaction ought to be rejected: > [...] if a rebalance has ha

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Hey Jay, The expiration of PIDs is tied to the retention of each partition. Once a PID "falls off the log," then it is considered expired for that partition and we take it out of the sequence table. This is intuitive because we always consider the log as the source of truth for the PID sequence ma

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Hi Ben, Those are both great questions. I will tackle the second one now, and address the first one a bit later. AppIds are prerequisite for using transactions, and must be consistent across across application sessions. They are the mechanism by which transaction recovery can occur across session

Re: [VOTE] KIP-94: Session Windows

+1 binding -Ewen On Tue, Dec 6, 2016 at 3:21 PM, Bill Bejeck wrote: > +1 > > On Tue, Dec 6, 2016 at 4:55 PM, Guozhang Wang wrote: > > > +1 (binding) > > > > On Tue, Dec 6, 2016 at 9:07 AM, Matthias J. Sax > > wrote: > > > > > +1 > > > > > > On 12/6/16 7:40 AM, Eno Thereska wrote: > > > > +1 (

Re: [VOTE] KIP-94: Session Windows

+1 (binding) On Tue, Dec 6, 2016 at 3:43 PM, Ewen Cheslack-Postava wrote: > +1 binding > > -Ewen > > On Tue, Dec 6, 2016 at 3:21 PM, Bill Bejeck wrote: > > > +1 > > > > On Tue, Dec 6, 2016 at 4:55 PM, Guozhang Wang > wrote: > > > > > +1 (binding) > > > > > > On Tue, Dec 6, 2016 at 9:07 AM, Mat

[GitHub] kafka pull request #2217: HOTFIX: Disable test until fixed

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2217 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4458) Add per partition metrics for in-sync and assigned replica count

[ https://issues.apache.org/jira/browse/KAFKA-4458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4458: --- Resolution: Fixed Fix Version/s: 0.10.2.0 Status: Resolved (was: Patch Available) I

[GitHub] kafka pull request #2186: KAFKA-4458 add per partition in-sync and assigned ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2186 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4458) Add per partition metrics for in-sync and assigned replica count

[ https://issues.apache.org/jira/browse/KAFKA-4458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727206#comment-15727206 ] ASF GitHub Bot commented on KAFKA-4458: --- Github user asfgit closed the pull request

Re: Is kafka mesos framework still supported? Is there any official kafka docker images?

On Thu, Nov 24, 2016, at 00:45, Yu Wei wrote: > Hi guys, > > > I found kafka mesos framework on https://github.com/mesos/kafka. > > Is it still maintained? Hi Yu Wei, Keep in mind the code you linked to is not part of the Apache Kafka code base. I'm not completely sure who the maintainers are

[jira] [Created] (KAFKA-4498) Extract Streams section as a separate page from documentation.html

Guozhang Wang created KAFKA-4498: Summary: Extract Streams section as a separate page from documentation.html Key: KAFKA-4498 URL: https://issues.apache.org/jira/browse/KAFKA-4498 Project: Kafka

[GitHub] kafka-site pull request #35: KAFKA-4498: [DO NOT MERGE] add rewrite rule for...

GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka-site/pull/35 KAFKA-4498: [DO NOT MERGE] add rewrite rule for streams For @derrickdoo to review and take over. Add the rule to avoid rewrite with [version]/documentation#streams_[any] Add

[jira] [Commented] (KAFKA-4498) Extract Streams section as a separate page from documentation.html

[ https://issues.apache.org/jira/browse/KAFKA-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727259#comment-15727259 ] ASF GitHub Bot commented on KAFKA-4498: --- GitHub user guozhangwang opened a pull requ

  1   2   >