[GitHub] kafka pull request #2223: Update `createFile` function of Uitls.scala

GitHub user Allianzcortex opened a pull request: https://github.com/apache/kafka/pull/2223 Update `createFile` function of Uitls.scala Well,Now I'm reading the source code and try to learn better Scala:-D.The question I find is sometimes obvious,If I try to create file with out cert

[jira] [Commented] (KAFKA-4500) Code Corrections

[ https://issues.apache.org/jira/browse/KAFKA-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727974#comment-15727974 ] ASF GitHub Bot commented on KAFKA-4500: --- GitHub user rekhajoshm opened a pull reques

[GitHub] kafka pull request #2222: KAFKA-4500: code corrections on client module

GitHub user rekhajoshm opened a pull request: https://github.com/apache/kafka/pull/ KAFKA-4500: code corrections on client module - Removed redundant modifiers, not needed String.format() - Removed unnecessary semicolon, additional assignment, inlined return - Added few

[jira] [Created] (KAFKA-4500) Code Corrections

Rekha Joshi created KAFKA-4500: -- Summary: Code Corrections Key: KAFKA-4500 URL: https://issues.apache.org/jira/browse/KAFKA-4500 Project: Kafka Issue Type: Improvement Components: clie

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Hi Ben, Now, on to your first question of how deal with consumer rebalances. The short answer is that the application needs to ensure that the the assignment of input partitions to appId is consistent across rebalances. For Kafka streams, they already ensure that the mapping of input partitions t

Jenkins build is back to normal : kafka-0.10.1-jdk7 #103

See

Build failed in Jenkins: kafka-trunk-jdk8 #1085

See Changes: [me] KAFKA-4306: Shutdown distributed herder with a timeout. [ismael] HOTFIX: Disable test until fixed [ismael] KAFKA-4458; add per partition in-sync and assigned replica count --

[jira] [Work started] (KAFKA-4468) Correctly calculate the window end timestamp after read from state stores

[ https://issues.apache.org/jira/browse/KAFKA-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4468 started by Bill Bejeck. -- > Correctly calculate the window end timestamp after read from state stores > ---

[jira] [Created] (KAFKA-4499) Add "getAllKeys" API for querying windowed KTable stores

Matthias J. Sax created KAFKA-4499: -- Summary: Add "getAllKeys" API for querying windowed KTable stores Key: KAFKA-4499 URL: https://issues.apache.org/jira/browse/KAFKA-4499 Project: Kafka Is

Build failed in Jenkins: kafka-0.10.1-jdk7 #102

See Changes: [me] MINOR: Update ducktape version to 0.5.3 -- [...truncated 12370 lines...] val (authorizedRequestInfo, unauthorizedRequestInfo) = offsetRequest.offsetData.asScala.partition

[GitHub] kafka pull request #2221: MINOR: fix metric collection NPE during shutdown

GitHub user xvrl opened a pull request: https://github.com/apache/kafka/pull/2221 MINOR: fix metric collection NPE during shutdown collecting socket server metrics during shutdown may throw NullPointerException You can merge this pull request into a Git repository by running:

Re: any plans to switch to java 8?

Hi Colin, Indeed, Hadoop was one of a few projects I mentioned in the original thread. When is Hadoop 3 expected to be stable? Examples are Cassandra[4], Lucene[5], Akka[6], Hadoop 3[7], > Jetty[8], Eclipse[9], IntelliJ[10] and many others[11]. Even Android will > support Java 8 in the next versi

Build failed in Jenkins: kafka-trunk-jdk8 #1084

See Changes: [me] MINOR: Update ducktape version to 0.5.3 -- [...truncated 15898 lines...] org.apache.kafka.connect.runtime.rest.resources.ConnectorsResourceTest > testDeleteConnector STARTED

Re: any plans to switch to java 8?

Interestingly, Hadoop 3.x will require Java 8 or later. >From http://hadoop.apache.org/docs/r3.0.0-alpha1/ > Minimum required Java version increased from Java 7 to Java 8 > All Hadoop JARs are now compiled targeting a runtime version of Java 8. Users > still > using Java 7 or below must upgrade t

[jira] [Commented] (KAFKA-4498) Extract Streams section as a separate page from documentation.html

[ https://issues.apache.org/jira/browse/KAFKA-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727288#comment-15727288 ] ASF GitHub Bot commented on KAFKA-4498: --- Github user guozhangwang commented on the i

[GitHub] kafka-site issue #35: KAFKA-4498: [DO NOT MERGE] add rewrite rule for stream...

Github user guozhangwang commented on the issue: https://github.com/apache/kafka-site/pull/35 Actually thinking about it a bit more, for versioned address we could still apply the rule for all versions. And any old versions that does not have the streams section, the hashtag will neve

[jira] [Commented] (KAFKA-4498) Extract Streams section as a separate page from documentation.html

[ https://issues.apache.org/jira/browse/KAFKA-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727259#comment-15727259 ] ASF GitHub Bot commented on KAFKA-4498: --- GitHub user guozhangwang opened a pull requ

[GitHub] kafka-site pull request #35: KAFKA-4498: [DO NOT MERGE] add rewrite rule for...

GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka-site/pull/35 KAFKA-4498: [DO NOT MERGE] add rewrite rule for streams For @derrickdoo to review and take over. Add the rule to avoid rewrite with [version]/documentation#streams_[any] Add

[jira] [Created] (KAFKA-4498) Extract Streams section as a separate page from documentation.html

Guozhang Wang created KAFKA-4498: Summary: Extract Streams section as a separate page from documentation.html Key: KAFKA-4498 URL: https://issues.apache.org/jira/browse/KAFKA-4498 Project: Kafka

Re: Is kafka mesos framework still supported? Is there any official kafka docker images?

On Thu, Nov 24, 2016, at 00:45, Yu Wei wrote: > Hi guys, > > > I found kafka mesos framework on https://github.com/mesos/kafka. > > Is it still maintained? Hi Yu Wei, Keep in mind the code you linked to is not part of the Apache Kafka code base. I'm not completely sure who the maintainers are

[jira] [Commented] (KAFKA-4458) Add per partition metrics for in-sync and assigned replica count

[ https://issues.apache.org/jira/browse/KAFKA-4458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727206#comment-15727206 ] ASF GitHub Bot commented on KAFKA-4458: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #2186: KAFKA-4458 add per partition in-sync and assigned ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2186 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4458) Add per partition metrics for in-sync and assigned replica count

[ https://issues.apache.org/jira/browse/KAFKA-4458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4458: --- Resolution: Fixed Fix Version/s: 0.10.2.0 Status: Resolved (was: Patch Available) I

[GitHub] kafka pull request #2217: HOTFIX: Disable test until fixed

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2217 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [VOTE] KIP-94: Session Windows

+1 (binding) On Tue, Dec 6, 2016 at 3:43 PM, Ewen Cheslack-Postava wrote: > +1 binding > > -Ewen > > On Tue, Dec 6, 2016 at 3:21 PM, Bill Bejeck wrote: > > > +1 > > > > On Tue, Dec 6, 2016 at 4:55 PM, Guozhang Wang > wrote: > > > > > +1 (binding) > > > > > > On Tue, Dec 6, 2016 at 9:07 AM, Mat

Re: [VOTE] KIP-94: Session Windows

+1 binding -Ewen On Tue, Dec 6, 2016 at 3:21 PM, Bill Bejeck wrote: > +1 > > On Tue, Dec 6, 2016 at 4:55 PM, Guozhang Wang wrote: > > > +1 (binding) > > > > On Tue, Dec 6, 2016 at 9:07 AM, Matthias J. Sax > > wrote: > > > > > +1 > > > > > > On 12/6/16 7:40 AM, Eno Thereska wrote: > > > > +1 (

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Hi Ben, Those are both great questions. I will tackle the second one now, and address the first one a bit later. AppIds are prerequisite for using transactions, and must be consistent across across application sessions. They are the mechanism by which transaction recovery can occur across session

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Hey Jay, The expiration of PIDs is tied to the retention of each partition. Once a PID "falls off the log," then it is considered expired for that partition and we take it out of the sequence table. This is intuitive because we always consider the log as the source of truth for the PID sequence ma

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Thanks for this! I'm looking forward to going through the full proposal in detail soon; a few early questions: First: what happens when a consumer rebalances in the middle of a transaction? The full documentation suggests that such a transaction ought to be rejected: > [...] if a rebalance has ha

Re: [VOTE] KIP-94: Session Windows

+1 On Tue, Dec 6, 2016 at 4:55 PM, Guozhang Wang wrote: > +1 (binding) > > On Tue, Dec 6, 2016 at 9:07 AM, Matthias J. Sax > wrote: > > > +1 > > > > On 12/6/16 7:40 AM, Eno Thereska wrote: > > > +1 (non-binding) > > > > > > Thanks > > > Eno > > >> On 6 Dec 2016, at 12:09, Damian Guy wrote: > >

[jira] [Resolved] (KAFKA-4442) Controller should grab lock when it is being initialized to avoid race condition

[ https://issues.apache.org/jira/browse/KAFKA-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-4442. - Resolution: Invalid This patch is not needed because controller already has the lock when it is executing

[jira] [Commented] (KAFKA-4442) Controller should grab lock when it is being initialized to avoid race condition

[ https://issues.apache.org/jira/browse/KAFKA-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726975#comment-15726975 ] ASF GitHub Bot commented on KAFKA-4442: --- Github user lindong28 closed the pull reque

[GitHub] kafka pull request #2167: KAFKA-4442; Controller should grab lock when it is...

Github user lindong28 closed the pull request at: https://github.com/apache/kafka/pull/2167 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

Re: [DISCUSS] KIP-95: Incremental Batch Processing for Kafka Streams

Thanks for the input Jay. From my understanding, your question boils down to how fuzzy the stop point can/should be, and what guarantees we want to provide to the user. This has multiple dimension: 1. Using a timestamp has the main issue, that if an input topic has no data with this timestamp, t

[jira] [Resolved] (KAFKA-4154) Kafka Connect fails to shutdown if it has not completed startup

[ https://issues.apache.org/jira/browse/KAFKA-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4154. -- Resolution: Fixed Reviewer: Ewen Cheslack-Postava Fix Version/s:

[jira] [Resolved] (KAFKA-4306) Connect workers won't shut down if brokers are not available

[ https://issues.apache.org/jira/browse/KAFKA-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4306. -- Resolution: Fixed Fix Version/s: 0.10.2.0 Issue resolved by pull request

[jira] [Commented] (KAFKA-4306) Connect workers won't shut down if brokers are not available

[ https://issues.apache.org/jira/browse/KAFKA-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726940#comment-15726940 ] ASF GitHub Bot commented on KAFKA-4306: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #2201: KAFKA-4306: Shutdown distributed herder with a tim...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2201 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #2220: MINOR: Update ducktape version to 0.5.3

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2220 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [DISCUSS] KIP-99: Add Global Tables to Kafka Streams

Thanks for the KIP Damian. Very nice motivating example! A few comments: - why is there no outer-join for GlobalKTables - on bootstrapping GlobalKTable, could it happen that this never finishes if the application fails before bootstrapping finishes and new data gets written at the same time? Do

Re: [VOTE] KIP-94: Session Windows

+1 (binding) On Tue, Dec 6, 2016 at 9:07 AM, Matthias J. Sax wrote: > +1 > > On 12/6/16 7:40 AM, Eno Thereska wrote: > > +1 (non-binding) > > > > Thanks > > Eno > >> On 6 Dec 2016, at 12:09, Damian Guy wrote: > >> > >> Hi all, > >> > >> I'd like to start the vote for KIP-94: > >> https://cwiki.

Re: [DISCUSS] KIP-94: Session Windows

1. Looks good. Thanks for the explanation. We can add some comments in the javadoc that this is normally not needed for app programmers, but only for the framework developers. 2. Thanks! On Mon, Dec 5, 2016 at 2:21 AM, Damian Guy wrote: > Hi Guozhang, > > Thanks for the feedback. > > 1. If we w

[GitHub] kafka pull request #2220: MINOR: Update ducktape version to 0.5.3

GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/2220 MINOR: Update ducktape version to 0.5.3 You can merge this pull request into a Git repository by running: $ git pull https://github.com/ewencp/kafka update-ducktape Alternatively you can revie

Jenkins build is back to normal : kafka-trunk-jdk8 #1083

See

Re: Extending KStream DSL in applications

Hi, personally, I do not see a good reason to change it. I guess, the simplest thing for you to do is, to patch the code in a private repo and build the library by yourself. That's the beauty of open source :) -Matthias On 12/3/16 8:44 PM, Mathieu Fenniak wrote: > Hello devs, > > I'd like to

[jira] [Resolved] (KAFKA-4496) LogCleaner thread exits with NoSuchElementException

[ https://issues.apache.org/jira/browse/KAFKA-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4496. Resolution: Fixed The code changed a lot since 0.8.2.1 and it no longer contains an `Iterator.toSeq

[GitHub] kafka pull request #2219: HOTFIX: Disable this test until it's fixed (0.10.1...

GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/2219 HOTFIX: Disable this test until it's fixed (0.10.1) You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka 0.10.1-hotfix-disable

[jira] [Updated] (KAFKA-4480) kafka-configs will execute the removal of an invalid property and not report an error

[ https://issues.apache.org/jira/browse/KAFKA-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-4480: --- Status: Patch Available (was: Open) > kafka-configs will execute the removal of an invalid pr

[jira] [Commented] (KAFKA-4497) log cleaner breaks on timeindex

[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726651#comment-15726651 ] Ismael Juma commented on KAFKA-4497: cc [~becket_qin] > log cleaner breaks on timeind

[jira] [Created] (KAFKA-4497) log cleaner breaks on timeindex

Robert Schumann created KAFKA-4497: -- Summary: log cleaner breaks on timeindex Key: KAFKA-4497 URL: https://issues.apache.org/jira/browse/KAFKA-4497 Project: Kafka Issue Type: Bug C

[jira] [Commented] (KAFKA-4480) kafka-configs will execute the removal of an invalid property and not report an error

[ https://issues.apache.org/jira/browse/KAFKA-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726634#comment-15726634 ] ASF GitHub Bot commented on KAFKA-4480: --- GitHub user vahidhashemian opened a pull re

[GitHub] kafka pull request #2218: KAFKA-4480: Report an error in 'kafka-configs' com...

GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/2218 KAFKA-4480: Report an error in 'kafka-configs' command if the config to be removed does not exist You can merge this pull request into a Git repository by running: $ git pull https://g

[GitHub] kafka pull request #2217: HOTFIX: Disable test until fixed

GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/2217 HOTFIX: Disable test until fixed You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka hotfix-disable-smoke-test Alternatively

Re: [DISCUSS] 0.10.1.1 Plan

Status Update: All tasks marked for 0.10.1.1 as been resolved, will start the release process right away. Guozhang On Fri, Dec 2, 2016 at 1:01 PM, Guozhang Wang wrote: > @Sean, > > There have been some discussions about KAFKA-4250, from Ismael. The main > concern is on backward compatibility

[jira] [Updated] (KAFKA-4488) UnsupportedOperationException during initialization of StandbyTask

[ https://issues.apache.org/jira/browse/KAFKA-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4488: - Fix Version/s: 0.10.1.1 > UnsupportedOperationException during initialization of StandbyTask > ---

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Hi, Michael, 4. Then, I think I misunderstood this point. Could you document the following points in the wiki? 4.1 If producer V3 sets tombstone, but provides a non-null value, does the send() get an error or does the producer automatically set the value to null? 4.2 If producer V3 doesn't set tom

[jira] [Resolved] (KAFKA-4488) UnsupportedOperationException during initialization of StandbyTask

[ https://issues.apache.org/jira/browse/KAFKA-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4488. -- Resolution: Fixed Fix Version/s: (was: 0.10.1.1) 0.10.2.0 Issue re

[jira] [Commented] (KAFKA-4488) UnsupportedOperationException during initialization of StandbyTask

[ https://issues.apache.org/jira/browse/KAFKA-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726509#comment-15726509 ] ASF GitHub Bot commented on KAFKA-4488: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #2212: KAFKA-4488: UnsupportedOperationException during i...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2212 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [VOTE] KIP-96 - Add per partition metrics for in-sync and replica count

KIP-96 passed with +3 binding and +3 non-binding votes. Thanks everyone! On Mon, Dec 5, 2016 at 6:24 AM Bill Bejeck wrote: +1 On Mon, Dec 5, 2016 at 8:07 AM, Ismael Juma wrote: > Thanks for the KIP, +1 (binding). > > Ismael > > On Thu, Dec 1, 2016 at 12:59 PM, Tom Crayford > wrote: > > > +1

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

@Jay 1. I totally agree on the naming. The appid for transactions is really an instance id. Any recommendation for a name is appreciated. We had thought of instance id, session id or app id and went with app id. 2. We also discussed about init() method but that could add its own set of confusion t

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Not at all. This only acts on compacted topics just as what occurs today Sent using OWA for iPhone From: Jun Rao Sent: Tuesday, December 6, 2016 6:25:28 PM To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag Hi, Michael,

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Hi, Michael, 4. Hmm, does that mean the new client library can never send a null message even to a regular topic? This seems like a change of the existing behavior. Thanks, Jun On Tue, Dec 6, 2016 at 9:51 AM, Michael Pearce wrote: > Hi Jun, > > Re 4) That's because we expect the tombstone val

Re: [DISCUSS] KIP-82 - Add Record Headers

Hi, Michael, Thanks for the reply. I find it very helpful. Data lineage: 100. I'd like to understand the APM use case a bit more. It sounds like that those APM plugins can generate a transaction id that we could potentially put in the header of every message. How would you typically make use of s

Build failed in Jenkins: kafka-trunk-jdk8 #1082

See Changes: [ismael] HOTFIX: Temporary suspension of 2 tests -- [...truncated 15921 lines...] org.apache.kafka.connect.runtime.rest.resources.ConnectorPluginsResourceTest > testValidateConfig

Jenkins build is back to normal : kafka-trunk-jdk7 #1733

See

[jira] [Updated] (KAFKA-4485) Follower should be in the isr if its FetchRequest has fetched up to the logEndOffset of leader

[ https://issues.apache.org/jira/browse/KAFKA-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-4485: Affects Version/s: 0.10.1.0 Reviewer: Jiangjie Qin Fix Version/s: 0.10.2.0 > Fo

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Hi Jun, Re 4) That's because we expect the tombstone value to be set correctly if message bit is 2, as such if an older client sends in on old message the message is upcast and the bit is set correctly. And such no longer need to check the value. Mayuresh can you confirm my thinking and underst

[jira] [Created] (KAFKA-4496) LogCleaner thread exits with NoSuchElementException

Mark Figura created KAFKA-4496: -- Summary: LogCleaner thread exits with NoSuchElementException Key: KAFKA-4496 URL: https://issues.apache.org/jira/browse/KAFKA-4496 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Hi, Michael, 4. Is this updated in the wiki? The text "If the magic byte on message is 2, the broker should use the tombstone bit for log compaction." doesn't seem to have changed. 2. My point is that if we change the message format just for this KIP, we should consider whether it's worth optimiz

[jira] [Updated] (KAFKA-4492) java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache

[ https://issues.apache.org/jira/browse/KAFKA-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4492: -- Description: This follows on from https://issues.apache.org/jira/browse/KAFKA-4311 The exception seems

[jira] [Resolved] (KAFKA-4495) ThreadCache.maybeEvict can become an infinite loop

[ https://issues.apache.org/jira/browse/KAFKA-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-4495. --- Resolution: Invalid > ThreadCache.maybeEvict can become an infinite loop > ---

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

Thanks for the KIP, I can see this being useful when investigating consumer issues +1 On Mon, Dec 5, 2016 at 6:16 PM, Vahid S Hashemian wrote: > Happy Monday, > > I'd like to start voting on KIP-88 ( > https://cwiki.apache.org/confluence/display/KAFKA/KIP-88%3A+OffsetFetch+Protocol+Update > ). >

Re: [VOTE] KIP-94: Session Windows

+1 On 12/6/16 7:40 AM, Eno Thereska wrote: > +1 (non-binding) > > Thanks > Eno >> On 6 Dec 2016, at 12:09, Damian Guy wrote: >> >> Hi all, >> >> I'd like to start the vote for KIP-94: >> https://cwiki.apache.org/confluence/display/KAFKA/KIP-94+Session+Windows >> >> There is a PR for it here: htt

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

For dealing with exactly once delivery. As an alternative option has it been considered to have a message uuid in the record, that then is deduped on consumption? Similar to https://activemq.apache.org/artemis/docs/1.0.0/duplicate-detection.html Agreed this does not deal with transaction suppor

Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag

Hi Jun do we have your vote on this now? Any other concerns? Cheers Mike Sent using OWA for iPhone From: Michael Pearce Sent: Saturday, December 3, 2016 1:37:45 AM To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-87 - Add Compaction Tombstone Flag Hi J

[jira] [Created] (KAFKA-4495) ThreadCache.maybeEvict can become an infinite loop

Damian Guy created KAFKA-4495: - Summary: ThreadCache.maybeEvict can become an infinite loop Key: KAFKA-4495 URL: https://issues.apache.org/jira/browse/KAFKA-4495 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Hey Guozhang, 1. My point is that it is a bit confusing to have two things called application id that have different meanings, right? Won't the streams user end up specifying two different application ids? 2. Makes sense. My two complaints are 1. At this point we've jumped throu

Build failed in Jenkins: kafka-trunk-jdk7 #1732

See Changes: [ismael] KAFKA-4472; offsetRetentionMs miscalculated in GroupCoordinator -- [...truncated 14247 lines...] org.apache.kafka.streams.processor.TopologyBuilderTest > shouldNotAllowNu

RE: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Is there a way that this functionality could be added as an extension to the Producer API, rather than adding extra complexity to the existing interface for those who don't need it. Maybe introduce a TransactionalProducer interface in addition to the existing Producer interface? Thanks, Jonathan

[jira] [Updated] (KAFKA-4492) java.lang.IllegalStateException: Attempting to put a clean entry for key... into NamedCache

[ https://issues.apache.org/jira/browse/KAFKA-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated KAFKA-4492: -- Description: This follows on from https://issues.apache.org/jira/browse/KAFKA-4311 The exception seems

Re: [VOTE] KIP-94: Session Windows

+1 (non-binding) Thanks Eno > On 6 Dec 2016, at 12:09, Damian Guy wrote: > > Hi all, > > I'd like to start the vote for KIP-94: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-94+Session+Windows > > There is a PR for it here: https://github.com/apache/kafka/pull/2166 > > Thanks, > Dam

Build failed in Jenkins: kafka-trunk-jdk8 #1081

See Changes: [ismael] KAFKA-4472; offsetRetentionMs miscalculated in GroupCoordinator -- [...truncated 16005 lines...] org.apache.kafka.connect.runtime.WorkerTest > testAddConnectorByShortAlias

[GitHub] kafka pull request #2199: HOTFIX: Temporary suspension of 2 tests

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2199 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #2216: MINOR: Upgrade Gradle to 3.2.1 and Scala to 2.12.1

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2216 MINOR: Upgrade Gradle to 3.2.1 and Scala to 2.12.1 There were a couple of important issues fixed in Gradle 3.2.1: * [GRADLE-3582] - Gradle wrapper fails to escape arguments with nested quotes

[jira] [Commented] (KAFKA-4493) Connections to Kafka brokers should be validated

[ https://issues.apache.org/jira/browse/KAFKA-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725713#comment-15725713 ] Gérald Quintana commented on KAFKA-4493: See also KAFKA-4491 > Connections to Kaf

[GitHub] kafka pull request #2199: HOTFIX: Temporary suspension of 2 tests

GitHub user enothereska reopened a pull request: https://github.com/apache/kafka/pull/2199 HOTFIX: Temporary suspension of 2 tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka hotfix-streams-test-reset-ignor

[jira] [Commented] (KAFKA-3537) Provide access to low-level Metrics in ProcessorContext

[ https://issues.apache.org/jira/browse/KAFKA-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725609#comment-15725609 ] Eno Thereska commented on KAFKA-3537: - [~mdcoon1] could you have a look at PR. Sorry f

[jira] [Commented] (KAFKA-3537) Provide access to low-level Metrics in ProcessorContext

[ https://issues.apache.org/jira/browse/KAFKA-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725600#comment-15725600 ] Eno Thereska commented on KAFKA-3537: - Note PR only exposes metrics to be consumed as

[jira] [Commented] (KAFKA-3537) Provide access to low-level Metrics in ProcessorContext

[ https://issues.apache.org/jira/browse/KAFKA-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725596#comment-15725596 ] ASF GitHub Bot commented on KAFKA-3537: --- GitHub user enothereska opened a pull reque

[GitHub] kafka pull request #2215: KAFKA-3537: Expose metrics registry

GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/2215 KAFKA-3537: Expose metrics registry You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka KAFKA-3537-access-low-level-metrics

Kafka on Ubuntu Core and Snap store

Hello all, My name is Michael Hall, I work at Canonical on the community team, and recently I've been working with the snapcraft[1] developers to help upstreams learn about and start using our new packaging format. Yesterday I spent a couple of hours looking at Kafka and building an example .snap

[jira] [Work started] (KAFKA-3701) Expose KafkaStreams metrics in public API

[ https://issues.apache.org/jira/browse/KAFKA-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3701 started by Eno Thereska. --- > Expose KafkaStreams metrics in public API > -

[jira] [Work started] (KAFKA-3537) Provide access to low-level Metrics in ProcessorContext

[ https://issues.apache.org/jira/browse/KAFKA-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3537 started by Eno Thereska. --- > Provide access to low-level Metrics in ProcessorContext > ---

[jira] [Created] (KAFKA-4494) Significant startup delays in KStreams app

j yeargers created KAFKA-4494: - Summary: Significant startup delays in KStreams app Key: KAFKA-4494 URL: https://issues.apache.org/jira/browse/KAFKA-4494 Project: Kafka Issue Type: Bug Affect

[jira] [Assigned] (KAFKA-3701) Expose KafkaStreams metrics in public API

[ https://issues.apache.org/jira/browse/KAFKA-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reassigned KAFKA-3701: --- Assignee: Eno Thereska > Expose KafkaStreams metrics in public API >

[jira] [Commented] (KAFKA-4493) Connections to Kafka brokers should be validated

[ https://issues.apache.org/jira/browse/KAFKA-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725314#comment-15725314 ] Ismael Juma commented on KAFKA-4493: This is sort of a duplicate of KAFKA-2512 althoug

[jira] [Commented] (KAFKA-4491) OOME when Java client can not connect to brokers

[ https://issues.apache.org/jira/browse/KAFKA-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725306#comment-15725306 ] Ismael Juma commented on KAFKA-4491: See KAFKA-4491. > OOME when Java client can not

[jira] [Resolved] (KAFKA-4489) Kafka Consumer throws Java Heap Out of Space Error on failed SSL connections

[ https://issues.apache.org/jira/browse/KAFKA-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4489. Resolution: Duplicate The OOM is not intentional. It's just that the PLAINTEXT protocol assumes a m

[jira] [Comment Edited] (KAFKA-4491) OOME when Java client can not connect to brokers

[ https://issues.apache.org/jira/browse/KAFKA-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15725306#comment-15725306 ] Ismael Juma edited comment on KAFKA-4491 at 12/6/16 12:13 PM: --

  1   2   >