[jira] [Commented] (KAFKA-4674) Frequent ISR shrinking and expanding and disconnects among brokers

[ https://issues.apache.org/jira/browse/KAFKA-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829525#comment-15829525 ] huxi commented on KAFKA-4674: - Is it a duplicate of [KAFKA-3916|https://issues.apache.org/jir

[jira] [Commented] (KAFKA-4674) Frequent ISR shrinking and expanding and disconnects among brokers

[ https://issues.apache.org/jira/browse/KAFKA-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829542#comment-15829542 ] Kaiming Wan commented on KAFKA-4674: [~huxi_2b]I have read that issue, but still not s

[jira] [Comment Edited] (KAFKA-4674) Frequent ISR shrinking and expanding and disconnects among brokers

[ https://issues.apache.org/jira/browse/KAFKA-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829542#comment-15829542 ] Kaiming Wan edited comment on KAFKA-4674 at 1/19/17 8:56 AM: -

[jira] [Comment Edited] (KAFKA-4674) Frequent ISR shrinking and expanding and disconnects among brokers

[ https://issues.apache.org/jira/browse/KAFKA-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829542#comment-15829542 ] Kaiming Wan edited comment on KAFKA-4674 at 1/19/17 8:56 AM: -

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829687#comment-15829687 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829697#comment-15829697 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[GitHub] kafka pull request #2406: KAFKA-4636; Per listener security settings overrid...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2406 KAFKA-4636; Per listener security settings overrides (WIP) Additional tests need to be added and an important FIXME needs to be fixed in `PlainSaslServer`. You can merge this pull request into a Git

[jira] [Commented] (KAFKA-4636) Per listener security setting overrides (KIP-103)

[ https://issues.apache.org/jira/browse/KAFKA-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829891#comment-15829891 ] ASF GitHub Bot commented on KAFKA-4636: --- GitHub user ijuma opened a pull request:

[GitHub] kafka pull request #2407: logDirs empty error added

GitHub user vogetihrsh opened a pull request: https://github.com/apache/kafka/pull/2407 logDirs empty error added You can merge this pull request into a Git repository by running: $ git pull https://github.com/vogetihrsh/kafka KAFKA-4520 Alternatively you can review and apply

[jira] [Commented] (KAFKA-4520) Kafka broker fails with not so user-friendly error msg when log.dirs is not set

[ https://issues.apache.org/jira/browse/KAFKA-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829937#comment-15829937 ] Sriharsha Vogeti commented on KAFKA-4520: - https://github.com/apache/kafka/pull/24

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830036#comment-15830036 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830045#comment-15830045 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

General question about kafka to use in a correct way

I read about kafka, and still i am thinking about some scenarios, what is the possibilities to use kafka in a cloud POS application? is there any sense to do a live dashboard? Thanks Amtest

[GitHub] kafka pull request #2369: KAFKA-4589: SASL/SCRAM documentation

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2369 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-4589) Add documentation for SASL/SCRAM

[ https://issues.apache.org/jira/browse/KAFKA-4589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-4589. Resolution: Fixed Issue resolved by pull request 2369 [https://github.com/apache/kafka/pull/2369] > Add doc

[jira] [Commented] (KAFKA-4589) Add documentation for SASL/SCRAM

[ https://issues.apache.org/jira/browse/KAFKA-4589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830218#comment-15830218 ] ASF GitHub Bot commented on KAFKA-4589: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-4672) KIP-100 api changes break Java 8 lambda expressions in some cases

[ https://issues.apache.org/jira/browse/KAFKA-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xavier Léauté updated KAFKA-4672: - Description: Variance changes introduced in KIP-100 cause compilation failures with lambda expres

Re: [Suggestion] Issues on StreamConfig Builder

Dongjin, Thanks for your interests. I looked at these three tickets, and I think we can tackle them incrementally instead of getting them in one shot, that is because: 1. Although I see some dependencies between 4436 and 2898, I think they can still be tackled separately (though like you said, pr

[GitHub] kafka pull request #2352: KAFKA-4614 Forcefully unmap mmap of OffsetIndex to...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2352 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4614) Long GC pause harming broker performance which is caused by mmap objects created for OffsetIndex

[ https://issues.apache.org/jira/browse/KAFKA-4614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830330#comment-15830330 ] ASF GitHub Bot commented on KAFKA-4614: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-4614) Long GC pause harming broker performance which is caused by mmap objects created for OffsetIndex

[ https://issues.apache.org/jira/browse/KAFKA-4614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-4614: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 2352 [https:

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830385#comment-15830385 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[GitHub] kafka pull request #2408: KAFKA-4493: Validate a plaintext client connection...

GitHub user taku-k opened a pull request: https://github.com/apache/kafka/pull/2408 KAFKA-4493: Validate a plaintext client connection to a SSL broker When a SSL Alert protocol is received from the broker by sending a request from a client, `InvalidTransportLayerException` is raised

[jira] [Commented] (KAFKA-4493) Connections to Kafka brokers should be validated

[ https://issues.apache.org/jira/browse/KAFKA-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830388#comment-15830388 ] ASF GitHub Bot commented on KAFKA-4493: --- GitHub user taku-k opened a pull request:

[jira] [Commented] (KAFKA-4670) Kafka Consumer should validate FetchResponse

[ https://issues.apache.org/jira/browse/KAFKA-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830402#comment-15830402 ] Ismael Juma commented on KAFKA-4670: Seems like a duplicate of KAFKA-2512. KAFKA-4493

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830404#comment-15830404 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

Jenkins build is back to normal : kafka-trunk-jdk7 #1855

See

Re: MirrorMaker across Kafka Clusters with different versions

As you figured out - 0.10 clients (including Connect and MirrorMaker) will not work against Kafka 0.8. On the other hand, 0.8. client will work with Kafka 0.10. So you just need to use a 0.8 MirrorMaker to do the replication. Gwen On Wed, Jan 18, 2017 at 8:14 AM, wrote: > Can MirrorMaker can w

Re: [DISCUSS] KIP-81: Max in-flight fetches

Thanks for the updates, Mickael. The proposal looks good to me. -Jason On Wed, Jan 18, 2017 at 10:19 AM, Mickael Maison wrote: > I've updated the KIP to mention this. > I've currently set the size limit to 1Kb. It's large enough so > group/heartbeat messages are smaller than it and also small e

Re: [DISCUSS] KIP-98: Exactly Once Delivery and Transactional Messaging

Quick update: I have merged the abort index proposal linked above into the main design document. We are now working on tying up the loose ends raised by Jun and others. Thanks, Jason On Tue, Jan 17, 2017 at 8:53 PM, Apurva Mehta wrote: > > > > 114.The section on Discussion on Pro-active Transac

Build failed in Jenkins: kafka-trunk-jdk8 #1196

See Changes: [junrao] KAFKA-4614; Forcefully unmap mmap of OffsetIndex to prevent long GC -- [...truncated 15820 lines...] org.apache.kafka.common.security.scram.ScramCredentialUtilsTest > gene

[jira] [Resolved] (KAFKA-4670) Kafka Consumer should validate FetchResponse

[ https://issues.apache.org/jira/browse/KAFKA-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4670. Resolution: Duplicate > Kafka Consumer should validate FetchResponse > -

[jira] [Resolved] (KAFKA-4491) OOME when Java client can not connect to brokers

[ https://issues.apache.org/jira/browse/KAFKA-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4491. Resolution: Duplicate Resolving this in favor KAFKA-4493, which has a patch available. > OO

[jira] [Commented] (KAFKA-4670) Kafka Consumer should validate FetchResponse

[ https://issues.apache.org/jira/browse/KAFKA-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830670#comment-15830670 ] Roger Hoover commented on KAFKA-4670: - Ah, yes, thanks, [~ijuma]. > Kafka Consumer

[jira] [Closed] (KAFKA-4670) Kafka Consumer should validate FetchResponse

[ https://issues.apache.org/jira/browse/KAFKA-4670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roger Hoover closed KAFKA-4670. --- > Kafka Consumer should validate FetchResponse > > >

[jira] [Assigned] (KAFKA-4144) Allow per stream/table timestamp extractor

[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeyhun Karimov reassigned KAFKA-4144: - Assignee: Jeyhun Karimov > Allow per stream/table timestamp extractor > -

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830748#comment-15830748 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830753#comment-15830753 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[GitHub] kafka-site pull request #41: New design for the "powered by" page

GitHub user derrickdoo opened a pull request: https://github.com/apache/kafka-site/pull/41 New design for the "powered by" page New design for the "powered by" page. - Stop linking off the site to show content - Include company logos - Display as a grid You can merg

[jira] [Commented] (KAFKA-3450) Producer blocks on send to topic that doesn't exist if auto create is disabled

[ https://issues.apache.org/jira/browse/KAFKA-3450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830829#comment-15830829 ] Esoga Simmons commented on KAFKA-3450: -- Building off of what [~tu...@avast.com] said,

[jira] [Comment Edited] (KAFKA-3450) Producer blocks on send to topic that doesn't exist if auto create is disabled

[ https://issues.apache.org/jira/browse/KAFKA-3450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830829#comment-15830829 ] Esoga Simmons edited comment on KAFKA-3450 at 1/19/17 11:37 PM:

[GitHub] kafka pull request #2409: MINOR: Update consumer group describe output in th...

GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/2409 MINOR: Update consumer group describe output in the documentation You can merge this pull request into a Git repository by running: $ git pull https://github.com/vahidhashemian/kafka d

[GitHub] kafka pull request #2341: KAFKA-4547: Avoid unnecessary offset commit that c...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2341 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi updated KAFKA-4295: Reviewer: Ismael Juma > kafka-console-consumer.sh does not delete the temporary group in zookeeper > ---

[jira] [Commented] (KAFKA-4547) Consumer.position returns incorrect results for Kafka 0.10.1.0 client

[ https://issues.apache.org/jira/browse/KAFKA-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830919#comment-15830919 ] ASF GitHub Bot commented on KAFKA-4547: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-4592) Kafka Producer Metrics Invalid Value

[ https://issues.apache.org/jira/browse/KAFKA-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi updated KAFKA-4592: Reviewer: Ismael Juma > Kafka Producer Metrics Invalid Value > > >

[jira] [Updated] (KAFKA-4547) Consumer.position returns incorrect results for Kafka 0.10.1.0 client

[ https://issues.apache.org/jira/browse/KAFKA-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4547: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Consumer.position returns

[GitHub] kafka pull request #2158: KAFKA-4432: Added support to supply custom message...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2158 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4432) ProducerPerformance.java : Add support to supply custom message payloads.

[ https://issues.apache.org/jira/browse/KAFKA-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15831009#comment-15831009 ] ASF GitHub Bot commented on KAFKA-4432: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-4432) ProducerPerformance.java : Add support to supply custom message payloads.

[ https://issues.apache.org/jira/browse/KAFKA-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-4432: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 2158 [https:

[jira] [Assigned] (KAFKA-2898) Kafka producer config incorrectly warns that serializer.* isn't a known config

[ https://issues.apache.org/jira/browse/KAFKA-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lee Dongjin reassigned KAFKA-2898: -- Assignee: Lee Dongjin > Kafka producer config incorrectly warns that serializer.* isn't a known

Re: [Suggestion] Issues on StreamConfig Builder

Guozhang and all, No problem. I just took KAFKA-2898. Let's concentrate on KAFKA-4436: 1. Does this issue require KIP? If it is true, I will prepare the KIP. 2. Should this issue be moved into Umbrella task, with separated sub-tasks? Best, Dongjin On Fri, Jan 20, 2017 at 2:22 AM, Guozhang Wang

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15831069#comment-15831069 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15831079#comment-15831079 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

Re: [Suggestion] Issues on StreamConfig Builder

1. I think it would need a KIP discussion, yes. 2. What sub-tasks are you considering to break KAFKA-4436? Guozhang On Thu, Jan 19, 2017 at 5:52 PM, Dongjin Lee wrote: > Guozhang and all, > > No problem. I just took KAFKA-2898. Let's concentrate on KAFKA-4436: > > 1. Does this issue require KI

Jenkins build is back to normal : kafka-trunk-jdk8 #1197

See

Build failed in Jenkins: kafka-trunk-jdk8 #1198

See Changes: [junrao] KAFKA-4432; Added support to supply custom message payloads to -- [...truncated 1205 lines...] kafka.api.SaslScramSslEndToEndAuthorizationTest > testNoProduceWithDescribeAc

Build failed in Jenkins: kafka-0.10.2-jdk7 #17

See Changes: [jason] KAFKA-4547; Avoid incorrect reset of paused partitions to the committed [junrao] KAFKA-4432; Added support to supply custom message payloads to -- [...truncated 7541 lines..

Re: [Suggestion] Issues on StreamConfig Builder

1. Then, I will submit the KIP as soon as KAFKA-2898 is completed. 2. Into following three sub-tasks: a. Provide ProducerConfig#builder b. Provide ConsumerConfig#builder c. Provide StreamsConfig#builder on top of a and b. Thanks, Dongjin On Fri, Jan 20, 2017 at 1:20 PM, Guozhang Wang

Re: General question about kafka to use in a correct way

Hi Vishnu, Assuming that the POS application will generate POS events, we could accumulate these events in Kafka and use it as a data feed for live dashboards. We could do some common events stream processing within Kafka itself using the streams API. Alternatively the POS events stream could

[jira] [Commented] (KAFKA-3896) Unstable test KStreamRepartitionJoinTest.shouldCorrectlyRepartitionOnJoinOperations

[ https://issues.apache.org/jira/browse/KAFKA-3896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15831285#comment-15831285 ] Guozhang Wang commented on KAFKA-3896: -- The root cause of this issue is that before

[jira] [Comment Edited] (KAFKA-3896) Unstable test KStreamRepartitionJoinTest.shouldCorrectlyRepartitionOnJoinOperations

[ https://issues.apache.org/jira/browse/KAFKA-3896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15831285#comment-15831285 ] Guozhang Wang edited comment on KAFKA-3896 at 1/20/17 6:37 AM: -

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15831309#comment-15831309 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15831311#comment-15831311 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipien