Build failed in Jenkins: kafka-0.11.0-jdk7 #249

2017-07-27 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-5611; AbstractCoordinator should handle wakeup raised from -- [...truncated 970.55 KB...] kafka.server.EdgeCaseRequestTest > testInvalidApiKeyRe

About "exclude.internal.topics" ... some thoughts

2017-07-27 Thread Paolo Patierno
Hi devs, I noticed that the "exclude.internal.topics" consumer property has an effect only if the consumer subscribes specifying a "topic pattern" and not a topic name directly. Of course if I run something like the console consumer passing "--topic __consumer_offsets", setting the above prop

Consumer assign vs subscribe influence on __consumer_offset

2017-07-27 Thread Paolo Patierno
Hi devs, I have one simple topic named "test" with only one partition. then ... I have a consumer C1 using assign() for having assigned partition 0 of topic "test" and this consumer has group.id = "mygroup" I have another consumer C2 using subscribe() for having assigned partitions from topic

[DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-07-27 Thread Damian Guy
Hi, I've put together a KIP to make some changes to the KafkaStreams DSL that will hopefully allow us to: 1) reduce the explosion of overloads 2) add new features without having to continue adding more overloads 3) provide simpler ways for people to use custom storage engines and wrap them with lo

Re: [DISCUSS] KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines

2017-07-27 Thread Damian Guy
Updated link: https://cwiki.apache.org/confluence/display/KAFKA/KIP-182%3A+Reduce+Streams+DSL+overloads+and+allow+easier+use+of+custom+storage+engines Thanks, Damian On Thu, 27 Jul 2017 at 13:09 Damian Guy wrote: > Hi, > > I've put together a KIP to make some changes to the KafkaStreams DSL tha

[GitHub] kafka pull request #83: KAFKA-1595; Remove deprecated and slower Scala JSON ...

2017-07-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/83 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] kafka pull request #3587: MINOR: Support versions with 3 segments in _kafka_...

2017-07-27 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3587 MINOR: Support versions with 3 segments in _kafka_jar_versions The bump from 0.11.1.0-SNAPSHOT to 1.0.0-SNAPSHOT broker a couple of tests: * TestVerifiableProducer.test_simple_run * Ka

[GitHub] kafka pull request #3588: HOTFIX: fix threading issue in MeteredKeyValueStor...

2017-07-27 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3588 HOTFIX: fix threading issue in MeteredKeyValueStore `MeteredKeyValueStore` wasn't thread safe. Interleaving operations could modify the state, i.e, the `key` and/or `value` which could result in incorr

[jira] [Resolved] (KAFKA-5549) Explain that `client.id` is just used as a prefix within Streams

2017-07-27 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-5549. --- Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 3544 [https://github.com/

[GitHub] kafka pull request #3544: KAFKA-5549 : Explain that 'client.id' is just used...

2017-07-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3544 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #1856

2017-07-27 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-1595; Remove deprecated and slower Scala JSON parser -- [...truncated 5.05 MB...] org.apache.kafka.connect.runtime.distributed.DistributedHerde

Access for creating KIP page

2017-07-27 Thread Dhananjay Patkar
Please grant me access to create KIP page on confluence Wiki Id : dhananjay.pat...@gmai.com I have created JIRA issue, which needs to be added as KIP https://issues.apache.org/jira/browse/KAFKA-5635 Thanks, Dhananjay

Consumer Group is for Scale or Security?

2017-07-27 Thread Cherian, George
Hello, We have Cloudera as the vendor for Kafka, and when they implemented Sentry for security they implemented two configurations. 1. Map an AD Group (Sentry Role) to map to a Topic to grant the specific permission (Read, Write, Describe etc.) 2. Map this AD Group (Sentry Role)

consumer group offset lag

2017-07-27 Thread Tarun Garg
I am sending this mail to DEV because i think this is a bug in AdminClient while getting the group offset. Hi, I run through a issue. i am trying to get the status of a consumer group. for this i have consumer and producer with topic named test_7 with partition count 1. It is working fine. 1.

[jira] [Created] (KAFKA-5666) Need feedback to user if consumption fails due to offsets.topic.replication.factor=3

2017-07-27 Thread Yeva Byzek (JIRA)
Yeva Byzek created KAFKA-5666: - Summary: Need feedback to user if consumption fails due to offsets.topic.replication.factor=3 Key: KAFKA-5666 URL: https://issues.apache.org/jira/browse/KAFKA-5666 Project:

Jenkins build is back to normal : kafka-trunk-jdk8 #1857

2017-07-27 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-5667) kafka.api.LogDirFailureTest testProduceAfterLogDirFailure flaky test

2017-07-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-5667: Summary: kafka.api.LogDirFailureTest testProduceAfterLogDirFailure flaky test Key: KAFKA-5667 URL: https://issues.apache.org/jira/browse/KAFKA-5667 Pr

[GitHub] kafka pull request #3575: KAFKA-5634; Do not allow segment deletion beyond h...

2017-07-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3575 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-5634) Replica fetcher thread crashes due to OffsetOutOfRangeException

2017-07-27 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-5634. Resolution: Fixed Issue resolved by pull request 3575 [https://github.com/apache/kafka/pull/

[jira] [Created] (KAFKA-5668) queryable state window store range scan only returns results from one store

2017-07-27 Thread JIRA
Xavier Léauté created KAFKA-5668: Summary: queryable state window store range scan only returns results from one store Key: KAFKA-5668 URL: https://issues.apache.org/jira/browse/KAFKA-5668 Project: Ka

[VOTE] KIP-175: Additional '--describe' views for ConsumerGroupCommand

2017-07-27 Thread Vahid S Hashemian
Hi all, Thanks to everyone who participated in the discussion on KIP-175, and provided feedback. The KIP can be found at https://cwiki.apache.org/confluence/display/KAFKA/KIP-175%3A+Additional+%27--describe%27+views+for+ConsumerGroupCommand . I believe the concerns have been addressed in the rec

[jira] [Created] (KAFKA-5669) Define allowed characters for connector names

2017-07-27 Thread JIRA
Sönke Liebau created KAFKA-5669: --- Summary: Define allowed characters for connector names Key: KAFKA-5669 URL: https://issues.apache.org/jira/browse/KAFKA-5669 Project: Kafka Issue Type: Improve

[DISCUSS] KAFKA-5669: Define allowed characters for connector names

2017-07-27 Thread Sönke Liebau
As stated in the jira, we should come up with either a set of allowed or a set of disallowed characters for connector names to avoid a couple of issues that currently exist. I tend towards a whitelisting approach to avoid missing a lot of things that then need to be fixed later on. According to

Jenkins build is back to normal : kafka-0.11.0-jdk7 #250

2017-07-27 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #3589: KAFKA-3623: KStreamTestDriver extends ExternalReso...

2017-07-27 Thread johnma14
GitHub user johnma14 opened a pull request: https://github.com/apache/kafka/pull/3589 KAFKA-3623: KStreamTestDriver extends ExternalResource In the streams project, there are a number of unit tests that has duplicate code with respect to the tearDown() method, in which it tries t

[jira] [Created] (KAFKA-5671) Add StreamsBuilder and deprecate KStreamBuilder

2017-07-27 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-5671: -- Summary: Add StreamsBuilder and deprecate KStreamBuilder Key: KAFKA-5671 URL: https://issues.apache.org/jira/browse/KAFKA-5671 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-5670) Add Topology and deprecate TopologyBuilder

2017-07-27 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-5670: -- Summary: Add Topology and deprecate TopologyBuilder Key: KAFKA-5670 URL: https://issues.apache.org/jira/browse/KAFKA-5670 Project: Kafka Issue Type: Sub-

[GitHub] kafka pull request #3590: KAFKA-5670: (KIP-120) Add Topology and deprecate T...

2017-07-27 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/3590 KAFKA-5670: (KIP-120) Add Topology and deprecate TopologyBuilder You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka kafka-3856-replace-t

[GitHub] kafka pull request #3591: Throttled producer

2017-07-27 Thread abhijitiitr
GitHub user abhijitiitr opened a pull request: https://github.com/apache/kafka/pull/3591 Throttled producer You can merge this pull request into a Git repository by running: $ git pull https://github.com/abhijitiitr/kafka throttled_producer Alternatively you can review and ap

[GitHub] kafka pull request #3591: Throttled producer

2017-07-27 Thread abhijitiitr
Github user abhijitiitr closed the pull request at: https://github.com/apache/kafka/pull/3591 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is