Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

2017-12-20 Thread vito jeng
Matthias, I try to clarify some concept. When streams state is REBALANCING, it means the user can just plain retry. When streams state is ERROR or PENDING_SHUTDOWN or NOT_RUNNING, it means state store migrated to another instance, the user needs to rediscover the store. Is my understanding corr

[GitHub] kafka pull request #4304: KAFKA-6323: document that punctuation is called im...

2017-12-20 Thread fredfp
Github user fredfp closed the pull request at: https://github.com/apache/kafka/pull/4304 ---

[jira] [Created] (KAFKA-6389) Expose transaction metrics via JMX

2017-12-20 Thread JIRA
Florent Ramière created KAFKA-6389: -- Summary: Expose transaction metrics via JMX Key: KAFKA-6389 URL: https://issues.apache.org/jira/browse/KAFKA-6389 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-6390) Update ZooKeeper to 3.4.11 and other minor updates

2017-12-20 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-6390: -- Summary: Update ZooKeeper to 3.4.11 and other minor updates Key: KAFKA-6390 URL: https://issues.apache.org/jira/browse/KAFKA-6390 Project: Kafka Issue Type: Bug

[GitHub] kafka pull request #4345: KAFKA-6390: Update ZooKeeper to 3.4.11, Gradle and...

2017-12-20 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4345 KAFKA-6390: Update ZooKeeper to 3.4.11, Gradle and other minor updates Updates: - Gradle, gradle plugins and maven artifact updated - Bug fix updates for ZooKeeper, Jackson, EasyMock and Snappy

[GitHub] kafka pull request #4306: KAFKA-6331; Fix transient failure in AdminClientIn...

2017-12-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4306 ---

[GitHub] kafka pull request #4346: appends Materialized#with to include the ability t...

2017-12-20 Thread kdrakon
GitHub user kdrakon opened a pull request: https://github.com/apache/kafka/pull/4346 appends Materialized#with to include the ability to specify the store name as well as the serdes `Materialized#with` doesn't allow you to specify both a store name and the key/value serdes. If you

[jira] [Resolved] (KAFKA-6331) Transient failure in kafka.api.AdminClientIntegrationTest.testLogStartOffsetCheckpointkafka.api.AdminClientIntegrationTest.testAlterReplicaLogDirs

2017-12-20 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-6331. Resolution: Fixed Fix Version/s: 1.1.0 > Transient failure in > kafka.api.AdminClientIntegra

[GitHub] kafka pull request #4026: KAFKA-5746: Document new broker metrics added for ...

2017-12-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4026 ---

[jira] [Created] (KAFKA-6391) output from ensure copartitioning is not used for Cluster metadata

2017-12-20 Thread Clemens Valiente (JIRA)
Clemens Valiente created KAFKA-6391: --- Summary: output from ensure copartitioning is not used for Cluster metadata Key: KAFKA-6391 URL: https://issues.apache.org/jira/browse/KAFKA-6391 Project: Kafka

Jenkins build is back to normal : kafka-trunk-jdk8 #2288

2017-12-20 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #4347: KAFKA-6391 ensure topics are created with correct ...

2017-12-20 Thread cvaliente
GitHub user cvaliente opened a pull request: https://github.com/apache/kafka/pull/4347 KAFKA-6391 ensure topics are created with correct partitions BEFORE building the… ensure topics are created with correct partitions BEFORE building the metadata for our stream tasks Fi

Build failed in Jenkins: kafka-trunk-jdk8 #2289

2017-12-20 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-5746; Document new broker metrics added for health checks -- [...truncated 3.88 MB...] org.apache.kafka.connect.runtime.rest.entities.Connecto

[jira] [Created] (KAFKA-6392) Do not permit message down-conversion for replicas

2017-12-20 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-6392: -- Summary: Do not permit message down-conversion for replicas Key: KAFKA-6392 URL: https://issues.apache.org/jira/browse/KAFKA-6392 Project: Kafka Issue Ty

Re: [DISCUSS] KIP-236 Interruptible Partition Reassignment

2017-12-20 Thread Jun Rao
Hi, Tom, Thanks for the reply. A few more comments below. 10. You explanation makes sense. My remaining concern is the additional ZK writes in the proposal. With the proposal, we will need to do following writes in ZK. a. write new assignment in /admin/reassignment_requests b. write new assignm

[GitHub] kafka-site issue #112: Migrate Streams Dev Guide content to AK

2017-12-20 Thread derrickdoo
Github user derrickdoo commented on the issue: https://github.com/apache/kafka-site/pull/112 👍 💯 LGTM ---

[jira] [Created] (KAFKA-6393) Add tool to view active brokers

2017-12-20 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-6393: -- Summary: Add tool to view active brokers Key: KAFKA-6393 URL: https://issues.apache.org/jira/browse/KAFKA-6393 Project: Kafka Issue Type: Improvement

[GitHub] kafka pull request #4260: KAFKA-5647: Use KafkaZkClient in ReassignPartition...

2017-12-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4260 ---

[jira] [Created] (KAFKA-6394) Prevent misconfiguration of advertised listeners

2017-12-20 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-6394: -- Summary: Prevent misconfiguration of advertised listeners Key: KAFKA-6394 URL: https://issues.apache.org/jira/browse/KAFKA-6394 Project: Kafka Issue Type

Re: [VOTE] KIP-239 Add queryableStoreName() to GlobalKTable

2017-12-20 Thread Ted Yu
Ping for more (binding) votes. The pull request is ready. On Fri, Dec 15, 2017 at 12:57 PM, Guozhang Wang wrote: > +1 (binding), thanks! > > On Fri, Dec 15, 2017 at 11:56 AM, Ted Yu wrote: > > > Hi, > > Here is the discussion thread: > > > > http://search-hadoop.com/m/Kafka/uyzND12QnH514pPO9?s

[GitHub] kafka-site pull request #112: Migrate Streams Dev Guide content to AK

2017-12-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka-site/pull/112 ---

[GitHub] kafka-site issue #112: Migrate Streams Dev Guide content to AK

2017-12-20 Thread guozhangwang
Github user guozhangwang commented on the issue: https://github.com/apache/kafka-site/pull/112 LGTM. Merged to asf-site. ---

[jira] [Resolved] (KAFKA-5849) Add process stop faults, round trip workload, partitioned produce-consume test

2017-12-20 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-5849. --- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 4323 [https://git

[GitHub] kafka pull request #4323: KAFKA-5849: Add process stop, round trip workload,...

2017-12-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4323 ---

Build failed in Jenkins: kafka-trunk-jdk8 #2290

2017-12-20 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-5647; Use KafkaZkClient in ReassignPartitionsCommand and -- [...truncated 405.82 KB...] kafka.server.DelayedOperationTest > testRequestSatisfac

Build failed in Jenkins: kafka-trunk-jdk9 #267

2017-12-20 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-5647; Use KafkaZkClient in ReassignPartitionsCommand and -- [...truncated 1.45 MB...] kafka.zk.KafkaZkClientTest > testSetAndGetConsumerOffset

[GitHub] kafka-site pull request #113: HOTFIX: broken /10 docs

2017-12-20 Thread joel-hamill
GitHub user joel-hamill opened a pull request: https://github.com/apache/kafka-site/pull/113 HOTFIX: broken /10 docs You can merge this pull request into a Git repository by running: $ git pull https://github.com/joel-hamill/kafka-site fix-broken-links Alternatively you can r

[GitHub] kafka-site issue #113: HOTFIX: broken /10 docs

2017-12-20 Thread joel-hamill
Github user joel-hamill commented on the issue: https://github.com/apache/kafka-site/pull/113 ping @guozhangwang ---

[jira] [Resolved] (KAFKA-4263) QueryableStateIntegrationTest.concurrentAccess is failing occasionally in jenkins builds

2017-12-20 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4263. -- Resolution: Fixed Fix Version/s: (was: 0.10.1.1) 1.0.1

[GitHub] kafka pull request #4342: KAFKA-4263: fix flaky test QueryableStateIntegrati...

2017-12-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4342 ---

Re: [VOTE] KIP-243: Make ProducerConfig and ConsumerConfig constructors public

2017-12-20 Thread Jason Gustafson
Hi Matthias, Isn't it a little weird to make these constructors public but not also expose the corresponding client constructors that use them? -Jason On Tue, Dec 19, 2017 at 9:30 AM, Bill Bejeck wrote: > +1 > > On Tue, Dec 19, 2017 at 12:09 PM, Guozhang Wang > wrote: > > > +1 > > > > On Tue,

Jenkins build is back to normal : kafka-trunk-jdk9 #268

2017-12-20 Thread Apache Jenkins Server
See

[GitHub] kafka-site issue #113: HOTFIX: broken /10 docs

2017-12-20 Thread derrickdoo
Github user derrickdoo commented on the issue: https://github.com/apache/kafka-site/pull/113 👍 👍 LGTM ---

[GitHub] kafka-site issue #113: HOTFIX: broken /10 docs

2017-12-20 Thread guozhangwang
Github user guozhangwang commented on the issue: https://github.com/apache/kafka-site/pull/113 Merged to asf-site. ---

[GitHub] kafka-site pull request #113: HOTFIX: broken /10 docs

2017-12-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka-site/pull/113 ---

Jenkins build is back to normal : kafka-trunk-jdk8 #2291

2017-12-20 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #4348: MINOR: Fix race condition in Streams EOS system te...

2017-12-20 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/4348 MINOR: Fix race condition in Streams EOS system test We should start the process only within the `with` block, otherwise the bytes parameter would cause a race condition that result in false al

Re: [VOTE] KIP-243: Make ProducerConfig and ConsumerConfig constructors public

2017-12-20 Thread Matthias J. Sax
It's tailored for internal usage. I think client constructors don't benefit from accepting those config objects. We just want to be able to access the default values for certain parameters. From a user point of view, it's actually boiler plate code if you pass in a config object instead of a plain

Re: [VOTE] KIP-243: Make ProducerConfig and ConsumerConfig constructors public

2017-12-20 Thread Matthias J. Sax
It's tailored for internal usage. I think client constructors don't benefit from accepting those config objects. We just want to be able to access the default values for certain parameters. From a user point of view, it's actually boiler plate code if you pass in a config object instead of a plain

[GitHub] kafka pull request #4322: KAFKA-6126: Remove unnecessary topics created chec...

2017-12-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4322 ---

[GitHub] kafka pull request #4349: KAFKA-6366 [WIP]: Fix stack overflow in consumer d...

2017-12-20 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/4349 KAFKA-6366 [WIP]: Fix stack overflow in consumer due to fast offset commits during coordinator disconnect When the coordinator is marked unknown, we explicitly disconnect its connection and cance

[GitHub] kafka pull request #4348: MINOR: Fix race condition in Streams EOS system te...

2017-12-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4348 ---

Build failed in Jenkins: kafka-trunk-jdk9 #270

2017-12-20 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6126: Remove unnecessary topics created check -- [...truncated 1.45 MB...] kafka.zk.KafkaZkClientTest > testSetAndGetConsumerOffset PASSED ka

Jenkins build is back to normal : kafka-trunk-jdk9 #271

2017-12-20 Thread Apache Jenkins Server
See