Guozhang, I created KAFKA-6100 for the issue: https://issues.apache.org/jira/browse/KAFKA-6100 An interim fix could be downgrading the version of RocksDB to 5.7.3.
Thanks. --Vahid From: Guozhang Wang <wangg...@gmail.com> To: "dev@kafka.apache.org" <dev@kafka.apache.org> Date: 10/19/2017 08:59 PM Subject: Re: [VOTE] 1.0.0 RC2 Vahid, Thanks for testing the RC! Really appreciate it. Could you file another JIRA for the Streams quickstart issue on Windows? Folks, While working on a flaky unit test we happen to find a topic-deletion issue ( https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_kafka_pull_4095&d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_xUKl7Nzswo6KE4Nj-kjJc7uSVcviKUc&m=KznO-5EzyQMg8VwCR3SNh62faQzNgSc9bBROmz5tTos&s=pjEK-Ul41dIO-epYJ4XNSLZsLO8nWhcsjh1vUVp-cII&e= ), marked as a blocker for the release. I will roll out another RC after this issue is fixed. Guozhang On Thu, Oct 19, 2017 at 3:27 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Hi Guozhang, > > I was able to successfully build the jars on Ubuntu (Java 8 and 9) and Mac > (Java 8) and run the quickstart (incl. streams quickstart). > > On Windows 10, build worked fine with both Java 8 and 9. > Quickstarts worked well too, except for streams quickstart, where the > following command > bin\windows\kafka-run-class.bat > org.apache.kafka.streams.examples.wordcount.WordCountDemo > constantly crashed Java for me, with the error: "An unhandled win32 > exception occurred in java.exe". > > This is what shows up in the broker log before the crash: > [2017-10-17 15:09:13,948] INFO [GroupCoordinator 0]: Preparing to > rebalance group streams-wordcount with old generation 0 > (__consumer_offsets-35) (kafka.coordinator.group.GroupCoordinator) > [2017-10-17 15:09:13,964] INFO [GroupCoordinator 0]: Stabilized group > streams-wordcount generation 1 (__consumer_offsets-35) > (kafka.coordinator.group.GroupCoordinator) > [2017-10-17 15:09:14,214] INFO [GroupCoordinator 0]: Assignment received > from leader for group streams-wordcount for generation 1 > (kafka.coordinator.group.GroupCoordinator) > > And this shortly after: > [2017-10-17 15:09:24,230] INFO [GroupCoordinator 0]: Member > streams-wordcount-5fd1c2b1-f050-45a3-a331-66832cf34f83- > StreamThread-1-consumer-71a4d57c-9f40-4340-8f71-5549187331d3 > in group streams-wordcount has failed, removing it from the group > (kafka.coordinator.group.GroupCoordinator) > [2017-10-17 15:09:24,230] INFO [GroupCoordinator 0]: Preparing to > rebalance group streams-wordcount with old generation 1 > (__consumer_offsets-35) (kafka.coordinator.group.GroupCoordinator) > [2017-10-17 15:09:24,230] INFO [GroupCoordinator 0]: Group > streams-wordcount with generation 2 is now empty (__consumer_offsets-35) > (kafka.coordinator.group.GroupCoordinator) > > I also noticed another issue on Windows that I reported in KAFKA-6075. > That issue is not specific to the release candidate though. > > Thanks. > --Vahid > > > > From: Guozhang Wang <wangg...@gmail.com> > To: "dev@kafka.apache.org" <dev@kafka.apache.org>, > "us...@kafka.apache.org" <us...@kafka.apache.org>, kafka-clients > <kafka-clie...@googlegroups.com> > Date: 10/17/2017 09:47 AM > Subject: [VOTE] 1.0.0 RC2 > > > > Hello Kafka users, developers and client-developers, > > This is the third candidate for release of Apache Kafka 1.0.0. The main > PRs > that gets merged in after RC1 are the following: > > https://urldefense.proofpoint.com/v2/url?u=https-3A__github. > com_apache_kafka_commit_dc6bfa553e73ffccd1e604963e076c > 78d8ddcd69&d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_ > itwloTQj3_xUKl7Nzswo6KE4Nj-kjJc7uSVcviKUc&m=Y-4kiSVRo1wsHsySpb2cQHh- > ex6Y29UAzo2cqTjH170&s=x_8A9EHvjlL9exX6PRNWYQLinf7VaKbx8Rwmn_IoK98&e= > > > It's worth noting that starting in this version we are using a different > version protocol with three digits: *major.minor.bug-fix* > > Any and all testing is welcome, but the following areas are worth > highlighting: > > 1. Client developers should verify that their clients can produce/consume > to/from 1.0.0 brokers (ideally with compressed and uncompressed data). > 2. Performance and stress testing. Heroku and LinkedIn have helped with > this in the past (and issues have been found and fixed). > 3. End users can verify that their apps work correctly with the new > release. > > This is a major version release of Apache Kafka. It includes 29 new KIPs. > See the release notes and release plan > (*https://urldefense.proofpoint.com/v2/url?u=https-3A__cwiki.apache.org_ > confluence_pages_viewpage.action-3FpageId-3D71764913&d= > DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_xUKl7Nzswo6KE4Nj- > kjJc7uSVcviKUc&m=Y-4kiSVRo1wsHsySpb2cQHh-ex6Y29UAzo2cqTjH170&s= > uyFdtyuGMnKZKQuyLbgzA1oGgZrSvC0ANWDn_aNVuE4&e= > < > https://urldefense.proofpoint.com/v2/url?u=https-3A__cwiki. > apache.org_confluence_pages_viewpage.action-3FpageId- > 3D71764913&d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_ > itwloTQj3_xUKl7Nzswo6KE4Nj-kjJc7uSVcviKUc&m=Y-4kiSVRo1wsHsySpb2cQHh- > ex6Y29UAzo2cqTjH170&s=uyFdtyuGMnKZKQuyLbgzA1oGgZrSvC0ANWDn_aNVuE4&e= > >*) > for more details. A few feature highlights: > > * Java 9 support with significantly faster TLS and CRC32C implementations > * JBOD improvements: disk failure only disables failed disk but not the > broker (KIP-112/KIP-113) > * Controller improvements: async ZK access for faster administrative > request handling > * Newly added metrics across all the modules (KIP-164, KIP-168, KIP-187, > KIP-188, KIP-196) > * Kafka Streams API improvements (KIP-120 / 130 / 138 / 150 / 160 / 161), > and drop compatibility "Evolving" annotations > > Release notes for the 1.0.0 release: > *https://urldefense.proofpoint.com/v2/url?u=http-3A__home.apache.org_- > 7Eguozhang_kafka-2D1.0.0-2Drc2_RELEASE-5FNOTES.html&d= > DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_xUKl7Nzswo6KE4Nj- > kjJc7uSVcviKUc&m=Y-4kiSVRo1wsHsySpb2cQHh-ex6Y29UAzo2cqTjH170&s=_ > l756hBFyb3wCb10btzzvYghhYPOpIt5-BWoRbXqfSQ&e= > < > https://urldefense.proofpoint.com/v2/url?u=http-3A__home. > apache.org_-7Eguozhang_kafka-2D1.0.0-2Drc2_RELEASE-5FNOTES. > html&d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_xUKl7Nzswo6KE4Nj- > kjJc7uSVcviKUc&m=Y-4kiSVRo1wsHsySpb2cQHh-ex6Y29UAzo2cqTjH170&s=_ > l756hBFyb3wCb10btzzvYghhYPOpIt5-BWoRbXqfSQ&e= > >* > > > > *** Please download, test and vote by Friday, October 20, 8pm PT > > Kafka's KEYS file containing PGP keys we use to sign the release: > https://urldefense.proofpoint.com/v2/url?u=http-3A__kafka. > apache.org_KEYS&d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_ > itwloTQj3_xUKl7Nzswo6KE4Nj-kjJc7uSVcviKUc&m=Y-4kiSVRo1wsHsySpb2cQHh- > ex6Y29UAzo2cqTjH170&s=wQXIRJTKOJixrQzT3j6Wh2HcZdQs6HWeJiHG_CPp12k&e= > > > * Release artifacts to be voted upon (source and binary): > *https://urldefense.proofpoint.com/v2/url?u=http-3A__home.apache.org_- > 7Eguozhang_kafka-2D1.0.0-2Drc2_&d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_ > itwloTQj3_xUKl7Nzswo6KE4Nj-kjJc7uSVcviKUc&m=Y-4kiSVRo1wsHsySpb2cQHh- > ex6Y29UAzo2cqTjH170&s=wZUoYtYo_0J9nYj93G7MECAtlVnDGqwYkxekWrMcS_c&e= > < > https://urldefense.proofpoint.com/v2/url?u=http-3A__home. > apache.org_-7Eguozhang_kafka-2D1.0.0-2Drc2_&d=DwIBaQ&c=jf_ > iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_xUKl7Nzswo6KE4Nj-kjJc7uSVcviKUc&m=Y- > 4kiSVRo1wsHsySpb2cQHh-ex6Y29UAzo2cqTjH170&s=wZUoYtYo_ > 0J9nYj93G7MECAtlVnDGqwYkxekWrMcS_c&e= > >* > > * Maven artifacts to be voted upon: > https://urldefense.proofpoint.com/v2/url?u=https-3A__ > repository.apache.org_content_groups_staging_org_apache_ > kafka_&d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_xUKl7Nzswo6KE4Nj- > kjJc7uSVcviKUc&m=Y-4kiSVRo1wsHsySpb2cQHh-ex6Y29UAzo2cqTjH170&s= > ZBwVY1iEInlnYrhGNXCc6aAqVIvzeteRMmIZMOU96Ro&e= > > > * Javadoc: > *https://urldefense.proofpoint.com/v2/url?u=http-3A__home.apache.org_- > 7Eguozhang_kafka-2D1.0.0-2Drc2_javadoc_&d=DwIBaQ&c=jf_ > iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_xUKl7Nzswo6KE4Nj-kjJc7uSVcviKUc&m=Y- > 4kiSVRo1wsHsySpb2cQHh-ex6Y29UAzo2cqTjH170&s=EHGUdPQVNQ7_ > NIu6GZiQkJAyJ47U2L29pP5BguaGmyQ&e= > < > https://urldefense.proofpoint.com/v2/url?u=http-3A__home. > apache.org_-7Eguozhang_kafka-2D1.0.0-2Drc2_javadoc_&d= > DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_xUKl7Nzswo6KE4Nj- > kjJc7uSVcviKUc&m=Y-4kiSVRo1wsHsySpb2cQHh-ex6Y29UAzo2cqTjH170&s= > EHGUdPQVNQ7_NIu6GZiQkJAyJ47U2L29pP5BguaGmyQ&e= > >* > > * Tag to be voted upon (off 1.0 branch) is the 1.0.0-rc2 tag: > > https://urldefense.proofpoint.com/v2/url?u=https-3A__git- > 2Dwip-2Dus.apache.org_repos_asf-3Fp-3Dkafka.git-3Ba-3Dtag-3Bh- > 3D51d5f12e190a38547839c7d2710c97faaeaca586&d=DwIBaQ&c=jf_ > iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_xUKl7Nzswo6KE4Nj-kjJc7uSVcviKUc&m=Y- > 4kiSVRo1wsHsySpb2cQHh-ex6Y29UAzo2cqTjH170&s=COtA4ahaqcJTWffraDwoLcmWgN- > P6H9AeERP3gO2uNg&e= > > > * Documentation: > Note the documentation can't be pushed live due to changes that will not > go > live until the release. You can manually verify by downloading > https://urldefense.proofpoint.com/v2/url?u=http-3A__home. > apache.org_-7Eguozhang_kafka-2D1.0.0-2Drc2_kafka-5F2.11- > 2D1.0.0-2Dsite-2Ddocs.tgz&d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_ > xUKl7Nzswo6KE4Nj-kjJc7uSVcviKUc&m=Y-4kiSVRo1wsHsySpb2cQHh- > ex6Y29UAzo2cqTjH170&s=WsEQ5ytw3z4yGPEuf9-6AdrxQ02H5miU5ilKMu00SCw&e= > > > * Successful Jenkins builds for the 1.0.0 branch: > Unit/integration tests: > https://urldefense.proofpoint.com/v2/url?u=https-3A__builds. > apache.org_job_kafka-2D1.0-2Djdk7_40_&d=DwIBaQ&c=jf_ > iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_xUKl7Nzswo6KE4Nj-kjJc7uSVcviKUc&m=Y- > 4kiSVRo1wsHsySpb2cQHh-ex6Y29UAzo2cqTjH170&s=oCcBm4jnOuMPQrd5UdQ2wEpUlhJhQn > O2UQ-ijbZm6ks&e= > > System test: > https://urldefense.proofpoint.com/v2/url?u=https-3A__ > jenkins.confluent.io_job_system-2Dtest-2Dkafka-2D1.0_6_ > &d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Q_itwloTQj3_xUKl7Nzswo6KE4Nj- > kjJc7uSVcviKUc&m=Y-4kiSVRo1wsHsySpb2cQHh-ex6Y29UAzo2cqTjH170&s= > TPeFv8fM40T5mhe_Ij4QAvVmGVRiZM1RUhWTZ0_QTPQ&e= > > > > /************************************** > > > Thanks, > -- Guozhang > > > > > -- -- Guozhang
