Just put a update here, Here is one PR for fixing the publish message issue https://github.com/apache/pulsar/pull/12590 and currently we are working on the integration tests. Looks like we are not able to startup a geo-replication cluster in the Github Action, I have tested it locally, the fix works.
Another one is related to the partitioned topic creation, Ran Gao is working on this part. Thanks, Penghui On Tue, Nov 2, 2021 at 5:15 PM PengHui Li <peng...@apache.org> wrote: > Thanks, I'm working on a fix. > > -Penghui > > On Tue, Nov 2, 2021 at 2:21 PM Enrico Olivelli <eolive...@gmail.com> > wrote: > >> Penghui, >> Thanks >> >> >> >> Il Mar 2 Nov 2021, 04:31 PengHui Li <peng...@apache.org> ha scritto: >> >> > The non-persistent partitioned topic with geo-replicated enabled is not >> > working in 2.9.0 rc2, >> > >> >> I will hold the result until you complete your investigations >> >> Enrico >> >> >> I have tested on 2.8.1, it works. But for 2.9.0 when I create a >> > non-persistent partitioned topic, I will get a timeout exception >> > >> > ``` >> > bin/pulsar-admin topics create-partitioned-topic >> > non-persistent://public/default/test1 -p 10 >> > Warning: Nashorn engine is planned to be removed from a future JDK >> release >> > null >> > >> > Reason: java.util.concurrent.TimeoutException >> > ``` >> > >> > This does not appear every time, but it is always easy to appear when >> first >> > created after starting the geo cluster. >> > >> > A more serious problem is the client side can't send messages to the >> > non-persistent partitioned topic >> > >> > ``` >> > bin/pulsar-perf produce -s 2048 -r 100 -bm 1 >> > non-persistent://public/default/test1 >> > >> > 11:23:58.251 [main] INFO >> org.apache.pulsar.testclient.PerformanceProducer >> > - Throughput produced: 0 msg --- 0.0 msg/s --- 0.0 >> Mbit/s >> > --- failure 0.0 msg/s --- Latency: mean: 0.000 ms - med: 0.000 >> - >> > 95pct: 0.000 - 99pct: 0.000 - 99.9pct: 0.000 - 99.99pct: 0.000 - >> > Max: 0.000 >> > 11:24:08.358 [main] INFO >> org.apache.pulsar.testclient.PerformanceProducer >> > - Throughput produced: 0 msg --- 0.0 msg/s --- 0.0 >> Mbit/s >> > --- failure 0.0 msg/s --- Latency: mean: 0.000 ms - med: 0.000 >> - >> > 95pct: 0.000 - 99pct: 0.000 - 99.9pct: 0.000 - 99.99pct: 0.000 - >> > Max: 0.000 >> > 11:24:18.420 [main] INFO >> org.apache.pulsar.testclient.PerformanceProducer >> > - Throughput produced: 0 msg --- 0.0 msg/s --- 0.0 >> Mbit/s >> > --- failure 0.0 msg/s --- Latency: mean: 0.000 ms - med: 0.000 >> - >> > 95pct: 0.000 - 99pct: 0.000 - 99.9pct: 0.000 - 99.99pct: 0.000 - >> > Max: 0.000 >> > 11:24:28.462 [main] INFO >> org.apache.pulsar.testclient.PerformanceProducer >> > - Throughput produced: 0 msg --- 0.0 msg/s --- 0.0 >> Mbit/s >> > --- failure 0.0 msg/s --- Latency: mean: 0.000 ms - med: 0.000 >> - >> > 95pct: 0.000 - 99pct: 0.000 - 99.9pct: 0.000 - 99.99pct: 0.000 - >> > Max: 0.000 >> > >> > ``` >> > >> > ``` >> > bin/pulsar-perf produce -s 2048 -r 100 -bm 1 >> > non-persistent://public/default/test2 >> > >> > 11:24:49.057 [pulsar-client-io-2-1] INFO >> > org.apache.pulsar.client.impl.ProducerImpl - >> > [non-persistent://public/default/test2-partition-3] [null] Creating >> > producer on cnx [id: 0x6d5aa588, L:/127.0.0.1:53168 - R:/127.0.0.1:6652 >> ] >> > 11:24:58.513 [main] INFO >> org.apache.pulsar.testclient.PerformanceProducer >> > - Throughput produced: 0 msg --- 0.0 msg/s --- 0.0 >> Mbit/s >> > --- failure 0.0 msg/s --- Latency: mean: 0.000 ms - med: 0.000 >> - >> > 95pct: 0.000 - 99pct: 0.000 - 99.9pct: 0.000 - 99.99pct: 0.000 - >> > Max: 0.000 >> > 11:25:08.659 [main] INFO >> org.apache.pulsar.testclient.PerformanceProducer >> > - Throughput produced: 0 msg --- 0.0 msg/s --- 0.0 >> Mbit/s >> > --- failure 0.0 msg/s --- Latency: mean: 0.000 ms - med: 0.000 >> - >> > 95pct: 0.000 - 99pct: 0.000 - 99.9pct: 0.000 - 99.99pct: 0.000 - >> > Max: 0.000 >> > ``` >> > >> > But I'm able to produce a message on 2.8.1 and I'm checking more details >> > for now. >> > >> > >> > The reproduce steps are(2.9.0 rc2): >> > >> > 1. Start a geo-replication instance with 2 clusters, I have 3 brokers >> for >> > each cluster >> > 2. Create a non-persistent partitioned topic such as 10 partitions >> > 3. Use pulsar-perf to publish messages to the partitioned topic >> > 4. Verify if the message produce throughput is 0, such as >> `bin/pulsar-perf >> > produce -s 2048 -r 100 -bm 1 non-persistent://public/default/test` >> > >> > >> > Repeat the same above steps on 2.8.1, verify if the message produce >> > throughput is not 0 >> > >> > Thanks, >> > Penghui >> > >> > On Mon, Nov 1, 2021 at 7:37 PM r...@apache.org <ranxiaolong...@gmail.com >> > >> > wrote: >> > >> > > +1 (non-binding) >> > > >> > > 1. Validate Pub/Sub and Java Functions >> > > 2. Validate Connectors >> > > 3. Validate Stateful Functions >> > > 4. Validate the sha512 checksums and gpg signatures >> > > 5. Validate Go SDK pub/sub >> > > >> > > -- >> > > Thanks >> > > Xiaolong Ran >> > > >> > > >> > > Massimiliano Mirelli <massimilianomirelli...@gmail.com> 于2021年11月1日周一 >> > > 上午5:57写道： >> > > >> > > > +1 (non-binding) >> > > > >> > > > Verified: >> > > > >> > > > 1. downloading the source/binary >> > > > 2. verifying the sha512 checksums and gpg signatures >> > > > 3. building docker image and pushing to own dockerhub repo >> > > > 4. generating a basic fallout test specification from >> > > > >> > > > >> > > > >> > > >> > >> https://github.com/datastax/pulsar-fallout/blob/master/release_validation/template.yaml >> > > > 5. validating the produced docker image with fallout >> > > > >> > > > Fixes needed: >> > > > 1. chmod +x /docker/pulsar/scripts/*.py >> > > > >> > > > Apparently, we didn't get this PR ( >> > > > https://github.com/apache/pulsar/pull/11951) in, my bad :*( . >> > > > >> > > > On Fri, 29 Oct 2021 at 19:31, Matteo Merli <mme...@apache.org> >> wrote: >> > > > >> > > > > +1 binding >> > > > > >> > > > > Checked: >> > > > > * Signatures >> > > > > * Bin distribution: >> > > > > - NOTICE, README, LICENSE >> > > > > - Start standalone service and producer/consumer test >> > > > > * Src distribution: >> > > > > - NOTICE, README, LICENSE >> > > > > - Compile and unit tests >> > > > > - Start standalone service >> > > > > * Checked staging maven repository artifacts >> > > > > >> > > > > >> > > > > >> > > > > -- >> > > > > Matteo Merli >> > > > > <mme...@apache.org> >> > > > > >> > > > > On Fri, Oct 29, 2021 at 3:59 AM Masahiro Sakamoto >> > > > > <massa...@yahoo-corp.jp> wrote: >> > > > > > >> > > > > > +1 (binding) >> > > > > > >> > > > > > - Checked checksums and signatures >> > > > > > - Compiled the source >> > > > > > - Ran the standalone server >> > > > > > - Confirmed that producer and consumer work properly >> > > > > > - Confirmed that the sample function works properly >> > > > > > - Confirmed that the cassandra connector works properly >> > > > > > >> > > > > > Regards, >> > > > > > >> > > > > > Masahiro Sakamoto >> > > > > > Yahoo Japan Corp. >> > > > > > E-mail: massa...@yahoo-corp.jp >> > > > > > >> > > > > > -----Original Message----- >> > > > > > From: Nicolò Boschi <boschi1...@gmail.com> >> > > > > > Sent: Thursday, October 28, 2021 10:21 PM >> > > > > > To: dev@pulsar.apache.org >> > > > > > Subject: Re: [VOTE] Pulsar Release 2.9.0 Candidate 2 >> > > > > > >> > > > > > +1 (non binding) >> > > > > > >> > > > > > Checks: >> > > > > > - checksum and signature >> > > > > > - build from source (build, apache-rat:check pass) >> > > > > > - build docker images from source >> > > > > > -- producing and consuming a message >> > > > > > -- java functions >> > > > > > >> > > > > > Il giorno gio 28 ott 2021 alle ore 09:22 Oguni Hideaki < >> > > > > hog...@yahoo-corp.jp> >> > > > > > ha scritto: >> > > > > > >> > > > > > > +1 (non-binding) >> > > > > > > >> > > > > > > - verified checksums and signatures >> > > > > > > - build from source >> > > > > > > - verified pub/sub and java functions >> > > > > > > - verified connectors >> > > > > > > - verified stateful functions >> > > > > > > >> > > > > > > Hideaki Oguni >> > > > > > > Yahoo Japan Corp. >> > > > > > > E-mail: hog...@yahoo-corp.jp >> > > > > > > >> > > > > > > -----Original Message----- >> > > > > > > From: Enrico Olivelli <eolive...@gmail.com> >> > > > > > > Reply-To: "dev@pulsar.apache.org" <dev@pulsar.apache.org> >> > > > > > > Date: Wednesday, October 27, 2021 0:40 >> > > > > > > To: Dev <dev@pulsar.apache.org> >> > > > > > > Subject: [VOTE] Pulsar Release 2.9.0 Candidate 2 >> > > > > > > >> > > > > > > This is the second release candidate for Apache Pulsar, >> > version >> > > > > 2.9.0. >> > > > > > > >> > > > > > > I just rebuilt the package, no changes in respect to >> > candidate >> > > 1, >> > > > > > > because I >> > > > > > > had a dirty version of BookKeeper in my local Maven cache. >> > > > > > > >> > > > > > > It fixes the following issues: >> > > > > > > >> > > > > > > >> > > > > >> > > > >> > > >> > >> https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpulsar%2Fmilestone%2F30%3Fclosed%3D1&data=04%7C01%7Cmassakam%40yahoo-corp.jp%7Cf217a4dd795a4928b3ef08d99a15db3c%7Ca208d369cd4e4f87b11998eaf31df2c3%7C1%7C0%7C637710242401463183%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=mI%2FcIus4mHWtXCb28Nm8DQ%2Fi%2BdroIzGUKMcn2iLhjXI%3D&reserved=0 >> > > > > > > >> > > > > > > *** Please download, test and vote on this release. This >> vote >> > > > will >> > > > > > > stay open >> > > > > > > for at least 72 hours *** >> > > > > > > >> > > > > > > Note that we are voting upon the source (tag), binaries >> are >> > > > > provided >> > > > > > > for >> > > > > > > convenience. >> > > > > > > >> > > > > > > Source and binary files: >> > > > > > > >> > > > > > > >> > > > > >> > > > >> > > >> > >> https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fpulsar%2Fpulsar-2.9.0-candidate-2%2F&data=04%7C01%7Cmassakam%40yahoo-corp.jp%7Cf217a4dd795a4928b3ef08d99a15db3c%7Ca208d369cd4e4f87b11998eaf31df2c3%7C1%7C0%7C637710242401463183%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=%2Fc7RWvJ%2FS8Igdc1FH1yhlO5%2BUIOMRKCwdHHUUqY5gQ4%3D&reserved=0 >> > > > > > > >> > > > > > > SHA-512 checksums: >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > >> > > > >> > > >> > >> d9eee279c23f2ef04a841c1e33fbe5da70d74905912425fc25024f628e7c0d02b834a5c8c6f1b982bc7c30e8969358bf9d203036929a4bd730c3317d4f42b58b >> > > > > > > apache-pulsar-2.9.0-SNAPSHOT-bin.tar.gz >> > > > > > > >> > > > > > > >> > > > > >> > > > >> > > >> > >> d6201fbec019c531bd26558e433f6dcc1c19f8d4966ddff261e6f90b12611e0d082d5c5033a157d7c3b49ef8cb20b0404b9cec2b17a0d4bbde9a178728eec161 >> > > > > > > apache-pulsar-2.9.0-SNAPSHOT-src.tar.gz >> > > > > > > >> > > > > > > Maven staging repo: >> > > > > > > >> > > > > > > >> > > > > >> > > > >> > > >> > >> https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachepulsar-1102%2F&data=04%7C01%7Cmassakam%40yahoo-corp.jp%7Cf217a4dd795a4928b3ef08d99a15db3c%7Ca208d369cd4e4f87b11998eaf31df2c3%7C1%7C0%7C637710242401463183%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=2eBNOKaEW2N72hlBzJsrn1ZBxQy7rzN6UFX%2B03Lt8ck%3D&reserved=0 >> > > > > > > >> > > > > > > The tag to be voted upon: >> > > > > > > v2.9.0-candidate-2 >> (c7157daf9a3ff21ebdf25f2962700bc7623f4804) >> > > > > > > >> > > > > > > >> > > > > >> > > > >> > > >> > >> https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpulsar%2Freleases%2Ftag%2Fv2.9.0-candidate-2&data=04%7C01%7Cmassakam%40yahoo-corp.jp%7Cf217a4dd795a4928b3ef08d99a15db3c%7Ca208d369cd4e4f87b11998eaf31df2c3%7C1%7C0%7C637710242401463183%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=5bZSlS6vtR7AM2UlF%2BfLHORgZIlqm%2FGbo8gVwV2qH3g%3D&reserved=0 >> > > > > > > >> > > > > > > Pulsar's KEYS file containing PGP keys we use to sign the >> > > > release: >> > > > > > > >> > > > > > > >> > > > > >> > > > >> > > >> > >> https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fpulsar%2FKEYS&data=04%7C01%7Cmassakam%40yahoo-corp.jp%7Cf217a4dd795a4928b3ef08d99a15db3c%7Ca208d369cd4e4f87b11998eaf31df2c3%7C1%7C0%7C637710242401463183%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=6aBq0b%2BV44YVZCJxeeIxXQ37zBUyxwU%2BmEB2pOTTTp0%3D&reserved=0 >> > > > > > > >> > > > > > > Release notes draft: >> > > > > > > >> > > > > > > >> > > > > >> > > > >> > > >> > >> https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fpulsar%2Fpull%2F12425&data=04%7C01%7Cmassakam%40yahoo-corp.jp%7Cf217a4dd795a4928b3ef08d99a15db3c%7Ca208d369cd4e4f87b11998eaf31df2c3%7C1%7C0%7C637710242401463183%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=mYcG8dwI3228%2BfF15p0%2B9EpVRRN9T8ioYMV%2ByQCnuxA%3D&reserved=0 >> > > > > > > >> > > > > > > Please download the source package, and follow the README >> to >> > > > build >> > > > > > > and run the Pulsar standalone service. >> > > > > > > >> > > > > > > Enrico Olivelli >> > > > > > > >> > > > > > > >> > > > > > >> > > > > > -- >> > > > > > Nicolò Boschi >> > > > > >> > > > >> > > >> > >> >
