Re: [VOTE] Pulsar Release 2.5.1 Candidate 3

ommon.java:221) at org.apache.pulsar.functions.utils.FunctionCommonTest.testDownloadFile(FunctionCommonTest.java:78) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Il giorno lun 13 apr 2020 alle ore 11:01 Enrico Olivelli < eo

Re: [VOTE] Pulsar Release 2.5.1 Candidate 3

fail, and these tests will affect each other. It is often the case > that running a test alone can pass, but running it together will fail, and > these tests will affect each other. > > Thanks, > Guangning > > Enrico Olivelli 于2020年4月13日周一 下午5:56写道： > > > I have thi

Re: [Discuss] Apache pulsar-manager 0.2.0 release

Guangning Il giorno mer 24 giu 2020 alle ore 10:10 Guangning E ha scritto: > Hello everyone: > > It has been a long time since the release of the previous version's major > release (0.1.0). I am planning to start the 0.2.0 release soon (probably > this week). > > You can find the whole change li

Re: [VOTE] Pulsar Manager Release 0.2.0 Candidate 1

Guagning, I can't find your key here https://dist.apache.org/repos/dist/release/pulsar/KEYS Enrico Il giorno mar 8 set 2020 alle ore 15:46 xiaolong ran < ranxiaolong...@gmail.com> ha scritto: > Thanks ganging, LGTM +1(non-binding) > > -- > Thanks > Xiaolong Ran > > > 在 2020年9月8日，下午6:13，Guangning

Re: [VOTE] Pulsar Manager Release 0.2.0 Candidate 1

to: > I'm very sorry. I seem to have added a wrong link. My key is here > https://dist.apache.org/repos/dist/dev/pulsar/KEYS > > Thanks, > Guangning > > Enrico Olivelli 于2020年9月8日周二 下午10:00写道： > > > Guagning, > > I can't find your key here &g

Re: [VOTE] Pulsar Manager Release 0.2.0 Candidate 2

Guangning, great to see the new version of BKVM, thank you. It looks like my comment on RC0 was not addressed: the source tarball apache-pulsar-manager-0.2.0-src.tar.gz

Re: [VOTE] Pulsar Manager Release 0.2.0 Candidate 3

+1 - checked checksums and signatures (I suggest you to add your signature to https://dist.apache.org/repos/dist/release/pulsar/KEYS as well, as the other one is on "dev") - run tests on Java8, Mac and Fedora Linux(it is unfortunate that we can't build it on JDK11, I will send a PR soon) - tested

Re: [VOTE] Pulsar Manager Release 0.2.0 Candidate 3

> Guangning > > Nozomi Kurihara 于2020年9月11日周五 下午6:52写道： > > > +1 > > > > - verified checksums, signatures > > - ran successfully pulsar-manager and bkvm (on Mac 10.15.6) > > > > Thank you for your great work! > > > > Nozomi > > nkuri...@ap

Re: [ANNOUNCE] New Pulsar Committer: Huanli Meng & Hang Chen

Congratulations ! Enrico Il Lun 26 Ott 2020, 07:07 Guangning E ha scritto: > Congratulations to Huanli and Hang. > > Thanks, > Guangning > > Jinfeng Huang 于2020年10月26日周一 下午1:46写道： > > > Congratulations to Huanli and Hang, thank you very much for your > > contributions to the Pulsar community.

Re: [DISCUSS] Introduce a cherry-pick command for cherry-picking PRs automatically

In BookKeeper project we have a script that does the merge to the target branch, handles cherry picks and also updates GitHub milestones and labels it should work well on Pulsar Repository as well https://github.com/apache/bookkeeper/blob/master/dev/bk-merge-pr3.py Enrico Il giorno mer 28 ott 2

Pulsar 2.7.0 and BooKeeper version

Hello, we pushed today a change that upgraded BookKeeper library to 4.11.1, that is the latest released version of BookKeeper. BookKeeper 4.12.0 comes with great features that would be useful for Pulsar, especially BP-41, that allows Bookies to have dynamic network addresses and the support for Ex

Re: [ANNOUNCE] New PMC Member Jennifer Huang (hjf)

Congratulations Enrico Il Lun 2 Nov 2020, 10:40 Fangbin Sun ha scritto: > Congratulations Jennifer Huang! > > jiny...@foxmail.com 于2020年11月2日周一 下午3:53写道： > > > Congratulations Jennifer Huang! > > > > > > > > jiny...@foxmail.com > > > > From: Jia Zhai > > Date: 2020-11-02 10:56 > > To: Dev; use

Re: [DISCUSS] Apache Pulsar 2.7.0 Release

Penghui, Probably it is worth to wait for BookKeeper 4.12.0 release and upgrade BookKeeper dependency In BK 4.12.0 we have BP-41 http://bookkeeper.apache.org/bps/BP-41-bookieid/ that allows to separate the concept of BookieId from BookieSocketAddress. This is a preview of how the upgrade would

Re: Updates on PIP-62

Great ! We will make the repo very slighter ! Enrico Il giorno ven 6 nov 2020 alle ore 18:45 Sijie Guo ha scritto: > Hi all, > > I am starting this thread to provide updates on the progress of PIP-62. > > Now I have moved all the pulsar-flink / pulsar-spark / pulsar-storm / > pulsar-kafka-wrapp

Re: [VOTE] Pulsar Release 2.6.2 Candidate 2

+1 (non binding) Built on linux,jdk8 Checked signatures Run smoke tests Enrico Il Lun 9 Nov 2020, 06:16 xiaolong ran ha scritto: > The vote is now closed for Pulsar Release 2.6.2 Release Candidate 2 > with 5 "+1” (4 +1 binding votes) votes, 0 +0/-0 votes, 0 -1 votes. > > 4 +1 bindings are: > >

Re: [DISCUSS] Apache Pulsar 2.7.0 Release

Penghui, as BK 4.12.0 has been released to Maven Central, the upgrade in Pulsar is ready to land https://github.com/apache/pulsar/pull/8447 still needs review, but all tests in CI passed thank you for driving the release Enrico Il giorno mar 10 nov 2020 alle ore 10:30 xiaolong ran < ranxiaolong

Re: [VOTE] Pulsar Release 2.7.0 Candidate 1

Hi, Thank you for putting this together ! Is there any way to have a meaningful list of highlights of this new release ? I have followed the development and probably I know the contents of this release, but the Pulsar project is huge, and the link to github refers to too many details. For instanc

Re: [VOTE] Pulsar Release 2.7.0 Candidate 1

+0 (non-binding) - verified checksums and sigs - run smoke tests on the binary tarball - built from sources and run "pulsar standalone" from the resulting binaries - built on Mac and on Fedora, with JDK8 (AdoptOpenJDK) My vote is not a full +1 because if I run the sources there is a non-transient

Re: [VOTE] Pulsar Release 2.7.0 Candidate 1

on, in which the ${git.commit.id} placeholder is not replaced. The problem affects who is building Pulsar from sources out of a git repository, probably it is not a big deal. Best regards Enrico > We can fix it in the next release version. > > Thanks, > Penghui > On Nov 25,

Re: [VOTE] Pulsar Release 2.7.0 Candidate 2

+1 (non binding) - checked checksums and signatures - built and run tests on MacOs and Fedora, with JDK8 (reported a few non blocker issues) - run smoke tests on a single machine cluster, using custom "bookieId" (bookieId parameter in conf/bookkeeper.conf) great work Enrico Olivelli

Re: Apache Pulsar PIP - advertisedListener enhancement - Invitation to comment

Hi, I left a few comments on the documenations. Thanks for your efforts, I hope we can get this new feature in soon Regards Enrico Il giorno gio 3 dic 2020 alle ore 16:39 Abhilash Mandaliya (via Google Docs) ha scritto: > I've shared an item with you: > > Apache Pulsar PIP - advertisedListener

Re: [DISCUSS] Apache Pulsar 2.6.3 Release

Xialong, could you please also pick up this patch ? https://github.com/apache/pulsar/pull/8725 it is about an annoying issue we are having in production at MagNews.com, and we are on 2.6.2 Enrico Il giorno lun 7 dic 2020 alle ore 08:18 xiaolong ran < ranxiaolong...@gmail.com> ha scritto: > Hell

Re: [DISCUSS] Apache Pulsar 2.6.3 Release

Thanks ! Enrico Il giorno lun 7 dic 2020 alle ore 14:23 PengHui Li ha scritto: > Hi Enrico, > > I have cherry-picked https://github.com/apache/pulsar/pull/8725 to > branch-2.6 and branch-2.7. > > Thanks, > Penghui > On Dec 7, 2020, 6:32 PM +0800, dev@pulsar.apache.org, wrote: > > > > https://gi

Re: [DISCUSS] Apache Pulsar 2.6.3 Release

Having this change would be awesome as well https://github.com/apache/pulsar/pull/8854 Thanks Enrico Il Lun 7 Dic 2020, 16:37 Yuva raj ha scritto: > +1 > > On Mon, 7 Dec 2020 at 12:48, xiaolong ran > wrote: > > > Hello everyone: > > > > I hope you’ve all been doing well. Last month, we releas

Re: [PROPOSAL] PIP 75: Replace protobuf code generator

Dave, Il Mer 23 Dic 2020, 19:58 Dave Fisher ha scritto: > > > > On Dec 23, 2020, at 10:55 AM, Matteo Merli > wrote: > > > > Hi Dave, > > > > these are not dependencies that are needed (or would be pulled) from > > the Pulsar build. > > > > The JMH is only used if someone wants to run a benchmar

Re: PIP 76: Streaming Offload

That's a great feature Looking at the patch now Enrico Il giorno mar 5 gen 2021 alle ore 10:18 Renkai Ge ha scritto: > Hi, community: > Recently, we are facing some problems with the offloading > mechanism about performance, resource efficiency, time lag, and so on. So I > have drafted

Problem with CI and automatic retry of tests

Hi devs, I recently discovered a bad issue regarding the automatic retrials of failed tests with TestNG. Basically we are using a feature from TestNG that tries to recover a failed test and repeats the execution. The fact is that TestNG is not properly cleaning up the env and the second execution

Re: [ANNOUNCE] New Pulsar Committer: LinLin

Congratulations Enrico Il Mer 6 Gen 2021, 12:09 Sijie Guo ha scritto: > Congrats Lin! > > Looking forward to more contributions from him! > > - Sijie > > On Tue, Jan 5, 2021 at 11:05 PM PengHui Li wrote: > >> The Apache Pulsar PMC recently extended committer karma to LinLin and he >> has accep

Re: [VOTE] Pulsar Release 2.6.3 Candidate 1

Hi, thank you PengHui Li, I am validating the release, most of my tests are passing: - checksums/signatures - smoke tests with the binaries But I think I have come to a blocker for a release basically the staged sources do not match the git tag, and especially they are missing important files nee

Re: [Vote] Accept Supernova as part of Apache Pulsar project

+1 (non binding) Thanks Enrico Il giorno lun 11 gen 2021 alle ore 14:02 xiaolong ran < ranxiaolong...@gmail.com> ha scritto: > +1(non-binding) > > Thanks > Xiaolong Ran > 在 2021年1月11日 +0800 AM10:29，anonymitaet _ ，写道： > > +1 > > > > And we can add Haskell docs on the Pulsar website to bring more

Re: [VOTE] Pulsar Release 2.6.3 Candidate 1

ster branch and > > > On board the fix in 2.7.1. This will facilitate rapid iteration. If > this > > > is a break change introduced > > > In 2.6.3. we should stop this candidate and start a new candidate with > the > > > fix. > > > > > >

Re: [VOTE] Pulsar Release 2.6.3 Candidate 2

+1 (non binding) - checked checksums/signatures - built from sources with JDK8 on Mac (a few flaky tests) - run produce/consume smoke tests with pulsar-per from the binaries (on JDK8 + Mac + Pulsar standalone) My concerns about the differences between the source tarball has been addressed in a PR,

Re: [ANNOUNCE] New committer: Yong Zhang

Congratulations Yong! Enrico Il Ven 22 Gen 2021, 04:28 Huanli Meng ha scritto: > > Congratulations, Yong > > BR//Huanli > > > On Jan 22, 2021, at 10:41 AM, Guangning E wrote: > > > > Congratulations! > > > > Thanks, > > Guangning > > > > Dianjin Wang 于2021年1月22日周五 上午10:33写道： > > > >> Congrat

Re: How is the pulsar tar ball produced?

Kramer, it is in the distribution/server/pom.xml, we are using the Maven assembly plugin. If you want to binaries just run mvn clean package -am -pl distribution/server -DskipTests I hope that helps Enrico Il giorno lun 25 gen 2021 alle ore 15:57 Kramer, Andre < andre.kra...@softwareag.com> ha

Re: [Discuss] draft PIP for "Changes to flaky test handling"

To address the issues caused by flaky tests, I have been preparing a > draft > > PIP for "Changes to flaky test handling" together with Enrico Olivelli. > > > > The document is a Google doc: > > > > > https://docs.google.com/document/d/10lmn4pW1IsT_8D1ZE0vM

Virtual Pulsar Community Meetings

Hello everyone, in the BookKeeper community we used to have "Community Meetings" in order to meet each other, discuss current works on the project, share knowledge about current problems. What about having Community meetings for Pulsar ? I would be happy to organize and to host the first meeting.

Re: Virtual Pulsar Community Meetings

loaded to Youtube. So people are > able > > to watch the recordings as well. > > > > If people are good with this proposal, I am happy to set up and > coordinate > > the meetings given I have run many meetings in the BookKeeper community > > before. > > >

Re: Virtual Pulsar Community Meetings

> > > > If people are good with this proposal, I am happy to set up and > coordinate > > the meetings given I have run many meetings in the BookKeeper community > > before. > > > > We can get started next Tuesday and formalize the process as we go. > P

Re: PIP 80 Unified namespace-level admin API

Penghui, thanks for the initiative, awesome work +1 I left just one comment in the GDoc Enrico Il giorno mar 2 feb 2021 alle ore 15:57 PengHui Li ha scritto: > Hi all, we have drafted a PIP to discuss unify the namespace-level admin > API. The details of the proposal you can see > > https://d

Pulsar Server on JDK11 - initial discussion

Hello Pulsar community, I would like to start a discussion about Java 11 support and about dropping support for JDK8 on the server side. It will take time, see my points below. At the moment we have these use cases about Java compatibility: - Java client users - Building Pulsar and running Pulsar

Attention please: CI is not running tests against Pull Requests today

Hello, today I saw that the GH queue was pretty empty. And I also realized that my PRs had been validated super quickly. I saw this problem, basically CI is no more validating PRs. The bad thing is that CI is reported as GREEN ! I created this issue in order to track the problem https://github.c

Re: Pulsar Server on JDK11 - initial discussion

njoy JDK11 >> - Pulsar developers will get used to having JDK11, but they won't be able to leverage JDK11 language and JRE features (only faster runtime, GC) Enrico > > Because I think there are still a lot of users running with Java 8. > > - Sijie > > On Mon, F

Re: Pulsar Server on JDK11 - initial discussion

Lari, We know that there will be work to do, I am happy to do what is needed in order to make this work Thanks for pointing it out Enrico Il giorno mar 9 feb 2021 alle ore 09:44 Enrico Olivelli ha scritto: > Sijie, > > Il giorno mar 9 feb 2021 alle ore 09:42 Sijie Guo ha > scrit

Re: Pulsar Server on JDK11 - initial discussion

Yunze, It's not exactly as you write. We will be building and testing on JDK11. Binaries, both server and client, will be able to run on jdk8 Building on jdk11 targeting jdk8 does not bring much benefit as you cannot use jdk11 features and also the byte code will look like the jdk8 version (for

Re: Pulsar Server on JDK11 - initial discussion

rst thing (and the hardest one) to do is to see all tests passing on Java 11 Thank you all for this discussion Enrico > > > 2021年2月9日 下午5:41，Enrico Olivelli 写道： > > > > Yunze, > > It's not exactly as you write. > > > > We will be building and testing on JD

Working on Kafka Connector

Hello everyone, here in our Pulsar repository we have a simple Kafka Connector for Pulsar IO composed by a Sink and a Source. https://github.com/apache/pulsar/tree/master/pulsar-io/kafka I have started to work on a set of enhancements to this connector in order to make it more powerful and to bett

Re: Working on Kafka Connector

r/src/main/java/io/streamnative/connectors/kafka/KafkaSource.java#L338 > > I am happy to submit a PR to merge those changes back. > > - Sijie > > On Thu, Feb 11, 2021 at 11:48 PM Enrico Olivelli > wrote: > > > Hello everyone, > > here in our Pulsar repositor

Re: [DISCUSS] Apache Pulsar 2.7.1 Release

I am happy to see the 2.7.1 release! +1 Enrico Il giorno gio 18 feb 2021 alle ore 01:55 Anonymitaet _ < anonymita...@hotmail.com> ha scritto: > +1 > > On 2021/2/18, 08:07, "PengHui Li" wrote: > > +1 > > Thanks, > Penghui > > Sijie Guo 于2021年2月18日周四 上午6:59写道： > > > +1

Re: First Pulsar Community Meeting - 2/2 & 2/4

Rajan, I can pick up https://github.com/apache/pulsar/issues/9644 Replace local ZooKeeper and cache access from PulsarService and replace with Metadata-store API can you please assign the issue to me ? Enrico Il giorno sab 20 feb 2021 alle ore 01:15 Rajan Dhabalia < rdhaba...@apache.org> ha scri

Publishing new version of Pulsar Build Docker image

Hello, we have merged a change to the Pulsar Builder image in order to allow builds to JDK11 (the default is still JDK8) https://github.com/apache/pulsar/pull/9609 Can you please publish the new image to Dockerhub ? The new image also contains: - Python 3 runtime (together with Python 2.7) - Upgr

Re: Publishing new version of Pulsar Build Docker image

pulsar/issues/9682 > > On Tue, 23 Feb 2021 at 05:08, Ali Ahmed wrote: > > > I have pushed the new image to "apachepulsar/pulsar-build:ubuntu-16.04" > > > > -Ali > > > > On Mon, Feb 22, 2021 at 5:05 AM Enrico Olivelli > > wrote: > > > &

Re: Publishing new version of Pulsar Build Docker image

Thanks Enrico Il giorno mar 23 feb 2021 alle ore 10:43 Yong Zhang < zhangyong1025...@gmail.com> ha scritto: > I have pushed the old image. > > We can push a new image with a new tag after the issue is addressed. > > On Tue, 23 Feb 2021 at 16:09, Enrico Olivelli wrote: &g

Re: [DISCUSS] Log Levels for Broker's ServerCnx Class

Michael, I saw the same issue. Probably we are adding sometimes too much log during development and we forget about the impact in production. I would create an issue for your cases and address each case one at a time. If we go for a general review of all "info" level logs we could end up in removi

Re: Working on Kafka Connector

this Connector Enrico Il giorno mar 16 feb 2021 alle ore 05:31 Sijie Guo ha scritto: > Thanks, I will review the PR. > > - Sijie > > On Mon, Feb 15, 2021 at 2:47 AM Enrico Olivelli > wrote: > > > Sijie, > > > > I managed to implement Avro sup

Spotbugs exlusions files problem

Hello, I noticed today that we are putting the findBugsExclude.xml file inside src/main/resources. This is not a good practice as we are going to put that file into the file .jar file produced by every Maven module who has that file. I suggest moving the file somewhere else. We could also use @S

Re: Pulsar Server on JDK11 - initial discussion

://github.com/apache/pulsar/issues/9720 Having some "label" would help in qualifying the issue. If anyone is interested in working on fixes on these issues please add a comment on the issue Enrico Il giorno mer 10 feb 2021 alle ore 09:54 Enrico Olivelli ha scritto: > > Renkai, >

Re: [DISCUSS] Apache Pulsar 2.7.1 Release

We have recently released Bookkeeper 4.13.0. The contents of the release are mostly about making 'stable' the stream storage service, that is fundamental for Pulsar Stateful Functions. In order to make the BK stream service more stable we had to upgrade GRPC. I would like to know that you think ab

Re: Working on Kafka Connector

again today or tomorrow. > > - Sijie > > On Wed, Feb 24, 2021 at 3:49 AM Enrico Olivelli wrote: > > > Hello community, > > It looks like only Sijie started to review this work. > > https://github.com/apache/pulsar/pull/9448 > > > > I wonder if others that

Re: Working on Kafka Connector

gt; I would like to work directly here within the project by sending pull > >> requests to the ASF repo and I am not willing to not create my own > >> Kafka Connector fork. > >> I believe this is the best approach for the community, > >> but I need some support fro

Re: [DISCUSS] Apache Pulsar 2.7.1 Release

> > Pulsar 2.8.0. And it's been a long time since we released the 2.7.0 so we > > can > > release Pulsar 2.8.0 at the end of March. > > > > Yong > > > > On Mon, 1 Mar 2021 at 02:18, Enrico Olivelli wrote: > > > > > We have recently rel

Re: [VOTE] Pulsar Release 2.7.1 Candidate 1

Yong, I cannot find your signature at https://dist.apache.org/repos/dist/release/pulsar/KEYS can you please add yourself ? otherwise I cannot validate the digital signatures of the artifacts Thanks Enrico Il giorno lun 8 mar 2021 alle ore 05:41 Yong Zhang ha scritto: > > Hi all. > > This is the

Re: [VOTE] Pulsar Release 2.7.1 Candidate 1

08:04 Enrico Olivelli ha scritto: > > Yong, > I cannot find your signature at > https://dist.apache.org/repos/dist/release/pulsar/KEYS > > can you please add yourself ? > otherwise I cannot validate the digital signatures of the artifacts > > Thanks > Enrico > >

Re: [VOTE] Pulsar Release 2.7.1 Candidate 1

t; > > https://dist.apache.org/repos/dist/release/pulsar/KEYS > > > > are the PMC keys. They have permission to promote a candidate > > > > release to a stable release. > > > > > > > > For the docker image build, it's might an issue but it'

Re: [Discuss] draft PIP for "Changes to GitHub Actions based Pulsar CI"

Lari, Thank you for this work. I have been following it very closely and I am happy that we are close to be able to leverage it very soon. What is the next step in order to apply these changes to the Pulsar repo ? IIUC all of the changes that blocked you on building up this work have been merged (

Problems with Avro upgrade from 1.9 to 1.10

Hello, I am working on the upgrade of Avro from 1.9 to 1.10.1. I noticed a bad behaviour change about Schema.AVRO(Pojo.class). Basically the new Avro version creates the Schema by sorting the fields in alphabetical order and this is an incompatible schema change. More details here https://github.

Re: Problems with Avro upgrade from 1.9 to 1.10

don't depend on the ordering for the compatibility checks. > > Can you explain more about the compatibility issue you refer to? > > Thanks, > Sijie > > On Mon, Mar 15, 2021 at 3:52 AM Enrico Olivelli wrote: > > > Hello, > > I am working on the upgrade of Avro

Re: Problems with Avro upgrade from 1.9 to 1.10

uot;null","int"],"default":null}]} ENCODED: AgRmMQKcAQ== [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.326 s <<< FAILURE! - in SenderTest [ERROR] helloCompatibility Time elapsed: 0.313 s <<< ERROR! java.lang.ArrayIn

Re: Problems with Avro upgrade from 1.9 to 1.10

schema and reader schema in order. > > See: > > https://avro.apache.org/docs/1.8.2/api/java/org/apache/avro/generic/GenericDatumReader.html#GenericDatumReader(org.apache.avro.Schema,%20org.apache.avro.Schema) > > - Sijie > > > > On Tue, Mar 16, 2021 at 9:21 A

Re: Proposal to change how git checkout is done for PR builds

Il giorno mer 17 mar 2021 alle ore 08:56 Lari Hotari ha scritto: > > Dear Pulsar community members, > > I would like to propose a change how Pull Request (PR) builds are handled > in Pulsar CI. > > In GitHub Actions, the default way to handle PR builds is to checkout > GitHub provided merge_commit

Enhancements to Pulsar IO

f a database, put the PK into the key and the rest of the record into the value. Use the convention that a NULL value means a DELETE operation and a non NULL value is an UPSERT. Thoughts ? Enrico Olivelli

Re: Enhancements to Pulsar IO

to Pulsar, and there is no easy and no standard way to do it > > > *Problem 3: Pulsar IO Records do not allow NULL values* > Don't have a problem with this. The use case you provided makes sense. I will send a patch, thanks Enrico > > On Wed, Mar 17, 2021 at 2:04 AM Enri

Re: Enhancements to Pulsar IO

omething > can be implemented at a higher layer then we should implement it there and > not try to push it down to the framework layer. > > Best, > > Jerry > > On Thu, Mar 18, 2021 at 1:38 AM Enrico Olivelli wrote: > > > Jerry > > > > Il giorno gio 18 mar 20

Re: Setting up personal Pulsar CI for reducing load on apache/pulsar CI

Lari Can we configure CI in a way that it does not trigger the PR validation if the PR is in draft status? Or another way would be that we do not trigger the validation at PR creation, but only when you issue a special command IIRC the Netty project works this way. It will be also safer, especia

Re: Setting up personal Pulsar CI for reducing load on apache/pulsar CI

on, https://github.com/peter-evans/slash-command-dispatch, but I don't > think that there is a solution for the security issues. > > One of the main security issues would be a cache poisoning attack. A PR > build that is run in the context of the main repository could "poison" t

Re: Working on Kafka Connector

and for compaction. Please take a look if you are interested, there is still much work to be done, but the results are promising Enrico Il giorno lun 1 mar 2021 alle ore 22:32 Enrico Olivelli ha scritto: > > > > Il Lun 1 Mar 2021, 22:20 Sijie Guo ha scritto: >> >> Enric

Re: Enhancements to Pulsar IO

e. For consumer declared like > > Consumer, getSchema() calls on messages the consumer returns will > > always be SCHEMA.BYTES, regardless of what the actual schema the message > > was produced with. The schema of message is overridden when byte[] is > > specified as th

Re: Enhancements to Pulsar IO

Il giorno lun 22 mar 2021 alle ore 11:44 Enrico Olivelli ha scritto: > > Sijjie, Jerry, Matteo > I have created this GDoc that explains the problem, and the points we > raised in the various PRs and in the Community meeting. > > I hope that it clarifies my need for Schema

Re: [ANNOUNCE] New committer: Ran Gao

Kudos Ran Enrico Il Gio 25 Mar 2021, 04:44 Anonymitaet _ ha scritto: > Congrats Ran! > > > > Great job on all your hard work that led to your promotion. > > > > *From: *Jinfeng Huang > *Reply-To: *"us...@pulsar.apache.org" > *Date: *Thursday, March 25, 2021 at 10:06 > *To: *pulsar-users > *

Re: Enhancements to Pulsar IO

the actual schema implementation. > 3) It also provides extensibility than `Object`. Because it makes > `GenericRecord` a root object for representing objects deserialized from a > log record. > > Thanks, > Sijie > > > > > > On Wed, Mar 24, 2021 at 9:43 AM Enric

Re: State of pulsar-adaptors project

It looks like it is the repository in which Sijie is pushing the Adapters as part as PIP-62 initiative The code is still on master branch and this is only a partial copy Enrico Il Sab 27 Mar 2021, 00:33 Andrey Yegorov ha scritto: > Hello, > > I am trying to understand state of the pulsar-adapto

Re: [DISCUSS] Fix 2.7.1 DEB and RPM packages

Il Sab 27 Mar 2021, 08:41 Yong Zhang ha scritto: > Hi all， > > When releasing 2.7.1 DEB and RPMs packages I upload them as a tarball > and that will make some user can not download them properly. Do we have a github issue to track this problem? So I want to > decompress them and reupload it t

Re: [DISCUSS] Fix 2.7.1 DEB and RPM packages

tarball, just upload the missing deb > and rpm packages so that users can continue to use the tarball and the > unpacked packages > > Thanks, > Guangning > > Enrico Olivelli 于2021年3月27日周六 下午5:55写道： > > > Il Sab 27 Mar 2021, 08:41 Yong Zhang ha scritto: > >

Re: [DISCUSS] Fix 2.7.1 DEB and RPM packages

tarball and > upload the > inner content to the dist. > +1 Enrico > On Sat, 27 Mar 2021 at 19:47, Enrico Olivelli wrote: > > > are the tarballs generated during the execution of the release > > procedure or do you need to create new files that have not been > > &

Re: Enhancements to Pulsar IO

Il giorno ven 26 mar 2021 alle ore 07:50 Enrico Olivelli ha scritto: > > Sijie, > I have a proposal that fits your points and my needs > > 1. Introduce a new PulsarObject interface, that is a wrapper for any data type > > interface PulsarObject { > Schema/

Re: [DISCUSS] PIP 83 : Pulsar client: Message consumption with pooled buffer

Rajan (and Matteo), very interesting feature. How are we going to implement this feature ? it looks like it is bound to the Schema.BYTEBUFFER implementation, the doc does not tell much about how we have to change the Schema API in order to pass the Consumer configuration to the Schema implementati

Re: [DISCUSS] Request to Release 2.7.2 with Cursor Metrics Configuration Fix

Michael, Il giorno mer 31 mar 2021 alle ore 06:55 Michael Marshall ha scritto: > > Hi All, > > I propose and request that we release version 2.7.2 to fix a regression > introduced in 2.7.1. > > Pulsar 2.7.1 introduced cursor level metrics without including the ability > to disable them (https://g

Using a script to commit paches

Hello, I was talking with Peng Hui about the fact that in BK community we have this nice script [1] that performs automatically all of the steps for merging a PR: - merge with target branch and squashes commits - keeps the original author of the patch - create a meaningful commit message - adds the

Very flaky CPP tests - BasicEndToEndTest.testLookupThrottling

Hello, We have this BasicEndToEndTest.testLookupThrottling CPP test that is very flaky We already created two issues about it https://github.com/apache/pulsar/issues/6301 https://github.com/apache/pulsar/issues/6267 Is there any expert of the CPP client that can help in fixing this? In my experie

Flaky tests - more than usual

Hello, today I see these tests (below) that are failing most of the PR validation jobs that I am tracking. it it literally the whole day that I am rerunning CI jobs, without success What can we do ? Perhaps I am too pessimistic but it looks like the whole PR validation pipeline is stuck. Enrico

Re: Flaky tests - more than usual

we merged only 1pr, due to this problem Enrico > -Ali > > On Fri, Apr 2, 2021 at 9:09 AM Jonathan Ellis wrote: > > > Is there a legit regression causing elevated failures? > > > > On Fri, Apr 2, 2021 at 10:30 AM Enrico Olivelli > > wrote: > > > >

Re: Flaky tests - more than usual

this idea. I cannot send a PR now Other ideas from the community? Enrico > On Fri, Apr 2, 2021 at 10:56 AM Enrico Olivelli > wrote: > > > Il Ven 2 Apr 2021, 18:47 Ali Ahmed ha scritto: > > > > > You can rebuild the commit and force push this results in the job

Re: [DISCUSS] Request to Release 2.7.2 with Cursor Metrics Configuration Fix

I propose to cut the first 2.7.2RC on April 12th. Is this a good trade off? Enrico Il Gio 1 Apr 2021, 22:56 Michael Marshall ha scritto: > After discussing this issue in the Pulsar community meeting today, I > realized that I might not have described the issue well enough. The > fundamental

Re: Flaky tests - more than usual

I propose to disable those tests and unblock CI and create blocker issues for 2.8.0 release. Issue are probably already present and I see a few PRs about tentative fixes. Does this sound good? Enrico Il Ven 2 Apr 2021, 20:32 Enrico Olivelli ha scritto: > Jonathan > I am not aware of c

Re: Flaky tests - more than usual

arantined"? > Works for me Enrico > > -Lari > > On Sat, 3 Apr 2021, 12:06 Enrico Olivelli, wrote: > > > I propose to disable those tests and unblock CI and create blocker issues > > for 2.8.0 release. > > Issue are probably already present and I see a few

Re: First release of python-client for osx bigsur

Thanks Enrico Il giorno lun 5 apr 2021 alle ore 23:32 Ali Ahmed ha scritto: > > I have uploaded the macosx big sur builds for the python client to pypi. It's > early work . Feel free to test any report on any issues. > > https://files.pythonhosted.org/packages/b8/20/e4e717a358570adbdaf43db4327f

Cutting 2.7.2 release?

Hello, during the discussion started by Michal Marshall, two weeks ago [1] we talked about cutting 2.7.2 release. Here [2] you can find the list of commits cherry-picked to branch-2.7 since 2.7.1 release. I would like to volunteer as a release manager and to learn how to release Pulsar if no one

Re: Cutting 2.7.2 release?

tfully request this be added as well. I was expecting > to see it in 2.7.1. > > It is a major bug that prevents using third party proxy providers with > pulsar, and the fix is simple. > > https://github.com/apache/pulsar/pull/8957 > > Thank you! > > On Sun, Apr 11, 20

Make enable transactions simpler for "pulsar standalone" users

Hello, I believe that "transactions" are a great feature in Pulsar and users are trying them more and more. Currently if you want to use transactions with Pulsar Standalone you have to: - add enableTransactionCoordinator=true in the conf/standalone.conf file and there is no example - execute the i

Re: Cutting 2.7.2 release?

ed it extensively. > > On Sun, Apr 11, 2021 at 8:47 AM Enrico Olivelli wrote: > > > Joshua, > > I have pinged the reviewers for 8957. > > If there is no incompatibility with branch-2.7 then we can cherry-pick it. > > > > Just for curiosity are you already t

Re: Cutting 2.7.2 release?

prevents using third party proxy providers with > pulsar, and the fix is simple. > > https://github.com/apache/pulsar/pull/8957 > > Thank you! > > On Sun, Apr 11, 2021 at 2:23 AM Enrico Olivelli wrote: > > > Hello, > > during the discussion started by Michal Mars

<    1   2   3   4   5   6   7   8   9   10   >