Re: Setting up personal Pulsar CI for reducing load on apache/pulsar CI

2021-03-19 Thread Enrico Olivelli
Il giorno ven 19 mar 2021 alle ore 20:09 Lari Hotari ha scritto: > > Good suggestions. > > > Can we configure CI in a way that it does not trigger the PR validation if > > the PR is in draft status? > > Yes, that's possible. I guess this would be the solution: > https://github.community/t/dont-run

Re: Setting up personal Pulsar CI for reducing load on apache/pulsar CI

2021-03-19 Thread Lari Hotari
Good idea. Let's see if this "personal CI" solution turns out to be useful. -Lari On Fri, Mar 19, 2021 at 7:21 PM Jonathan Ellis wrote: > Is it worth adding this to the Contributing doc page? > https://pulsar.apache.org/en/contributing/ > > On Fri, Mar 19, 2021 at 7:37 AM Lari Hotari wrote: >

Re: Setting up personal Pulsar CI for reducing load on apache/pulsar CI

2021-03-19 Thread Lari Hotari
Good suggestions. > Can we configure CI in a way that it does not trigger the PR validation if > the PR is in draft status? Yes, that's possible. I guess this would be the solution: https://github.community/t/dont-run-actions-on-draft-pull-requests/16817/16 . Please create an GH issue about this

Re: Enhancements to Pulsar IO

2021-03-19 Thread Jerry Peng
HI Enrico, > > > One problem is that I do not know how to code "my_decode_method" > without Schema information. > If we had the Schema that is used for the Record then the approach of > using Sink[] may work. In fact it works perfectly for Source. > This is not the case, because for Sink record.get

Re: Setting up personal Pulsar CI for reducing load on apache/pulsar CI

2021-03-19 Thread Enrico Olivelli
Lari Can we configure CI in a way that it does not trigger the PR validation if the PR is in draft status? Or another way would be that we do not trigger the validation at PR creation, but only when you issue a special command IIRC the Netty project works this way. It will be also safer, especia

Re: Setting up personal Pulsar CI for reducing load on apache/pulsar CI

2021-03-19 Thread Jonathan Ellis
Is it worth adding this to the Contributing doc page? https://pulsar.apache.org/en/contributing/ On Fri, Mar 19, 2021 at 7:37 AM Lari Hotari wrote: > Dear Pulsar community members, > > I'm very happy to see a lot of activity in Pulsar development. This is a > positive thing. > The negative impac

Re: [ANNOUNCE] New committer: Enrico Olivelli

2021-03-19 Thread Zhengxin Cai
Congrats Enrico! Best, Marvin, Aparnesh Gaurav 于2021年3月19日周五 上午6:20写道: > Congratulations Enrico .. > > Best regards, > Aparnesh > > On Thu, Mar 18, 2021 at 7:33 PM Michael Marshall > wrote: > > > Congratulations Enrico! That's great news! > > > > - Michael Marshall > > > > On Thu, Mar 18, 2021

Re: [ANNOUNCE] New committer: Enrico Olivelli

2021-03-19 Thread Aparnesh Gaurav
Congratulations Enrico .. Best regards, Aparnesh On Thu, Mar 18, 2021 at 7:33 PM Michael Marshall wrote: > Congratulations Enrico! That's great news! > > - Michael Marshall > > On Thu, Mar 18, 2021 at 7:06 PM Dianjin Wang .invalid> > wrote: > > > Congratulations! > > > > Best, > > Dianjin Wang

Setting up personal Pulsar CI for reducing load on apache/pulsar CI

2021-03-19 Thread Lari Hotari
Dear Pulsar community members, I'm very happy to see a lot of activity in Pulsar development. This is a positive thing. The negative impact of this is that it adds more load to the GitHub Actions based Pulsar CI. We have been seeing long build queues and slow feedback from Pulsar CI recently. Sin

Re: Enhancements to Pulsar IO

2021-03-19 Thread Enrico Olivelli
Il giorno ven 19 mar 2021 alle ore 08:20 Jerry Peng ha scritto: > > > But it doesn't work for Sinks > currently if you declare a Sink you will see as schema Schema.BYTES. > If we had a Schema object that is preconfigured for decoding the > payload probably we will be done. > > If you declare sink

[GitHub] [pulsar-test-infra] lhotari commented on pull request #19: Add copy of dorny/paths-filter@ca8fa4002 action

2021-03-19 Thread GitBox
lhotari commented on pull request #19: URL: https://github.com/apache/pulsar-test-infra/pull/19#issuecomment-802619268 > It looks like the source repository has had frequent updates/releases in the past 6 months. @lhotari, do you think we need to implement a process to ensure that our copy

[GitHub] [pulsar-test-infra] eolivelli merged pull request #19: Add copy of dorny/paths-filter@ca8fa4002 action

2021-03-19 Thread GitBox
eolivelli merged pull request #19: URL: https://github.com/apache/pulsar-test-infra/pull/19 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service

Re: Enhancements to Pulsar IO

2021-03-19 Thread Jerry Peng
> But it doesn't work for Sinks currently if you declare a Sink you will see as schema Schema.BYTES. If we had a Schema object that is preconfigured for decoding the payload probably we will be done. If you declare sink as Sink there should be no schema. I am not sure what getSchema() returns but

[GitHub] [pulsar-test-infra] eolivelli commented on pull request #19: Add copy of dorny/paths-filter@ca8fa4002 action

2021-03-19 Thread GitBox
eolivelli commented on pull request #19: URL: https://github.com/apache/pulsar-test-infra/pull/19#issuecomment-802607831 @michaeljmarshall in your opinion can we merge this patch in the current form in order to unblock apache/pulsar#9963 ? -- This is an automated message from the Apache

[GitHub] [pulsar-test-infra] michaeljmarshall commented on pull request #19: Add copy of dorny/paths-filter@ca8fa4002 action

2021-03-19 Thread GitBox
michaeljmarshall commented on pull request #19: URL: https://github.com/apache/pulsar-test-infra/pull/19#issuecomment-802607279 It looks like the source repository has had frequent updates/releases in the past 6 months. @lhotari, do you think we need to implement a process to ensure that o