Re: [DISCUSS] PIP-62: Move connectors, adapters, and presto connector to separate repositories

2020-04-09 Thread Sijie Guo
Sanjeev, Matteo, > Will these > additional repositories build against the latest pulsar release? Or will > they build against say a nightly build of master? > testing dependents modules against the latest version, Here is my original proposal - "The three new repositories will run their Github A

Re: [DISCUSS] PIP-62: Move connectors, adapters, and presto connector to separate repositories

2020-04-09 Thread Matteo Merli
+1 I think there are still some unknowns, but they will only be discovered once the effort is started. Regarding, testing dependents modules against the latest version, we could rely on publishing snapshot Jars (which we already do on a daily basis) and snapshot Docker images. It's not perfect, b

Re: [DISCUSS] PIP-62: Move connectors, adapters, and presto connector to separate repositories

2020-04-09 Thread Sanjeev Kulkarni
Thanks Sijie for writing this proposal. I whole-heartedly agree with this proposal. Not only does it reduce Pulsar build time and make our lives as pulsar developers simple, it will also make connector/adaptor contributions less frictionless for contributors. No longer will developers need to know

[DISCUSS] PIP-62: Move connectors, adapters, and presto connector to separate repositories

2020-04-09 Thread Sijie Guo
Hi all, I chatted with some committers a few months ago about the build time of the current main repo. I'd like to raise a discussion of moving connectors, adapters, and presto-connector to separate repositories so that we can reduce the build time of the main repo and improve the review process f