Hi Daniel, Thanks for reaching out. Keep in mind that you weren't subscribed to the Flink Dev mailing list, I've just pushed this through the mailing list moderation.
The process for contributing a connector is to create a Connector FLIP [1], which needs to be discussed and voted on in the Dev mailing list [2]. One thing in particular is who can help with the maintenance of the connector: will there be more volunteers who can help with bug fixes, new features etc. As we've seen with the current PubSub connector, that's already quite hard: it's currently lacking volunteers overall. I do recall a proposal to contribute a PubSub Lite connector a while back, but that ultimately was not followed through. Best regards, Martijn [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP+Connector+Template [2] https://cwiki.apache.org/confluence/display/FLINK/Flink+Bylaws On Mon, Feb 27, 2023 at 9:44 AM Daniel Collins <dpcoll...@google.com.invalid> wrote: > Hello flink devs, > > My name is Daniel, I'm the tech lead for Google's Pub/Sub Lite streaming > system, which is a lower cost streaming data system with semantics more > similar to OSS streaming solutions. I've authored a source and sink > connector for flink and load tested it at GiB/s scale- what would be the > process for contributing this to flink? > > I've opened a JIRA to do this > https://issues.apache.org/jira/projects/FLINK/issues/FLINK-31229, if this > seems like a reasonable thing to do could someone assign it to me? > > The code for the connector currently lives here > https://github.com/googleapis/java-pubsublite-flink, I believe it is > following the FLIP-27 guidelines, but please let me know if I'm > implementing the wrong interfaces. Which repo and in what folder should I > move this code into? > > -Daniel >
