@Galen, I've just seen that you posted your ideas on the old Github PR. I think it would be better to post it on the JIRA ticket [1].
[1] https://issues.apache.org/jira/browse/FLINK-11838 Cheers, Till On Tue, Feb 2, 2021 at 12:02 PM Xintong Song <tonysong...@gmail.com> wrote: > Hi Galen, > > Thanks for offering the contribution. > > As Till has already suggested, please comment on FLINK-11838 your solution > proposal. > Once we reach consensus on the proposal, I'll assign you to the ticket. > > Thank you~ > > Xintong Song > > > > On Tue, Feb 2, 2021 at 5:19 PM Till Rohrmann <trohrm...@apache.org> wrote: > > > Hi Galen, > > > > I think that adding support for GCS using the StreamingFileSink sounds > like > > a very good idea to me. Looking at FLINK-11838 I believe that this effort > > has been abandoned. I think that you could take this ticket over if you > > want. Maybe you could update this ticket with your solution proposal. > > > > I will check whether I can find a committer who could help you with this > > effort. > > > > Cheers, > > Till > > > > On Sat, Jan 30, 2021 at 7:43 PM Galen Warren <ga...@cvillewarrens.com> > > wrote: > > > > > Hi -- I'm wondering if you would be interested in a contribution to > add a > > > HadoopFileSystem implementation, with associated RecoverableWriter, for > > > Google Cloud Storage. This would be similar to what's already in place > > for > > > S3, and it would allow writing to GCS using a StreamingFileSink. The > > > implementation would be similar to what's already in place for S3. > > > > > > I see there's been some work on this before (FLINK-11838 Add GCS > > > RecoverableWriter by Fokko · Pull Request #7915 · apache/flink ( > > github.com > > > ) > > > <https://github.com/apache/flink/pull/7915>, but the original people > > > working on it have put it on hold, and the last activity was over six > > > months ago. > > > > > > I need this for my own purposes and I have an implementation that I'm > > > working on locally. I'd be interested to contribute this if you'd be > > > interested. Let me know if so and I'll create a Jira ticket. > > > > > > Thanks, > > > Galen Warren > > > > > >
