Re: HADOOP-19343 feature branch: GCS FileSystem

2025-04-23 Thread Steve Loughran
I like it, even if gcs want to be more agile at first 1. can help testing/debugging against a broadly used store 2. stops us accidentally breaking things (who would do that 🙂) 3. makes it easier to do changes across the modules Because Chris is involved, I'm not worried about this being

Re: HADOOP-19343 feature branch: GCS FileSystem

2025-04-21 Thread Chris Nauroth
Hi Wei-Chiu, This is an important trade-off to consider. There is some discussion in the JIRA issue comments relevant to this topic. To summarize, we prefer closer integration with the ASF community as we continue to evolve this FileSystem. It's true that releases will operate at a different caden

Re: HADOOP-19343 feature branch: GCS FileSystem

2025-04-21 Thread Wei-Chiu Chuang
Chris, I'm curious is having a GCS fs implementation in the main Hadoop repo the right choice? As mentioned by Steve, Hadoop release cadence tends to be slow. There's a lot of legacy code so release work is usually a multi month effort. Have you considered having it in a separate repo? On Mon, Apr