way forward for Winutils excision from `FileSystem`

2022-11-10 Thread Garret Wilson
Steve Loughran and I have been discussing on Stack Overflow a way forward for removing the Winutils requirement from the local `FileSystem` implementations. Hadoop's FileSystem API has a lot of *nix assumptions which originally made it not possible to imp

Re: way forward for Winutils excision from `FileSystem`

2022-11-28 Thread Garret Wilson
On 11/14/2022 12:04 PM, Gautham Banasandra wrote: … I would like to aim for winutils deprecation by the end of the first quarter of 2023. The key word is "deprecation". Note that the sentence doesn't say the references in the code to Winutils will be removed by this time. I offered to remove

Re: way forward for Winutils excision from `FileSystem`

2022-11-30 Thread Garret Wilson
On 11/29/2022 8:16 AM, Gautham Banasandra wrote: … However, I don't see anyone stopping you from working on removing winutils. I encourage you to put across a PR and I would be glad to review the same. That's not how it works. This is an intense undertaking. If I spend six months with no incom

[jira] [Created] (HADOOP-18525) ViewFileSystem major bug can cause entire subtrees to effectively disappear

2022-11-09 Thread Garret Wilson (Jira)
Garret Wilson created HADOOP-18525: -- Summary: ViewFileSystem major bug can cause entire subtrees to effectively disappear Key: HADOOP-18525 URL: https://issues.apache.org/jira/browse/HADOOP-18525