Re: [I] [FEATURE] Support fuse for Fileset [gravitino]

2024-11-07 Thread via GitHub
diqiu50 commented on issue #4558: URL: https://github.com/apache/gravitino/issues/4558#issuecomment-2463642896 We track the development process through issue #5504 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] [FEATURE] Support fuse for Fileset [gravitino]

2024-09-09 Thread via GitHub
coolderli commented on issue #4558: URL: https://github.com/apache/gravitino/issues/4558#issuecomment-2337573960 @diqiu50 I have tested the fsspec fuse again. I mounted an HDFS directory and found the writer wasn't successful. The list and read are successful. ``` >>> with open('/

Re: [I] [FEATURE] Support fuse for Fileset [gravitino]

2024-08-22 Thread via GitHub
coolderli commented on issue #4558: URL: https://github.com/apache/gravitino/issues/4558#issuecomment-2304515545 @diqiu50 I'm not sure if the fsspec fuse is a good way. Because in most cases we need to use it in a container environment, we not only need to implement fuse, but also need to i

Re: [I] [FEATURE] Support fuse for Fileset [gravitino]

2024-08-22 Thread via GitHub
coolderli commented on issue #4558: URL: https://github.com/apache/gravitino/issues/4558#issuecomment-2304476521 > Hi @coolderli I heard that you encountered some issues with `fsspec`. I’d like to understand the details. Could you help list the specific problems? The first issue is fr

Re: [I] [FEATURE] Support fuse for Fileset [gravitino]

2024-08-22 Thread via GitHub
diqiu50 commented on issue #4558: URL: https://github.com/apache/gravitino/issues/4558#issuecomment-2304370573 Hi @coolderli I heard that you encountered some issues with `fsspec`. I’d like to understand the details. Could you help list the specific problems? -- This is an automated mess

Re: [I] [FEATURE] Support fuse for Fileset [gravitino]

2024-08-21 Thread via GitHub
shaofengshi commented on issue #4558: URL: https://github.com/apache/gravitino/issues/4558#issuecomment-2301864360 > > Hi Peidian, I don't have much knowledge about FUSE; For the solution2, is that only available for python? Which means, only in Python application, fsspec mounts a remote st

Re: [I] [FEATURE] Support fuse for Fileset [gravitino]

2024-08-21 Thread via GitHub
coolderli commented on issue #4558: URL: https://github.com/apache/gravitino/issues/4558#issuecomment-2301481233 > Hi Peidian, I don't have much knowledge about FUSE; For the solution2, is that only available for python? Which means, only in Python application, fsspec mounts a remote storag

Re: [I] [FEATURE] Support fuse for Fileset [gravitino]

2024-08-20 Thread via GitHub
shaofengshi commented on issue #4558: URL: https://github.com/apache/gravitino/issues/4558#issuecomment-2301237821 Hi Peidian, I don't have much knowledge about FUSE; For the solution2, is that only available for python? Which means, only in Python application, fsspec mounts a remote storag

Re: [I] [FEATURE] Support fuse for Fileset [gravitino]

2024-08-19 Thread via GitHub
jerryshao commented on issue #4558: URL: https://github.com/apache/gravitino/issues/4558#issuecomment-2296282629 Thanks @coolderli to bring this out. I think HCFS API is not Posix compliant API, so using HCFS API with fuse has many limitations. I don't know how well fsspec support Posix, we

Re: [I] [FEATURE] Support fuse for Fileset [gravitino]

2024-08-19 Thread via GitHub
coolderli commented on issue #4558: URL: https://github.com/apache/gravitino/issues/4558#issuecomment-2296027918 @jerryshao @shaofengshi @xunliu Can you share your thoughts?Thanks. cc @xloya @YxAc @zhoukangcn -- This is an automated message from the Apache Git Service. To respond to the

[I] [FEATURE] Support fuse for Fileset [gravitino]

2024-08-15 Thread via GitHub
coolderli opened a new issue, #4558: URL: https://github.com/apache/gravitino/issues/4558 ### Describe the feature Implement fuse for gvfs to support mounting fileset to local directories. The instance defaults to mounting `fileset://fileset/fileset_catalog/schema/fileset_name` to `