Re: Alluxio cache read support

Le 06/09/2022 à 09:45, Manoj Kumar a écrit : Hi Sutou Kouhei/Team *[Background]* Working on intel gazelle_plugin , It's a C++ based backend with an arrow compute engine for spark. Now during scan i.e reading data from HDFS/Cloud currently we are

Re: Alluxio cache read support

Hi Sutou Kouhei/Team *[Background]* Working on intel gazelle_plugin , It's a C++ based backend with an arrow compute engine for spark. Now during scan i.e reading data from HDFS/Cloud currently we are using cloud/hdfs APIs as mentioned above. But no

Re: Alluxio cache read support

Hi, Could you try our HDFS support? * https://arrow.apache.org/docs/cpp/dataset.html#reading-from-cloud-storage * https://arrow.apache.org/docs/cpp/api/filesystem.html#_CPPv4N5arrow2fs16HadoopFileSystemE (You're using Apache Arrow C++, right?) Thanks, -- kou In "Alluxio cache read suppor