I want to use Arrow as a middle layer between spark and parquet data in HDFS, but I don't find any docs about how to load parquet data to arrow in memory, and how spark read arrow data format. Does anyone provide some examples or manuals to describe it?
thanks.