I'd like to use HadoopFileSystem to open a file and then a read a block of data specified by the offset and the length. I see that for libhdfs driver, arrow supports hdfsPread API. It also exposes it as ReadAt method of the RandomAccessFile interface. I did not find don'ta way to access it from Python, though. My question: is there a way to use ReadAt from Python and I missed it?
If not, would it make sense to extend HadoopFileSystem, and perhaps other file systems to support that access pattern? Thanks, - Yevgeni
