Re: can not use iceberg as a sql source in flink sql according to iceberg 0.12.0

2021-09-27 Thread Ryan Blue
Thanks, Josh! I guess it makes sense that without the base class you can't load the Parquet class. We'll have to watch out for Hadoop/Flink issues. I think we hit one as well where not having Configuration in the Flink classpath could prevent loading modules correctly. Ryan On Sun, Sep 26, 2021

Re: In-memory implementation of FileIO

2021-09-27 Thread Ryan Blue
I don't think so. There's one that wraps the local file system we use for testing that at least doesn't depend on Hadoop though. If you want to build an in-memory one that would be great. On Mon, Sep 27, 2021 at 7:32 AM Mayur Srivastava < mayur.srivast...@twosigma.com> wrote: > Hi, > > > > Is the

In-memory implementation of FileIO

2021-09-27 Thread Mayur Srivastava
Hi, Is there an in-memory implementation of the FileIO interface? I'm looking for one for writing unit tests (basically avoiding touching local file system or other external resources). Thanks, Mayur