Re: Process parquet files in batch mode with blink planner

2020-03-09 Thread Jingsong Li
Hi olivier, Sorry for the late reply. In blink planner, - only hive parquet table can be read now. - If you want to support native parquet files, you can modify `ParquetTableSource` a little bit, extends StreamTableSource. Best, Jingsong Lee On Wed, Feb 26, 2020 at 7:50 PM wrote: > Hi communit

Process parquet files in batch mode with blink planner

2020-02-26 Thread olivier_brazet
Hi community, For a PoC I need to process some parquet files in batch mode. I managed to implement some processing using the DataSet API. It is working fine. Now, I would like to test the SQL API and the blink planner. If I do well understand, the ParquetTableSource is not compatible with the b