Re: ParquetColumnarRowInputFormat - parameter description

2022-02-02 Thread Krzysztof Chmielewski
Thank you Fabian, I have one followup question. You wrote: *isUtcTimestamp denotes whether timestamps should be represented asSQL UTC timestamps.* Quetion: So, if *isUtcTimestamp *is set to false, how timestamps are represented? Regards, Krzysztof Chmielewski wt., 25 sty 2022 o 11:56 Fabian

Re: ParquetColumnarRowInputFormat - parameter description

2022-01-25 Thread Fabian Paul
Hi Krzysztof, sorry for the late reply. The community is very busy at the moment with the final two weeks of Flink 1.15. The parameters you have mentioned are mostly relevant for the internal conversion or representation from Parquet types to Flink's SQL type system. - isUtcTimestamp denotes whe

Re: ParquetColumnarRowInputFormat - parameter description

2022-01-24 Thread Krzysztof Chmielewski
Hi, I would like to bump this up a little bit. The isCaseSensitive is rather clear. If this is false, then column read in parquet file is case insensitive. batchSize - how many records we read from the Parquet file before passing it to the upper classes right? Could someone describe what timest