[ https://issues.apache.org/jira/browse/FLINK-27655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17568800#comment-17568800 ]
Jingsong Lee commented on FLINK-27655: -------------------------------------- Avro dose not provide statistics. > Implement Avro File statistic collector > --------------------------------------- > > Key: FLINK-27655 > URL: https://issues.apache.org/jira/browse/FLINK-27655 > Project: Flink > Issue Type: Improvement > Reporter: Zheng Hu > Priority: Minor > Fix For: table-store-0.2.0 > > > Currently, the flink table store's avro file writer don't provide its File > statistic collector. So we have to use the generic FieldStatsCollector. > In fact, the correct direction is: Making all format writer has their own > FileStatsCollector, so that we can just parse the columnar statistic from the > file tailer, instead of comparing each column max-min when writing the > records into the columnar file. > In this way, I think we can just remove the FileFormatImpl class and > FieldStatsCollector class. -- This message was sent by Atlassian Jira (v8.20.10#820010)