Luke Hutchison created FLINK-6185: ------------------------------------- Summary: Input readers and output writers/formats need to support gzip Key: FLINK-6185 URL: https://issues.apache.org/jira/browse/FLINK-6185 Project: Flink Issue Type: Bug Components: Core Affects Versions: 1.2.0 Reporter: Luke Hutchison Priority: Minor
File sources (such as {{env#readCsvFile()}}) and sinks (such as FileOutputFormat and its subclasses, and methods such as {{DataSet#writeAsText()}}) need the ability to transparently decompress and compress files. Primarily gzip would be useful, but it would be nice if this were pluggable to support bzip2, xz, etc. There could be options for autodetect (based on file extension and/or file content), which could be the default, as well as no compression or a selected compression method. -- This message was sent by Atlassian JIRA (v6.3.15#6346)