[
https://issues.apache.org/jira/browse/BEAM-14452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17550049#comment-17550049
]
Danny McCormick commented on BEAM-14452:
----------------------------------------
This issue has been migrated to https://github.com/apache/beam/issues/21619
> Support Hadoop 4mc file format
> ------------------------------
>
> Key: BEAM-14452
> URL: https://issues.apache.org/jira/browse/BEAM-14452
> Project: Beam
> Issue Type: New Feature
> Components: sdk-java-core
> Reporter: Akhilesh Singh
> Assignee: Akhilesh Singh
> Priority: P2
> Time Spent: 1h
> Remaining Estimate: 0h
>
> The 4MC (4 More Compression) is a library for hadoop providing a new
> splittable compressed file format (4mc) which lets you leverage the power of
> LZ4 and ZSTD algorithms.
> It differs from other compressed file formats in a way that the output files
> can be read using HIVE partitioning - thus queries can be fast and reads from
> client applications can be very pointed to small compressed files stored on
> GCS.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)