[ https://issues.apache.org/jira/browse/FLINK-28382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574075#comment-17574075 ]
Yingjie Cao commented on FLINK-28382: ------------------------------------- Merged into master via 47d0b6d26c052a817a66f7b719eecf01387cb0d3 > Introduce new compression algorithms of higher compression ratio > ---------------------------------------------------------------- > > Key: FLINK-28382 > URL: https://issues.apache.org/jira/browse/FLINK-28382 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Network > Reporter: Yingjie Cao > Assignee: Weijie Guo > Priority: Major > Labels: pull-request-available > Fix For: 1.16.0 > > > Currently, we use lz4 for shuffle data compression which is a good balance > between IO optimization and CPU consumption. But for some scenarios, the IO > becomes bottleneck and the storage space is limited (especially for k8s > environment). For these cases, we need compression algorithms of higher > compression ratio to further reduce IO. -- This message was sent by Atlassian Jira (v8.20.10#820010)