Hi,
In demand of better performance, quite some end users want to leverage accelerators (e.g. FPGA, Intel QAT) to offload compression. However, in current Arrow compression framework, it only supports codec name based compression implementation and can't be customized to leverage accelerators. For example, for gzip format, we can't call customized codec to accelerate the compression. We would like to proposal a plugin API to support the customized compression codec. We've put the proposal here: https://docs.google.com/document/d/1W_TxVRN7WV1wBVOTdbxngzBek1nTolMlJWy6aqC6WG8/edit Any comment is welcome and please let us know your feedback. Thanks, XieQi
