Malthe I do see value in having the Record readers/writers understand and handle compression directly as it will avoid the extra disk hit of decompress, read, compress cycles using existing processes and further there are cases where the compression is record specific and not just holistic block encryption.
I think Koji offered a great description of how to start thinking about this. Thanks On Tue, Jul 30, 2019 at 10:47 AM Malthe <[email protected]> wrote: > In reference to NIFI-6496 [1], I'd like to open a discussion on adding > compression support to flow files such that a processor such as > `CompressContent` might function in a streaming or "lazy" mode. > > Context, more details and initial feedback can be found in the ticket > referenced below as well as in a related SO entry [2]. > > [1] https://issues.apache.org/jira/browse/NIFI-6496 > [2] > https://stackoverflow.com/questions/57005564/using-convertrecord-on-compressed-input >
