Have you read this ? http://stackoverflow.com/questions/22716346/how-to-use-lz4-compression-in-linux-3-11
> On Aug 21, 2015, at 6:57 AM, <saif.a.ell...@wellsfargo.com> > <saif.a.ell...@wellsfargo.com> wrote: > > Hi all, > > I am using pre-compiled spark with hadoop 2.6. LZ4 Codec is not on hadoop’s > native libraries, so I am not being able to use it. > > Can anyone suggest on how to proceed? Hopefully I wont have to recompile > hadoop. I tried changing the --driver-library-path to point directly into lz4 > stand alone package libraries, but of course it didnt work. > > Thanks > Saif >