Oh good point, does the Windows integration need native libs for POSIX-y file system access? I know there are some binaries shipped for this purpose but wasn't sure if that's part of what's covered in the native libs message.
On Tue, Aug 4, 2015 at 6:01 PM, Steve Loughran <ste...@hortonworks.com> wrote: > Think it may be needed on Windows, certainly if you start trying to work with > local files. > > >> On 4 Aug 2015, at 00:34, Sean Owen <so...@cloudera.com> wrote: >> >> It won't affect you if you're not actually running Hadoop. But it's >> mainly things like Snappy/LZO compression which are implemented as >> native libraries under the hood. > > There's a lot more in those native libs, primarily to bypass bits missing > from the java APIs (FS permissions) and to add new features (encryption, soon > erasure coding). > > The Hadoop file:// FS uses it on windows, at least for now > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
