Re: WARN LoadSnappy: Snappy native library not loaded

2015-11-19 Thread David Rosenstrauch
:05 WARN LoadSnappy: Snappy native library not loaded Here is an overview of my POS app. I have a file on hdfs containing about 5000 twitter status strings. tweetStrings = sc.textFile(dataURL) jTweets = (tweetStrings.map(lambda x: json.loads(x)).take(10)) Generated the following error ³error

Re: WARN LoadSnappy: Snappy native library not loaded

2015-11-17 Thread Andy Davidson
ux-i386-32 libhadooppipes.a libhadoop.so.1.0.0 libhdfs.a libsnappy.so.1 Linux-amd64-64 From: Andrew Davidson Date: Tuesday, November 17, 2015 at 2:29 PM To: "user @spark" Subject: Re: WARN LoadSnappy: Snappy native library not loaded > I forgot to mention. I am using sp

Re: WARN LoadSnappy: Snappy native library not loaded

2015-11-17 Thread Andy Davidson
I forgot to mention. I am using spark-1.5.1-bin-hadoop2.6 From: Andrew Davidson Date: Tuesday, November 17, 2015 at 2:26 PM To: "user @spark" Subject: Re: WARN LoadSnappy: Snappy native library not loaded > FYI > > After 17 min. only 26112/228155 have succeeded >

Re: WARN LoadSnappy: Snappy native library not loaded

2015-11-17 Thread Andy Davidson
FYI After 17 min. only 26112/228155 have succeeded This seems very slow Kind regards Andy From: Andrew Davidson Date: Tuesday, November 17, 2015 at 2:22 PM To: "user @spark" Subject: WARN LoadSnappy: Snappy native library not loaded >I started a spark POC. I created a e

WARN LoadSnappy: Snappy native library not loaded

2015-11-17 Thread Andy Davidson
platform... using builtin-java classes where applicable 15/11/17 22:03:05 WARN LoadSnappy: Snappy native library not loaded Here is an overview of my POS app. I have a file on hdfs containing about 5000 twitter status strings. tweetStrings = sc.textFile(dataURL) jTweets = (tweetStrings.map(lambda