??????Cleaning spark memory

2016-06-10 Thread Ricky
wml iPhone -- -- ??: Takeshi Yamamuro : 2016年6月11日 12:15 ??: Cesar Flores : user : Re: Cleaning spark memory

??????Classpath problem trying to use DataFrames

2015-12-12 Thread Ricky
encountor similar problems using hivecontext .When code print classload ,it was changed to multiclassloader from APPclassloader -- -- ??: Harsh J : 2015??12??12?? 12:09 ??: Christopher Brady , user : Re: Classpath problem trying

Negative Number of Workers used memory in Spark UI

2016-01-10 Thread Ricky
In spark UI , Workers used memoy show negative number as following picture: spark version:1.4.0 How to solve this problem? appreciate for you help! 3526FD5F@8B5ABE15.9A0C9356.png Description: Binary data

read snappy compressed files in spark

2018-08-31 Thread Ricky
I wanna be able to read snappy compressed files in spark. I can do a val df = spark.read.textFile("hdfs:// path") and it passes that test in spark shell but beyond that when i do a df.show(10,false) or something - it shows me binary data mixed with real text - how do I read the decompressed file in

Exception during creation of ActorReceiver when running ActorWordCount on CDH 5.5.2

2016-08-29 Thread Ricky Pritchett
I get the following exception on the worker nodes when running the ActorWordCount Example.  Caused by: java.lang.IllegalArgumentException: constructor public akka.actor.CreatorFunctionConsumer(scala.Function0) is incompatible with arguments [class java.lang.Class, class org.apache.spark.example

interpretation of Spark logs about remote fetch latency

2017-10-12 Thread ricky l
Hello Spark users, I have an inquiry while analyzing a sample Spark task. The task has remote fetches (shuffle) from few blocks. However, the remote fetch time does not really make sense to me. Can someone please help to interpret this? The logs came from Spark REST API. The task ID 33 needs four

Fwd: Using Spark

2014-06-20 Thread Ricky Thomas
Hi, Would like to add ourselves to the user list if possible please? Company: truedash url: truedash.io Automatic pulling of all your data in to Spark for enterprise visualisation, predictive analytics and data exploration at a low cost. Currently in development with a few clients. Thanks

Re: Using Spark

2014-06-22 Thread Ricky Thomas
Awesome, thanks On Sunday, June 22, 2014, Matei Zaharia wrote: > Alright, added you. > > On Jun 20, 2014, at 2:52 PM, Ricky Thomas > wrote: > > Hi, > > Would like to add ourselves to the user list if possible please? > > Company: truedash > url: truedash.io

unsubscribe

2014-10-28 Thread Ricky Thomas