Hi Oleg,
The Tachyon related issue should be fixed.
Hope this helps,
Calvin
On Mon, Jan 18, 2016 at 2:51 AM, Oleg Ruchovets
wrote:
> Hi ,
>I try to follow the spartk 1.6.0 to install spark on EC2.
>
> It doesn't work properly - got exceptions and at the end standalone spark
> cluster inst
Subject: Re: spark 1.6.0 on ec2 doesn't work
I am running from $SPARK_HOME.
It looks like connection problem to port 9000. It is on master machine.
What is this process is spark tries to connect?
Should I start any framework , processes before executing spark?
Thanks
OIeg.
16/01/19 03:
I am running from $SPARK_HOME.
It looks like connection problem to port 9000. It is on master machine.
What is this process is spark tries to connect?
Should I start any framework , processes before executing spark?
Thanks
OIeg.
16/01/19 03:17:56 INFO ipc.Client: Retrying connect to server
Could you run spark-shell at $SPARK_HOME DIR?
You can try to change you command run at $SPARK_HOME or, point to README.md
with full path.
Peter Zhang
--
Google
Sent with Airmail
On January 19, 2016 at 11:26:14, Oleg Ruchovets (oruchov...@gmail.com) wrote:
It looks spark is not working fine :
It looks spark is not working fine :
I followed this link ( http://spark.apache.org/docs/latest/ec2-scripts.html.
) and I see spot instances installed on EC2.
from spark shell I am counting lines and got connection exception.
*scala> val lines = sc.textFile("README.md")*
*scala> lines.count()*
On Mon, Jan 18, 2016 at 5:24 PM, Oleg Ruchovets
wrote:
> I thought script tries to install hadoop / hdfs also. And it looks like it
> failed. Installation is only standalone spark without hadoop. Is it correct
> behaviour?
>
Yes, it also sets up two HDFS clusters. Are they not working? Try to se
I thought script tries to install hadoop / hdfs also. And it looks like it
failed. Installation is only standalone spark without hadoop. Is it correct
behaviour?
Also errors in the log:
ERROR: Unknown Tachyon version
Error: Could not find or load main class crayondata.com.log
Thanks
Oleg.
Hi,
How do you know it doesn't work? The log looks roughly normal to me. Is
Spark not running at the printed address? Can you not start jobs?
On Mon, Jan 18, 2016 at 11:51 AM, Oleg Ruchovets
wrote:
> Hi ,
>I try to follow the spartk 1.6.0 to install spark on EC2.
>
> It doesn't work properl
