Re: A number of issues when running spark-ec2

2016-04-16 Thread Ted Yu
;>>>> Warning: $HADOOP_HOME is deprecated. >>>>>> >>>>>> 16/04/16 20:34:09 INFO namenode.NameNode: STARTUP_MSG: >>>>>> /******************** >>>>>> STARTUP_MSG: Starting NameNo

Re: A number of issues when running spark-ec2

2016-04-16 Thread Josh Rosen
namenode.FSNamesystem: supergroup=supergroup >>>>> 16/04/16 20:34:09 INFO namenode.FSNamesystem: isPermissionEnabled=false >>>>> 16/04/16 20:34:09 INFO namenode.FSNamesystem: >>>>> dfs.block.invalidate.limit=100 >>>>> 16/04/16 20:34:09 INF

Re: A number of issues when running spark-ec2

2016-04-16 Thread Ted Yu
.internal.out >>>> ec2-54-209-124-74.compute-1.amazonaws.com: Warning: $HADOOP_HOME is >>>> deprecated. >>>> ec2-54-209-124-74.compute-1.amazonaws.com: >>>> ec2-54-209-124-74.compute-1.amazonaws.com:

Re: A number of issues when running spark-ec2

2016-04-16 Thread Jon Gregg
* >>> STARTUP_MSG: Starting NameNode >>> STARTUP_MSG: host = ip-172-31-55-237.ec2.internal/172.31.55.237 >>> STARTUP_MSG: args = [-format] >>> STARTU

Re: A number of issues when running spark-ec2

2016-04-16 Thread Ted Yu
size 110 saved in 0 >> seconds. >> 16/04/16 20:34:17 INFO common.Storage: Storage directory >> /vol/persistent-hdfs/dfs/name has been successfully formatted. >> 16/04/16 20:34:17 INFO namenode.NameNode: SHUTDOWN_MSG: >> / >

Re: A number of issues when running spark-ec2

2016-04-16 Thread Ted Yu
4-88-249-255.compute-1.amazonaws.com > Killed 0 processes on ip-172-31-55-237.ec2.internal > Killed 0 processes on ip-172-31-55-237.ec2.internal > Connecting to ec2-54-209-124-74.compute-1.amazonaws.com as root... > Pseudo-terminal will not be allocated because stdin is not a te

A number of issues when running spark-ec2

2016-04-16 Thread YaoPau
error on line 154 of /etc/httpd/conf/httpd.conf: Cannot load /etc/httpd/modules/mod_authz_core.so into server: /etc/httpd/modules/mod_authz_core.so: cannot open shared object file: No such file or directory [FAILED] [timing] ganglia se