spark is deloyed on bigdata001 bigdata002 bigdata003 bigdata004 bigdata001 is master i have also copied shark's files on the four machines. when i run " select count(*) from b " on bigdata003's shark shell "bin/shark" , i could get the result. but when i run "select count(*) from b" on other nodes's shark shell "bin/shark", i can not get the result.
it seems the result has been sent to bigdata003, i have found such log on bigdata003: 14/03/25 17:08:49 INFO network.ConnectionManager: Accepted connection from [bigdata001/192.168.1.101] 14/03/25 17:08:49 INFO network.ConnectionManager: Accepted connection from [bigdata002/192.168.1.102] 14/03/25 17:08:49 INFO network.ConnectionManager: Accepted connection from [bigdata004/192.168.1.104] and also found such log on bigdata004 002 001: 09/01/13 09:32:29 INFO network.ConnectionManager: Accepted connection from [bigdata003/192.168.1.103] 09/01/13 09:32:29 INFO network.SendingConnection: Initiating connection to [bigdata003/192.168.1.103:39848] 09/01/13 09:32:29 INFO network.SendingConnection: Connected to [bigdata003/192.168.1.103:39848], 1 messages pending 2014-03-25 16:19 GMT+08:00 qingyang li <liqingyang1...@gmail.com>: > reopen this thread because i encounter this problem again. > Here is my env: > scala 2.10.3 s > spark 0.9.0 tandalone mode > shark 0.9.0 downlaod the source code and build by myself > hive hive-shark-0.11 > I have copied hive-site.xml from my hadoop cluster , it's hive version is > 0.12, after copied , i deleted some attributes from hive-site.xml > > When run select count(*) from xxx, no resut and no errors output. > > Can someone give me some suggestions to debug ? > > > > > > 2014-03-20 11:27 GMT+08:00 qingyang li <liqingyang1...@gmail.com>: > > have found the cause , my problem is : >> the style of file salves is not correct, so the task only be run on >> master. >> >> explain here to help other guy who also encounter similiar problem. >> >> >> 2014-03-20 9:57 GMT+08:00 qingyang li <liqingyang1...@gmail.com>: >> >> Hi, i install spark0.9.0 and shark0.9 on 3 nodes , when i run select * >>> from src , i can get result, but when i run select count(*) from src or >>> select * from src limit 1, there is no result output. >>> >>> i have found similiar problem on google groups: >>> >>> https://groups.google.com/forum/#!searchin/spark-users/Shark$20does$20not$20give$20any$20results$20with$20SELECT$20command/spark-users/oKMBPBWim0U/_hbDCi4m-xUJ >>> but , there is no solution on it. >>> >>> Does anyone encounter such problem? >>> >> >> >
