Re: Shark does not give any results with SELECT count(*) command

2014-03-26 Thread qingyang li
i have found such log on bigdata003: 14/03/25 17:08:49 INFO network.ConnectionManager: Accepted connection from [bigdata001/192.168.1.101] 14/03/25 17:08:49 INFO network.ConnectionManager: Accepted connection from [bigdata002/192.168.1.102] 14/03/25 17:08:49 INFO network.ConnectionManager: Accepte

Re: Shark does not give any results with SELECT count(*) command

2014-03-26 Thread qingyang li
hi, Praveen, I can start server on bigdata001 using "/bin/shark --service sharkserver", i can also connect this server using "./bin/shark -h bigdata001" . but, the problem still there: run "select count(*) from b " on bigdata001, no result , no error. run "select count(*) from b " on bigdata0

Re: Shark does not give any results with SELECT count(*) command

2014-03-26 Thread Praveen R
Oh k. You must be running shark server on bigdata001 to use it from other machines. ./bin/shark --service sharkserver # runs shark server on port 1 You could connect to shark server as ./bin/shark -h , this should work unless there is a firewall blocking it. You might use telnet bigdata001 10

Re: Shark does not give any results with SELECT count(*) command

2014-03-26 Thread qingyang li
hi, Praveen, thanks for replying. I am using hive-0.11 which comes from amplab, at the begining , the hive-site.xml of amplab is empty, so , i copy one hive-site.xml from my cluster and then remove some attributes and aslo add some atrributs. i think it is not the reason for my problem, i think

Re: Shark does not give any results with SELECT count(*) command

2014-03-25 Thread Praveen R
Hi Qingyang Li, Shark-0.9.0 uses a patched version of hive-0.11 and using configuration/metastore of hive-0.12 could be incompatible. May I know the reason you are using hive-site.xml from previous hive version(to use existing metastore?). You might just leave hive-site.xml blank, otherwise. S

Re: Shark does not give any results with SELECT count(*) command

2014-03-25 Thread qingyang li
reopen this thread because i encounter this problem again. Here is my env: scala 2.10.3 s spark 0.9.0tandalone mode shark 0.9.0downlaod the source code and build by myself hive hive-shark-0.11 I have copied hive-site.xml from my hadoop cluster , it's hive version is 0.12, after copied , i

Re: Shark does not give any results with SELECT count(*) command

2014-03-19 Thread qingyang li
have found the cause , my problem is : the style of file salves is not correct, so the task only be run on master. explain here to help other guy who also encounter similiar problem. 2014-03-20 9:57 GMT+08:00 qingyang li : > Hi, i install spark0.9.0 and shark0.9 on 3 nodes , when i run select *

Shark does not give any results with SELECT count(*) command

2014-03-19 Thread qingyang li
Hi, i install spark0.9.0 and shark0.9 on 3 nodes , when i run select * from src , i can get result, but when i run select count(*) from src or select * from src limit 1, there is no result output. i have found similiar problem on google groups: https://groups.google.com/forum/#!searchin/spark-use