Yi, As you suggested this time I tried to install Samza on clean server (there is nothing installed on this server) Still I am getting connection timeout error, Please find below command line outputs. My System Admin/Dev Ops confirmed that this server does not have any firewall restrictions
[root@csadatlak-wc-a1t ~]# echo $JAVA_HOME /usr/lib/jvm/java-1.8.0-openjdk [root@csadatlak-wc-a1t ~]# echo $PATH /usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/root/bin [root@csadatlak-wc-a1t ~]# clear [root@csadatlak-wc-a1t ~]# pwd /root [root@csadatlak-wc-a1t ~]# cd [root@csadatlak-wc-a1t ~]# set -o vi [root@csadatlak-wc-a1t ~]# ^Ct -o vi [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]# cd /home/sanant003c/ [root@csadatlak-wc-a1t sanant003c]# ll total 4 drwxr-xr-x 7 root root 4096 Sep 20 15:32 hello-samza [root@csadatlak-wc-a1t sanant003c]# cd hello-samza/ [root@csadatlak-wc-a1t hello-samza]# ll total 312 drwxr-xr-x 2 root root 119 Sep 20 15:32 bin -rw-r--r-- 1 root root 6946 Sep 20 15:32 build.gradle drwxr-xr-x 2 root root 26 Sep 20 15:32 conf drwxr-xr-x 3 root root 20 Sep 20 15:32 gradle -rw-r--r-- 1 root root 898 Sep 20 15:32 gradle.properties -rwxr-xr-x 1 root root 5080 Sep 20 15:32 gradlew -rw-r--r-- 1 root root 2404 Sep 20 15:32 gradlew.bat -rw-r--r-- 1 root root 30449 Sep 20 15:32 LICENSE -rw-r--r-- 1 root root 9343 Sep 20 15:32 pom.xml -rw-r--r-- 1 root root 1095 Sep 20 15:32 README-gradle.md -rw-r--r-- 1 root root 1118 Sep 20 15:32 README.md drwxr-xr-x 3 root root 17 Sep 20 15:32 src -rw-r--r-- 1 root root 240217 Sep 20 15:32 wikipedia-raw.json [root@csadatlak-wc-a1t hello-samza]# bin/grid bootstrap Bootstrapping the system... EXECUTING: stop kafka Kafka is not installed. Run: bin/grid install kafka EXECUTING: stop yarn YARN is not installed. Run: bin/grid install yarn EXECUTING: stop zookeeper Zookeeper is not installed. Run: bin/grid install zookeeper EXECUTING: install samza ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'... fatal: unable to connect to git.apache.org: git.apache.org[0: 54.84.58.65]: errno=Connection timed out [root@csadatlak-wc-a1t hello-samza]# bin/grid install kafka EXECUTING: install kafka Downloading kafka_2.11-0.10.1.1.tgz... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 32.8M 100 32.8M 0 0 614k 0 0:00:54 0:00:54 --:--:-- 620k [root@csadatlak-wc-a1t hello-samza]# bin/grid install yarn EXECUTING: install yarn Downloading hadoop-2.6.1.tar.gz... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 187M 100 187M 0 0 717k 0 0:04:28 0:04:28 --:--:-- 734k [root@csadatlak-wc-a1t hello-samza]# bin/grid install zookeeper EXECUTING: install zookeeper Downloading zookeeper-3.4.3.tar.gz... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 15.4M 100 15.4M 0 0 727k 0 0:00:21 0:00:21 --:--:-- 747k [root@csadatlak-wc-a1t hello-samza]# bin/grid install samza EXECUTING: install samza ~/.samza/download /home/sanant003c/hello-samza Cloning into 'samza'... fatal: unable to connect to git.apache.org: git.apache.org[0: 54.84.58.65]: errno=Connection timed out Kindly help me to install Samza on my UNIX server Regards, ~Sri -----Original Message----- From: Yi Pan [mailto:nickpa...@gmail.com] Sent: Thursday, September 14, 2017 6:42 PM To: dev@samza.apache.org Subject: Re: Connection timed out error while installing "Hello Samza" P.S., the attachment you post w/ the previous email does not show up (Apache mailing list disallow attachments). If would be better if you send the command line outputs in pure text or html format. -Yi On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <nickpa...@gmail.com> wrote: > Hi, Anantharaman, > > A lot of firewall setup prevents "incoming connections", not "outgoing > connections" from a box. I.e. if you are downloading files, you are > establishing outgoing connections and it is fine. When you are hosting > a server (i.e. ZooKeeper or Kafka), you are making an "incoming connections" > to the box and will trigger the firewall rules. > > Just trying to pin down the problem, could you try on a Linux box w/o > any firewall rules setup and see whether that works? At least, verify > that localhost resolves to 127.0.0.1 and try telnet locahost 9092 or 2181? > > NOTE: Success in ping simply means that you can access via ICMP, not > guarantee you can establish TCP connection to the ports via firewall rules. > > -Yi > > On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha (Contractor) > < srinatha_ananthara...@comcast.com> wrote: > >> That is a good catch Naveena the server which I am trying to install >> is an Hadoop edge node, it has kafka broker and Zookeeper client >> already installed for my Hadoop Does it matter If I am installing it >> on a separate folder?. My guess Even if there are conflicts on >> earlier installations it should throw some other error but not the >> connection time out >> >> Coming to your question " it could either related resolving "localhost" >> or firewall that prevents communication between ports" - how to prove >> it is because of Firewall issue. I am able to clone Samza files from Apache >> git. >> I can download any external files on this server >> >> ~Sri >> >> -----Original Message----- >> From: Navina Ramesh [mailto:nram...@linkedin.com] >> Sent: Thursday, September 14, 2017 2:51 PM >> To: dev@samza.apache.org >> Subject: Re: Connection timed out error while installing "Hello Samza" >> >> I wonder if this has anything to do with previous kafka / zookeeper >> installed on your box. Just for sanity, try clearing /tmp/zookeeeper* >> and >> /tmp/kafka* before re-trying those steps. >> >> >> Same as Yi, I strongly suspect issues with your local laptop setup - >> it could either related resolving "localhost" or firewall that >> prevents communication between ports. >> >> >> Navina >> >> ________________________________ >> From: Yi Pan <nickpa...@gmail.com> >> Sent: Thursday, September 14, 2017 11:37:46 AM >> To: dev@samza.apache.org >> Subject: Re: Connection timed out error while installing "Hello Samza" >> >> Hi, Anantharaman, >> >> I just did the same steps as you described in your email and all >> passed on my box. Hence, I strongly suspect that it is related to >> your local laptop network setup. >> >> Could you post all the command line output when you ran the sequence >> of commands? >> >> -Yi >> >> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <nickpa...@gmail.com> wrote: >> >> > Hi, Ananarath, >> > >> > It is very strange that you are seeing this timeout exception that >> > we do not see. I am trying to follow the exact steps you did to see >> > whether there is anything broken. I will update you this afternoon. >> > >> > Meanwhile, could you check your hostname setup and firewall >> > configuration to see whether your local laptop has blocked access >> > via the public IP address to your laptop? Could you verify that >> > your localhost is resolved to >> > 127.0.0.1 and is accessible? >> > >> > -Yi >> > >> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha >> > (Contractor) < srinatha_ananthara...@comcast.com> wrote: >> > >> >> Yi, >> >> >> >> Is there any alternate way to install Samza Or solution to the >> >> connection time out error? >> >> >> >> Regards, >> >> ~Sri >> >> >> >> From: Anantharaman, Srinatha (Contractor) >> >> Sent: Wednesday, September 13, 2017 11:37 AM >> >> To: dev@samza.apache.org >> >> Subject: RE: Connection timed out error while installing "Hello Samza" >> >> >> >> >> >> Yi, >> >> >> >> >> >> >> >> I am trying to build Samza locally by following the steps provided >> >> by Navina. >> >> >> >> As per those steps kafka will be installed after Zookeeper, I am >> >> getting Error while starting Zookeeper after it is installed >> >> >> >> >> >> >> >> >> >> >> >> Steps Followed : >> >> >> >> >> >> >> >> Yes. You can clone apache/samza locally and build it with: >> >> >> >> >> >> >> >> >> >> >> >> cd <samza-workspace> >> >> >> >> >> >> >> >> gradle -b bootstrap.gradle >> >> >> >> >> >> >> >> ./gradlew clean build -x test >> >> >> >> >> >> >> >> ./gradlew publishToMavenLocal ## This publishes a snapshot version >> of >> >> the latest apache/samza into your local maven repo >> >> >> >> >> >> >> >> >> >> >> >> Then, head to hello-samza workspace and build again: >> >> >> >> >> >> >> >> cd <hello-samza-workspace> >> >> >> >> >> >> >> >> mvn clean package ## This should create a build target >> >> >> >> >> >> >> >> ./bin/grid install zookeeper >> >> >> >> >> >> >> >> ./bin/grid start zookeeper >> >> >> >> >> >> >> >> ./bin/grid install kafka >> >> >> >> >> >> >> >> ./bin/grid start kafka >> >> >> >> >> >> >> >> ./bin/grid install yarn >> >> >> >> >> >> >> >> ./bin/grid start yarn >> >> >> >> >> >> >> >> >> >> >> >> mkdir -p deploy/samza >> >> >> >> >> >> >> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C >> >> deploy/samza >> >> >> >> >> >> >> >> >> >> >> >> NOTE : BTW From the above steps I could not execute " gradle -b >> >> bootstrap.gradle" since that command does not exists >> >> >> >> >> >> >> >> Regards, >> >> >> >> ~Sri >> >> >> >> >> >> >> >> -----Original Message----- >> >> From: Yi Pan [mailto:nickpa...@gmail.com] >> >> Sent: Tuesday, September 12, 2017 7:13 PM >> >> To: dev@samza.apache.org<mailto:dev@samza.apache.org> >> >> Subject: Re: Connection timed out error while installing "Hello Samza" >> >> >> >> >> >> >> >> Hi, Anantharam, >> >> >> >> >> >> >> >> Could you confirm at which step your setup failed? It seems that >> >> your zookeeper server is running. Could you check to see whether >> >> your Kafka broker is running? You can either do a telnet localhost >> >> 9092 or do a ps auxww | grep kafka to see whether you got any broker >> >> running. >> >> >> >> >> >> >> >> Sometimes, the Kafka service takes time to start on a single laptop. >> >> You can just try to run ./bin/grid start kafka >> >> >> >> >> >> >> >> again to see whether the service is up. >> >> >> >> >> >> >> >> Thanks! >> >> >> >> >> >> >> >> -Yi >> >> >> >> >> >> >> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha >> >> (Contractor) < >> >> srinatha_ananthara...@comcast.com<mailto:Srinatha_Anantharam >> >> a...@comcast.com>> wrote: >> >> >> >> >> >> >> >> > Find below Zookeeper logs: >> >> >> >> > >> >> >> >> > 2017-09-12 17:05:19,124 [myid:] - INFO >> >> > [main:QuorumPeerConfig@101] >> >> > - >> >> >> >> > Reading configuration from: /app/home/eventsvc/samza-git/ >> >> >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg >> >> >> >> > 2017-09-12 17:05:19,133 [myid:] - INFO >> >> >> >> > [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set >> >> > to >> >> > 3 >> >> >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO >> >> >> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to >> >> > 0 >> >> >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO >> >> >> >> > [main:DatadirCleanupManager@101] >> >> >> >> > - Purge task is not scheduled. >> >> >> >> > 2017-09-12 17:05:19,135 [myid:] - WARN >> >> > [main:QuorumPeerMain@113] - >> >> >> >> > Either no config or no quorum defined in config, running in >> >> >> >> > standalone mode >> >> >> >> > 2017-09-12 17:05:19,161 [myid:] - INFO >> >> > [main:QuorumPeerConfig@101] >> >> > - >> >> >> >> > Reading configuration from: /app/home/eventsvc/samza-git/ >> >> >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg >> >> >> >> > 2017-09-12 17:05:19,162 [myid:] - INFO >> >> > [main:ZooKeeperServerMain@95] >> >> >> >> > - Starting server >> >> >> >> > 2017-09-12 17:05:19,175 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 >> >> > 10:48 >> >> >> >> > GMT >> >> >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net >> >> >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:java.version=1.8.0_31 >> >> >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:java.vendor=Oracle Corporation >> >> >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1. >> >> >> >> > 8.0.31-2.b13.el7.x86_64/jre >> >> >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:java.class.path=/app/home/eventsvc/samza-git/ >> >> >> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/ >> >> >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../ >> >> >> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello- >> >> >> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/ >> >> >> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/ >> >> >> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza- >> >> >> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3. >> >> >> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello- >> >> >> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/ >> >> >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../ >> >> >> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello- >> >> >> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/home/ >> >> >> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../ >> >> >> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello- >> >> >> >> > samza/deploy/zookeeper/bin/../conf: >> >> >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:java.library.path=/usr/java/packages/lib/amd64:/ >> >> >> >> > usr/lib64:/lib64:/lib:/usr/lib >> >> >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:java.io.tmpdir=/tmp >> >> >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:java.compiler=<NA> >> >> >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:os.name=Linux >> >> >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:os.arch=amd64 >> >> >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64 >> >> >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:user.name=root >> >> >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:user.home=/root >> >> >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO [main:Environment@98] - >> >> > Server >> >> >> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello- >> >> >> >> > samza/deploy/zookeeper >> >> >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO >> >> > [main:ZooKeeperServer@733] >> >> > - >> >> >> >> > tickTime set to 2000 >> >> >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO >> >> > [main:ZooKeeperServer@742] >> >> > - >> >> >> >> > minSessionTimeout set to -1 >> >> >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO >> >> > [main:ZooKeeperServer@751] >> >> > - >> >> >> >> > maxSessionTimeout set to -1 >> >> >> >> > 2017-09-12 17:05:19,213 [myid:] - INFO >> >> >> >> > [main:NIOServerCnxnFactory@110] - binding to port >> >> > 0.0.0.0/0.0.0.0:2181 >> >> >> >> > 2017-09-12 17:05:19,240 [myid:] - INFO >> >> > [main:FileTxnSnapLog@238] - >> >> >> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0 >> >> >> >> > 2017-09-12 17:05:19,673 [myid:] - INFO >> >> > [NIOServerCxn.Factory:0.0.0.0/ >> >> >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket >> >> > connection >> >> >> >> > from >> >> >> >> > /0:0:0:0:0:0:0:1:21754 >> >> >> >> > 2017-09-12 17:17:40,265 [myid:] - WARN >> >> > [NIOServerCxn.Factory:0.0.0.0/ >> >> >> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream exception >> >> >> >> > EndOfStreamException: Unable to read additional data from client >> >> >> >> > sessionid 0x0, likely client has closed socket >> >> >> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO( >> >> >> >> > NIOServerCnxn.java:220) >> >> >> >> > at org.apache.zookeeper.server.NIOServerCnxnFactory.run( >> >> >> >> > NIOServerCnxnFactory.java:224) >> >> >> >> > at java.lang.Thread.run(Thread.java:745) >> >> >> >> > 2017-09-12 17:17:40,267 [myid:] - INFO >> >> > [NIOServerCxn.Factory:0.0.0.0/ >> >> >> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket connection for >> >> > client >> >> >> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client) >> >> >> >> > 2017-09-12 17:18:06,236 [myid:] - INFO >> >> > [NIOServerCxn.Factory:0.0.0.0/ >> >> >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket >> >> > connection >> >> >> >> > from / >> >> >> >> > 127.0.0.1:48071 >> >> >> >> > 2017-09-12 17:18:06,247 [myid:] - INFO >> >> > [NIOServerCxn.Factory:0.0.0.0/ >> >> >> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to >> >> > establish new >> >> >> >> > session at /127.0.0.1:48071 >> >> >> >> > 2017-09-12 17:18:06,250 [myid:] - INFO >> >> > [SyncThread:0:FileTxnLog@199] >> >> >> >> > - Creating new log file: log.1 >> >> >> >> > 2017-09-12 17:18:06,263 [myid:] - INFO >> >> >> >> > [SyncThread:0:ZooKeeperServer@604] >> >> >> >> > - Established session 0x15e770d61920000 with negotiated timeout >> >> > 6000 >> >> >> >> > for client /127.0.0.1:48071 >> >> >> >> > 2017-09-12 17:18:06,321 [myid:] - INFO [ProcessThread(sid:0 >> cport:-1):: >> >> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when >> >> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x5 >> >> > zxid:0x3 >> >> >> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode >> >> > = >> >> >> >> > NoNode for /brokers >> >> >> >> > 2017-09-12 17:18:06,342 [myid:] - INFO [ProcessThread(sid:0 >> cport:-1):: >> >> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when >> >> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0xb >> >> > zxid:0x7 >> >> >> >> > txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode >> >> > = >> >> >> >> > NoNode for /config >> >> >> >> > 2017-09-12 17:18:06,356 [myid:] - INFO [ProcessThread(sid:0 >> cport:-1):: >> >> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when >> >> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x13 >> >> > zxid:0xc >> >> >> >> > txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode = >> >> >> >> > NoNode for /admin >> >> >> >> > 2017-09-12 17:18:06,457 [myid:] - INFO [ProcessThread(sid:0 >> cport:-1):: >> >> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when >> >> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x1b >> >> > zxid:0x11 >> >> >> >> > txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode >> >> > = >> >> >> >> > NoNode for /cluster >> >> >> >> > 2017-09-12 17:18:06,973 [myid:] - INFO [ProcessThread(sid:0 >> cport:-1):: >> >> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when >> >> >> >> > processing sessionid:0x15e770d61920000 type:setData cxid:0x25 >> >> >> >> > zxid:0x15 >> >> >> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch >> >> >> >> > Error:KeeperErrorCode = NoNode for /controller_epoch >> >> >> >> > 2017-09-12 17:18:07,050 [myid:] - INFO [ProcessThread(sid:0 >> cport:-1):: >> >> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when >> >> >> >> > processing sessionid:0x15e770d61920000 type:delete cxid:0x34 >> >> > zxid:0x17 >> >> >> >> > txntype:-1 reqpath:n/a Error >> >> > Path:/admin/preferred_replica_election >> >> >> >> > Error:KeeperErrorCode = NoNode for >> >> > /admin/preferred_replica_election >> >> >> >> > 2017-09-12 17:18:07,288 [myid:] - INFO [ProcessThread(sid:0 >> cport:-1):: >> >> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when >> >> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x3f >> >> > zxid:0x18 >> >> >> >> > txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode >> >> > = >> >> >> >> > NodeExists for /brokers >> >> >> >> > 2017-09-12 17:18:07,290 [myid:] - INFO [ProcessThread(sid:0 >> cport:-1):: >> >> >> >> > PrepRequestProcessor@617] - Got user-level KeeperException when >> >> >> >> > processing sessionid:0x15e770d61920000 type:create cxid:0x40 >> >> > zxid:0x19 >> >> >> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids >> >> > Error:KeeperErrorCode = >> >> >> >> > NodeExists for /brokers/ids >> >> >> >> > >> >> >> >> > >> >> >> >> > >> >> >> >> > -----Original Message----- >> >> >> >> > From: Yi Pan [mailto:nickpa...@gmail.com] >> >> >> >> > Sent: Tuesday, September 12, 2017 2:02 PM >> >> >> >> > To: dev@samza.apache.org<mailto:dev@samza.apache.org> >> >> >> >> > Subject: Re: Connection timed out error while installing "Hello >> Samza" >> >> >> >> > >> >> >> >> > Hi, Anantharaman, >> >> >> >> > >> >> >> >> > Could you post your zookeeper startup logs here? >> >> >> >> > >> >> >> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha >> >> > (Contractor) >> >> >> >> > < srinatha_ananthara...@comcast.com<mailto:Srinatha_Anantharam >> >> a...@comcast.com>> wrote: >> >> >> >> > >> >> >> >> > > It hangs while bringing up the service >> >> >> >> > > >> >> >> >> > > [root@codehdplak-po-r19p hello-samza]# pwd >> >> >> >> > > /app/home/eventsvc/samza-git/hello-samza >> >> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install >> >> > > zookeeper >> >> >> >> > > EXECUTING: install zookeeper >> >> >> >> > > Using previously downloaded file /root/.samza/download/ >> >> >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]# >> >> >> >> > > ./bin/grid start zookeeper >> >> >> >> > > EXECUTING: start zookeeper >> >> >> >> > > JMX enabled by default >> >> >> >> > > Using config: >> >> >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/ >> >> >> >> > > bin/../conf/zoo.cfg >> >> >> >> > > Starting zookeeper ... STARTED >> >> >> >> > > Waiting for zookeeper to start... >> >> >> >> > > >> >> >> >> > > ^C >> >> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start >> >> > > zookeeper^C >> >> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid install >> >> > > kafka >> >> >> >> > > EXECUTING: install kafka >> >> >> >> > > Using previously downloaded file /root/.samza/download/kafka_2. >> >> >> >> > > 11-0.10.1.1.tgz >> >> >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start kafka >> >> >> >> > > EXECUTING: start kafka >> >> >> >> > > Waiting for kafka to start... >> >> >> >> > > Ncat: Connection refused. >> >> >> >> > > .Ncat: Connection refused. >> >> >> >> > > .Ncat: Connection refused. >> >> >> >> > > .^C >> >> >> >> > > [root@codehdplak-po-r19p hello-samza]# >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > -----Original Message----- >> >> >> >> > > From: Navina Ramesh [mailto:nram...@linkedin.com] >> >> >> >> > > Sent: Tuesday, September 12, 2017 12:43 PM >> >> >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org> >> >> >> >> > > Subject: Re: Connection timed out error while installing >> >> > > "Hello >> Samza" >> >> >> >> > > >> >> >> >> > > Yes. You can clone apache/samza locally and build it with: >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > cd <samza-workspace> >> >> >> >> > > >> >> >> >> > > gradle -b bootstrap.gradle >> >> >> >> > > >> >> >> >> > > ./gradlew clean build -x test >> >> >> >> > > >> >> >> >> > > ./gradlew publishToMavenLocal ## This publishes a snapshot >> version >> >> of >> >> >> >> > > the latest apache/samza into your local maven repo >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > Then, head to hello-samza workspace and build again: >> >> >> >> > > >> >> >> >> > > cd <hello-samza-workspace> >> >> >> >> > > >> >> >> >> > > mvn clean package ## This should create a build target >> >> >> >> > > >> >> >> >> > > ./bin/grid install zookeeper >> >> >> >> > > >> >> >> >> > > ./bin/grid start zookeeper >> >> >> >> > > >> >> >> >> > > ./bin/grid install kafka >> >> >> >> > > >> >> >> >> > > ./bin/grid start kafka >> >> >> >> > > >> >> >> >> > > ./bin/grid install yarn >> >> >> >> > > >> >> >> >> > > ./bin/grid start yarn >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > mkdir -p deploy/samza >> >> >> >> > > >> >> >> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C >> >> > > deploy/samza >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > After this, you can follow steps in the tutorial to "Run" the >> >> >> >> > > example Samza job. >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > HTH! Let me know if you need further help. >> >> >> >> > > >> >> >> >> > > Navina >> >> >> >> > > >> >> >> >> > > ________________________________ >> >> >> >> > > From: Anantharaman, Srinatha (Contractor) >> >> > > <Srinatha_Anantharaman@ >> >> >> >> > > comcast.com> >> >> >> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM >> >> >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org> >> >> >> >> > > Subject: RE: Connection timed out error while installing >> >> > > "Hello >> Samza" >> >> >> >> > > >> >> >> >> > > Navina, >> >> >> >> > > >> >> >> >> > > Is there any other way we can install Hello Samza? >> >> >> >> > > >> >> >> >> > > Regards, >> >> >> >> > > ~Sri >> >> >> >> > > >> >> >> >> > > -----Original Message----- >> >> >> >> > > From: Navina Ramesh [mailto:nram...@linkedin.com] >> >> >> >> > > Sent: Tuesday, September 12, 2017 11:42 AM >> >> >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org> >> >> >> >> > > Subject: Re: Connection timed out error while installing >> >> > > "Hello >> Samza" >> >> >> >> > > >> >> >> >> > > Ok. I tried again for the "latest" branch in hello-samza and >> >> > > it >> >> >> >> > > still works. >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > > While installing it says "Building samza from master..." >> >> >> >> > > >> >> >> >> > > It is expected to build from "master" in apache/samza repo. >> >> > > So, the >> >> >> >> > > output line is expected. >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > It is weird that you are unable to connect. Is it possible you >> >> > > are >> >> >> >> > > behind a firewall or something? Can you try to ping " >> git.apache.org" >> >> ? >> >> >> >> > > Or try the setup on a different box? >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > Navina >> >> >> >> > > >> >> >> >> > > ________________________________ >> >> >> >> > > From: Anantharaman, Srinatha (Contractor) >> >> > > <Srinatha_Anantharaman@ >> >> >> >> > > comcast.com> >> >> >> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM >> >> >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org> >> >> >> >> > > Subject: RE: Connection timed out error while installing >> >> > > "Hello >> Samza" >> >> >> >> > > >> >> >> >> > > Navina, >> >> >> >> > > >> >> >> >> > > I tried again but still same error >> >> >> >> > > >> >> >> >> > > While installing it says "Building samza from master..." >> >> >> >> > > >> >> >> >> > > But when after I cloned I executed " git checkout latest" >> >> >> >> > > >> >> >> >> > > Regards, >> >> >> >> > > ~Sri >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > -----Original Message----- >> >> >> >> > > From: Navina Ramesh [mailto:nram...@linkedin.com] >> >> >> >> > > Sent: Tuesday, September 12, 2017 11:10 AM >> >> >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org> >> >> >> >> > > Subject: Re: Connection timed out error while installing >> >> > > "Hello >> Samza" >> >> >> >> > > >> >> >> >> > > Hi Anantharaman, >> >> >> >> > > >> >> >> >> > > It looks like a transient connection failure to connect to >> >> > > Apache's >> >> >> >> > > git. I tried on my host and it seems to be working. >> >> >> >> > > >> >> >> >> > > Can you give it another shot? >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > If it still doesn't work, please let me know if you are >> >> > > running the >> >> >> >> > > command under the "master" or "latest" branch of samza-hello-samza. >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > Thanks! >> >> >> >> > > >> >> >> >> > > Navina >> >> >> >> > > >> >> >> >> > > ________________________________ >> >> >> >> > > From: Anantharaman, Srinatha (Contractor) >> >> > > <Srinatha_Anantharaman@ >> >> >> >> > > comcast.com> >> >> >> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM >> >> >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org> >> >> >> >> > > Subject: Connection timed out error while installing "Hello Samza" >> >> >> >> > > >> >> >> >> > > Hi, >> >> >> >> > > >> >> >> >> > > I am trying to install "Hello Samza" on a single node >> >> > > Initially I >> >> >> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid >> >> > > install >> >> >> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap >> >> > > getting >> >> >> >> > > connection timed out error It also mentions no kafka, yarn and >> >> >> >> > > zookeeper installed >> >> >> >> > > >> >> >> >> > > Please find below the error message >> >> >> >> > > >> >> >> >> > > [root@codehdplak-po-r19p bin]# cd .. >> >> >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install kafka >> >> >> >> > > EXECUTING: install kafka >> >> >> >> > > Using previously downloaded file /root/.samza/download/kafka_2. >> >> >> >> > > 11-0.10.1.1.tgz >> >> >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install yarn >> >> >> >> > > EXECUTING: install yarn >> >> >> >> > > Using previously downloaded file >> >> >> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz >> >> >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install >> >> > > zookeeper >> >> >> >> > > EXECUTING: install zookeeper >> >> >> >> > > Using previously downloaded file /root/.samza/download/ >> >> >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p hello-samza]# >> >> >> >> > > bin/grid bootstrap Bootstrapping the system... >> >> >> >> > > EXECUTING: stop kafka >> >> >> >> > > No kafka server to stop >> >> >> >> > > EXECUTING: stop yarn >> >> >> >> > > no resourcemanager to stop >> >> >> >> > > no nodemanager to stop >> >> >> >> > > EXECUTING: stop zookeeper >> >> >> >> > > JMX enabled by default >> >> >> >> > > Using config: >> >> >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/ >> >> >> >> > > bin/../conf/zoo.cfg >> >> >> >> > > Stopping zookeeper ... no zookeeper to stop (could not find >> >> > > file >> >> >> >> > > /tmp/zookeeper/zookeeper_server.pid) >> >> >> >> > > EXECUTING: install samza >> >> >> >> > > Building samza from master... >> >> >> >> > > ~/.samza/download /app/home/eventsvc/samza-git/hello-samza >> >> >> >> > > Cloning into 'samza'... >> >> >> >> > > fatal: unable to connect to git.apache.org: >> >> >> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out >> >> >> >> > > >> >> >> >> > > >> >> >> >> > > Could you please help me to resolve this issue? >> >> >> >> > > >> >> >> >> > > Regards, >> >> >> >> > > ~Sri >> >> >> >> > > >> >> >> >> > >> >> >> > >> > >> > >