Hi, Anantharaman,
So, apparently, your local Kafka broker has not started successfully. Could
you try:
{noformat}
./bin/grid stop kafka
ps auxww | grep kafka
{noformat}
First make sure there is no Kafka broker running, and run the following
command:
{noformat}
./bin/grid start kafka
telnet localhost 9092
{noformat}
If it does not work, please post the Kafka broker side log file (under
${YOUR-HELLO-SAMZA-DIR}/deploy/kafka/logs), please post server.log,
kafka.log, and controller.log).
P.S. regarding to your build failure w/ publishToMavenLocal, please note
the following in the online doc (
http://samza.apache.org/startup/hello-samza/0.13/):
1. The online doc stated that you will only need that if trying to build
and deploy hello-samza in *latest branch*. If you are building and
deploying in master branch, you don't need to do that.
2. The online doc also stated that you will run this command in *Samza*
build directory, not in *hello-samza* build directory.
Hope the above help to clarify it.
-Yi
On Thu, Sep 21, 2017 at 2:14 PM, Anantharaman, Srinatha (Contractor) <
srinatha_ananthara...@comcast.com> wrote:
> Yi,
>
> Meanwhile I fixed the issue with "]# ./gradlew publishToMavenLocal" by
> adding apply plugin: 'maven-publish' inside the build.gradle file
>
> Still telnet to port 9092 is not working
>
> I also tried the next steps to run the Samza job and to consume the feed
> through kafka but getting below warning
>
> 2017-09-21 21:13:01.104 [main] KafkaSystemAdmin [WARN] Failed to create
> topic __samza_coordinator_wikipedia-feed_1: org.apache.kafka.common.
> errors.InvalidReplicationFactorException: replication factor: 1 larger
> than available brokers: 0. Retrying.
>
> Kafka Consumer:
>
> [root@csadatlak-wc-a1t hello-samza]#
> deploy/kafka/bin/kafka-console-consumer.sh
> --zookeeper localhost:2181 --topic wikipedia-raw
> Using the ConsoleConsumer with old consumer is deprecated and will be
> removed in a future major release. Consider using the new consumer by
> passing [bootstrap-server] instead of [zookeeper].
> [2017-09-21 21:07:24,744] WARN [console-consumer-21819_
> csadatlak-wc-a1t.sys.comcast.net-1506028044391-5afc1cc2], no brokers
> found when trying to rebalance. (kafka.consumer.
> ZookeeperConsumerConnector)
>
>
> Regards,
> ~Sri
>
> -----Original Message-----
> From: Anantharaman, Srinatha (Contractor)
> Sent: Thursday, September 21, 2017 4:06 PM
> To: dev@samza.apache.org
> Subject: RE: Connection timed out error while installing "Hello Samza"
>
> Yi,
>
> It is my mistake I was looking at the previous version documentation
>
> All the telnet worked like you showed me except for " telnet localhost
> 9092"
> Got the cluster info as below
>
> {"clusterInfo":{"id":1506020118416,"startedOn":1506020118416,"state":"
> STARTED","haState":"ACTIVE","rmStateStoreName":"org.apache.
> hadoop.yarn.server.resourcemanager.recovery.NullRMStateStore","
> resourceManagerVersion":"2.6.1","resourceManagerBuildVersion":"2.6.1 from
> b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
> 74cda5515f4fe1fa62ab68b2bd4cd13c","resourceManagerVersionBuiltOn"
> :"2015-09-16T21:14Z","hadoopVersion":"2.6.1","hadoopBuildVersion":"2.6.1
> from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
> ba9a9397365e3ec2f1b3691b52627f","hadoopVersionBuiltOn":"2015-09-16T21:07Z"}}Connection
> closed by foreign host.
>
>
> BTW earlier I did not execute the " Build a Samza Job Package" { was
> referring to .7 and this step is not part of it)
>
> ./gradlew publishToMavenLocal
>
> When I run the above command I am getting below error
>
> [root@csadatlak-wc-a1t hello-samza]# ./gradlew publishToMavenLocal
>
> FAILURE: Build failed with an exception.
>
> * What went wrong:
> Task 'publishToMavenLocal' not found in root project 'hello-samza'.
>
> * Try:
> Run gradlew tasks to get a list of available tasks. Run with --stacktrace
> option to get the stack trace. Run with --info or --debug option to get
> more log output.
>
> BUILD FAILED
>
> Total time: 5.786 secs
>
> Kindly advise me for the above errors
>
> Regards,
> ~Sri
>
>
> -----Original Message-----
> From: Yi Pan [mailto:nickpa...@gmail.com]
> Sent: Wednesday, September 20, 2017 8:29 PM
> To: dev@samza.apache.org
> Subject: Re: Connection timed out error while installing "Hello Samza"
>
> Hi, Anantharaman,
>
> Did you follow documentation here:
> http://samza.apache.org/startup/hello-samza/0.13/? It states that you
> will need to use the following commands to install hello-samza job, in the
> same directory that you cloned the hello-samza git project:
> {code}
>
> mvn clean package
> mkdir -p deploy/samza
> tar -xvf ./target/hello-samza-0.13.0-dist.tar.gz -C deploy/samza
>
> {code}
>
> We apologize if the documentation is not clear and please file/open JIRA
> for unclear documentation issues s.t. we can fix and help.
>
> But first, please follow the exact steps, especially when we are trying to
> help debugging your local deployment issue.
>
> P.S. if all 3 services (i.e. zookeeper, kafka, and YARN) are running, are
> you able to telnet to those service like the response I got from my local
> box below:
>
> {noformat}
>
> yipan-mn1:hello-samza yipan$ telnet localhost 2181
>
> Trying ::1...
>
> Connected to localhost.
>
> Escape character is '^]'.
>
> ^]
>
> telnet> quit
>
> Connection closed.
>
> yipan-mn1:hello-samza yipan$ telnet localhost 9092
>
> Trying ::1...
>
> Connected to localhost.
>
> Escape character is '^]'.
>
> ^]
>
> telnet>
>
> quit
>
> Connection closed by foreign host.
>
> yipan-mn1:hello-samza yipan$ telnet localhost 8088
>
> Trying ::1...
>
> telnet: connect to address ::1: Connection refused
>
> Trying fe80::1...
>
> telnet: connect to address fe80::1: Connection refused
>
> Trying 127.0.0.1...
>
> Connected to localhost.
>
> Escape character is '^]'.
>
> GET /ws/v1/cluster/info
>
> {"clusterInfo":{"id":1505953361666,"startedOn":1505953361666,"state":"
> STARTED","haState":"ACTIVE","rmStateStoreName":"org.apache.
> hadoop.yarn.server.resourcemanager.recovery.NullRMStateStore","
> resourceManagerVersion":"2.6.1","resourceManagerBuildVersion":"2.6.1
> from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
> 74cda5515f4fe1fa62ab68b2bd4cd13c","resourceManagerVersionBuiltOn"
> :"2015-09-16T21:14Z","hadoopVersion":"2.6.1","hadoopBuildVersion":"2.6.1
> from b4d876d837b830405ccdb6af94742f99d49f9c04 by jenkins source checksum
> ba9a9397365e3ec2f1b3691b52627f","hadoopVersionBuiltOn":"
> 2015-09-16T21:07Z"}}Connection
> closed by foreign host.
>
> {noformat}
>
>
> And are you using VPN to access Internet on the host you are deploying
> Samza?
>
>
> -Yi
>
>
> On Wed, Sep 20, 2017 at 2:58 PM, Anantharaman, Srinatha (Contractor) <
> srinatha_ananthara...@comcast.com> wrote:
>
> > I had already seen using ps aux that all 3 services are running I am
> > not able to open the Yarn UI and when I start YARN it says "Waiting
> > for resourcemanager to start... Ncat: Connection refused" that made
> > me to think YARN not started properly
> >
> > Now Trying to build the Samza Package with the below steps
> >
> > mvn clean package -- Done
> > mkdir -p deploy/samza --Done
> > tar -xvf
> > ./samza-job-package/target/samza-job-package-0.7.0-dist.tar.gz
> > -C deploy/samza -- Fails as file does not exists.
> >
> > Samza documentation sucks, I do not find that folder Or file. Do I
> > need to use hello-samza-0.13.0-dist.tar.gz which is under my
> > "/home/sanant003c/hello-samza/target" folder?
> >
> >
> >
> > -----Original Message-----
> > From: Jagadish Venkatraman [mailto:jagadish1...@gmail.com]
> > Sent: Wednesday, September 20, 2017 4:48 PM
> > To: dev@samza.apache.org
> > Subject: Re: Connection timed out error while installing "Hello Samza"
> >
> > What do you mean by YARN fails to start? The logs you pointed out
> > don't seem to have any error.
> >
> > Is the ResourceManager process running and you are not able to connect
> > to it? Perhaps, try running a quick *ps aux* to find that.
> >
> > On Wed, Sep 20, 2017 at 1:18 PM, Anantharaman, Srinatha (Contractor) <
> > srinatha_ananthara...@comcast.com> wrote:
> >
> > > Jagdish,
> > >
> > > I appreciate your help.
> > >
> > > It worked though netcat gave "0' output I still changed the grid
> > > script to "https"
> > >
> > >
> > > [root@csadatlak-wc-a1t hello-samza]# nc github.com 9418 < /dev/null;
> > > echo $?
> > > 0
> > >
> > >
> > > Before I build my Samza job I wanted to confirm if I am able to
> > > access my YARN When I start YARN it fails to start, Below are the
> > > last few lines from Yarn log
> > >
> > > LOG :
> > >
> > > 2017-09-20 19:45:50,586 INFO org.mortbay.log: jetty-6.1.26
> > > 2017-09-20 19:45:50,625 INFO org.mortbay.log: Extract
> > > jar:file:/home/sanant003c/hello-samza/deploy/yarn/share/
> > > hadoop/yarn/hadoop-yarn-common-2.6.1.jar!/webapps/cluster to
> > > /tmp/Jetty_127_0_0_1_8088_cluster____wfih6e/webapp
> > > 2017-09-20 19:45:50,922 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Starting expired delegation
> > > token remover thread, tokenRemoverScanInterval=60 min(s)
> > > 2017-09-20 19:45:50,923 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,970 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Starting expired delegation
> > > token remover thread, tokenRemoverScanInterval=60 min(s)
> > > 2017-09-20 19:45:50,971 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Starting expired delegation
> > > token remover thread, tokenRemoverScanInterval=60 min(s)
> > > 2017-09-20 19:45:50,972 INFO org.apache.hadoop.security.
> > token.delegation.
> > > AbstractDelegationTokenSecretManager: Updating the current master
> > > key for generating delegation tokens
> > > 2017-09-20 19:45:50,983 INFO org.mortbay.log: Started HttpServer2$
> > > SelectChannelConnectorWithSafeStartup@127.0.0.1:8088
> > > 2017-09-20 19:45:50,983 INFO org.apache.hadoop.yarn.webapp.WebApps:
> > > Web app /cluster started at 8088
> > > 2017-09-20 19:45:51,629 INFO org.apache.hadoop.yarn.webapp.WebApps:
> > > Registered webapp guice modules
> > > 2017-09-20 19:45:51,665 INFO org.apache.hadoop.ipc.CallQueueManager:
> > > Using callQueue class java.util.concurrent.LinkedBlockingQueue
> > > 2017-09-20 19:45:51,667 INFO org.apache.hadoop.ipc.Server: Starting
> > > Socket Reader #1 for port 8033
> > > 2017-09-20 19:45:51,670 INFO org.apache.hadoop.yarn.factories.impl.pb.
> > RpcServerFactoryPBImpl:
> > > Adding protocol org.apache.hadoop.yarn.server.api.
> > > ResourceManagerAdministrationProtocolPB to the server
> > > 2017-09-20 19:45:51,671 INFO org.apache.hadoop.ipc.Server: IPC
> > > Server
> > > Responder: starting
> > > 2017-09-20 19:45:51,672 INFO org.apache.hadoop.ipc.Server: IPC
> > > Server listener on 8033: starting
> > > 2017-09-20 19:55:50,040 INFO org.apache.hadoop.yarn.server.
> > > resourcemanager.scheduler.AbstractYarnScheduler: Release request
> > > cache is cleaned up
> > >
> > >
> > >
> > >
> > >
> > > Command line output of Zookeepr and Yarn process Start :
> > >
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid start zookeeper
> > > EXECUTING: start zookeeper
> > > JMX enabled by default
> > > Using config:
> > > /home/sanant003c/hello-samza/deploy/zookeeper/bin/../conf/
> > > zoo.cfg
> > > Starting zookeeper ... already running as process 11824.
> > > Waiting for zookeeper to start...
> > > ^C
> > > [root@csadatlak-wc-a1t hello-samza]# bin/grid start yarn
> > > EXECUTING: start yarn
> > > starting resourcemanager, logging to /home/sanant003c/hello-samza/
> > > deploy/yarn/logs/yarn-root-resourcemanager-csadatlak-wc-
> > > a1t.sys.comcast.net.out
> > > Waiting for resourcemanager to start...
> > > Ncat: Connection refused.
> > > .Ncat: Connection refused.
> > > .
> > >
> > >
> > >
> > > Regards,
> > > ~Sri
> > >
> > > -----Original Message-----
> > > From: Jagadish Venkatraman [mailto:jagadish1...@gmail.com]
> > > Sent: Wednesday, September 20, 2017 1:36 PM
> > > To: dev@samza.apache.org
> > > Subject: Re: Connection timed out error while installing "Hello Samza"
> > >
> > > Hi Anantharaman,
> > >
> > > It's likely that your server blocks the GIT protocol. If so, I'd
> > > recommend cloning via HTTPS instead of git.
> > >
> > > *First, determine if the git protocol is blocked on the server as
> > > follows:*
> > >
> > > Please run:
> > > # connects to github default port ➜ ~ nc github.com 9418 <
> > > /dev/null; echo $?
> > >
> > > You should see the output as "0". Any other exit code means that the
> > > GIT protocol is blocked.
> > >
> > > *If the above command gets you a non-zero exit code, please clone
> > > using HTTPS as follows:*
> > >
> > > git clone https://github.com/apache/samza.git
> > >
> > > Alternately, you can edit the line in the bin/grid script replacing
> > > git clone git://git.apache.org/samza.git with git clone
> > > https://github.com/apache/samza.git
> > > and re-run the same command.
> > >
> > > Please let us know how it goes! :-)
> > >
> > > Best,
> > > Jagdish
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Wed, Sep 20, 2017 at 9:04 AM, Anantharaman, Srinatha (Contractor)
> > > < srinatha_ananthara...@comcast.com> wrote:
> > >
> > > > Yi,
> > > >
> > > > As you suggested this time I tried to install Samza on clean
> > > > server (there is nothing installed on this server) Still I am
> > > > getting connection timeout error, Please find below command line
> outputs.
> > > > My System Admin/Dev Ops confirmed that this server does not have
> > > > any firewall restrictions
> > > >
> > > >
> > > > [root@csadatlak-wc-a1t ~]# echo $JAVA_HOME
> > > > /usr/lib/jvm/java-1.8.0-openjdk [root@csadatlak-wc-a1t ~]# echo
> > > > $PATH
> > > > /usr/lib/jvm/java-1.8.0-openjdk/bin:/usr/lib/jvm/java-
> > > > 1.8.0-openjdk/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/
> > > > usr/bin:/usr/local/sbin:/usr/sbin:/root/bin
> > > > [root@csadatlak-wc-a1t ~]# clear
> > > > [root@csadatlak-wc-a1t ~]# pwd
> > > > /root
> > > > [root@csadatlak-wc-a1t ~]# cd
> > > > [root@csadatlak-wc-a1t ~]# set -o vi [root@csadatlak-wc-a1t ~]#
> > > > ^Ct -o vi [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > > > [root@csadatlak-wc-a1t ~]# [root@csadatlak-wc-a1t ~]#
> > > > [root@csadatlak-wc-a1t ~]# cd /home/sanant003c/
> > > > [root@csadatlak-wc-a1t sanant003c]# ll total 4 drwxr-xr-x 7 root
> > > > root 4096 Sep 20 15:32 hello-samza [root@csadatlak-wc-a1t
> > > > sanant003c]# cd hello-samza/ [root@csadatlak-wc-a1t hello-samza]#
> > > > ll
> > total 312
> > > > drwxr-xr-x 2 root root 119 Sep 20 15:32 bin
> > > > -rw-r--r-- 1 root root 6946 Sep 20 15:32 build.gradle
> > > > drwxr-xr-x 2 root root 26 Sep 20 15:32 conf
> > > > drwxr-xr-x 3 root root 20 Sep 20 15:32 gradle
> > > > -rw-r--r-- 1 root root 898 Sep 20 15:32 gradle.properties
> > > > -rwxr-xr-x 1 root root 5080 Sep 20 15:32 gradlew
> > > > -rw-r--r-- 1 root root 2404 Sep 20 15:32 gradlew.bat
> > > > -rw-r--r-- 1 root root 30449 Sep 20 15:32 LICENSE
> > > > -rw-r--r-- 1 root root 9343 Sep 20 15:32 pom.xml
> > > > -rw-r--r-- 1 root root 1095 Sep 20 15:32 README-gradle.md
> > > > -rw-r--r-- 1 root root 1118 Sep 20 15:32 README.md
> > > > drwxr-xr-x 3 root root 17 Sep 20 15:32 src
> > > > -rw-r--r-- 1 root root 240217 Sep 20 15:32 wikipedia-raw.json
> > > > [root@csadatlak-wc-a1t hello-samza]# bin/grid bootstrap
> > > > Bootstrapping the system...
> > > > EXECUTING: stop kafka
> > > > Kafka is not installed. Run: bin/grid install kafka
> > > > EXECUTING: stop yarn
> > > > YARN is not installed. Run: bin/grid install yarn
> > > > EXECUTING: stop zookeeper
> > > > Zookeeper is not installed. Run: bin/grid install zookeeper
> > > > EXECUTING: install samza
> > > > ~/.samza/download /home/sanant003c/hello-samza Cloning into
> 'samza'...
> > > > fatal: unable to connect to git.apache.org:
> > > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > > >
> > > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install kafka
> > > > EXECUTING: install kafka
> > > > Downloading kafka_2.11-0.10.1.1.tgz...
> > > > % Total % Received % Xferd Average Speed Time Time
> Time
> > > > Current
> > > > Dload Upload Total Spent
> Left
> > > > Speed
> > > > 100 32.8M 100 32.8M 0 0 614k 0 0:00:54 0:00:54
> > --:--:--
> > > > 620k
> > > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install yarn
> > > > EXECUTING: install yarn
> > > > Downloading hadoop-2.6.1.tar.gz...
> > > > % Total % Received % Xferd Average Speed Time Time
> Time
> > > > Current
> > > > Dload Upload Total Spent
> Left
> > > > Speed
> > > > 100 187M 100 187M 0 0 717k 0 0:04:28 0:04:28
> > --:--:--
> > > > 734k
> > > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install zookeeper
> > > > EXECUTING: install zookeeper
> > > > Downloading zookeeper-3.4.3.tar.gz...
> > > > % Total % Received % Xferd Average Speed Time Time
> Time
> > > > Current
> > > > Dload Upload Total Spent
> Left
> > > > Speed
> > > > 100 15.4M 100 15.4M 0 0 727k 0 0:00:21 0:00:21
> > --:--:--
> > > > 747k
> > > > [root@csadatlak-wc-a1t hello-samza]# bin/grid install samza
> > > > EXECUTING: install samza
> > > > ~/.samza/download /home/sanant003c/hello-samza Cloning into
> 'samza'...
> > > > fatal: unable to connect to git.apache.org:
> > > > git.apache.org[0: 54.84.58.65]: errno=Connection timed out
> > > >
> > > > Kindly help me to install Samza on my UNIX server
> > > >
> > > > Regards,
> > > > ~Sri
> > > >
> > > > -----Original Message-----
> > > > From: Yi Pan [mailto:nickpa...@gmail.com]
> > > > Sent: Thursday, September 14, 2017 6:42 PM
> > > > To: dev@samza.apache.org
> > > > Subject: Re: Connection timed out error while installing "Hello
> Samza"
> > > >
> > > > P.S., the attachment you post w/ the previous email does not show
> > > > up (Apache mailing list disallow attachments). If would be better
> > > > if you send the command line outputs in pure text or html format.
> > > >
> > > > -Yi
> > > >
> > > > On Thu, Sep 14, 2017 at 3:34 PM, Yi Pan <nickpa...@gmail.com> wrote:
> > > >
> > > > > Hi, Anantharaman,
> > > > >
> > > > > A lot of firewall setup prevents "incoming connections", not
> > > > > "outgoing connections" from a box. I.e. if you are downloading
> > > > > files, you are establishing outgoing connections and it is fine.
> > > > > When you are hosting a server (i.e. ZooKeeper or Kafka), you are
> > > > > making an "incoming
> > > > connections"
> > > > > to the box and will trigger the firewall rules.
> > > > >
> > > > > Just trying to pin down the problem, could you try on a Linux
> > > > > box w/o any firewall rules setup and see whether that works? At
> > > > > least, verify that localhost resolves to 127.0.0.1 and try
> > > > > telnet locahost
> > > > > 9092 or
> > > > 2181?
> > > > >
> > > > > NOTE: Success in ping simply means that you can access via ICMP,
> > > > > not guarantee you can establish TCP connection to the ports via
> > > > > firewall
> > > > rules.
> > > > >
> > > > > -Yi
> > > > >
> > > > > On Thu, Sep 14, 2017 at 12:33 PM, Anantharaman, Srinatha
> > > > > (Contractor) < srinatha_ananthara...@comcast.com> wrote:
> > > > >
> > > > >> That is a good catch Naveena the server which I am trying to
> > > > >> install is an Hadoop edge node, it has kafka broker and
> > > > >> Zookeeper client already installed for my Hadoop Does it matter
> > > > >> If I am installing it on a separate folder?. My guess Even if
> > > > >> there are conflicts on earlier installations it should throw
> > > > >> some other error but not the connection time out
> > > > >>
> > > > >> Coming to your question " it could either related resolving
> > > "localhost"
> > > > >> or firewall that prevents communication between ports" - how to
> > > > >> prove it is because of Firewall issue. I am able to clone Samza
> > > > >> files from
> > > > Apache git.
> > > > >> I can download any external files on this server
> > > > >>
> > > > >> ~Sri
> > > > >>
> > > > >> -----Original Message-----
> > > > >> From: Navina Ramesh [mailto:nram...@linkedin.com]
> > > > >> Sent: Thursday, September 14, 2017 2:51 PM
> > > > >> To: dev@samza.apache.org
> > > > >> Subject: Re: Connection timed out error while installing "Hello
> > Samza"
> > > > >>
> > > > >> I wonder if this has anything to do with previous kafka /
> > > > >> zookeeper installed on your box. Just for sanity, try clearing
> > > > >> /tmp/zookeeeper* and
> > > > >> /tmp/kafka* before re-trying those steps.
> > > > >>
> > > > >>
> > > > >> Same as Yi, I strongly suspect issues with your local laptop
> > > > >> setup
> > > > >> - it could either related resolving "localhost" or firewall
> > > > >> that prevents communication between ports.
> > > > >>
> > > > >>
> > > > >> Navina
> > > > >>
> > > > >> ________________________________
> > > > >> From: Yi Pan <nickpa...@gmail.com>
> > > > >> Sent: Thursday, September 14, 2017 11:37:46 AM
> > > > >> To: dev@samza.apache.org
> > > > >> Subject: Re: Connection timed out error while installing "Hello
> > Samza"
> > > > >>
> > > > >> Hi, Anantharaman,
> > > > >>
> > > > >> I just did the same steps as you described in your email and
> > > > >> all passed on my box. Hence, I strongly suspect that it is
> > > > >> related to your local laptop network setup.
> > > > >>
> > > > >> Could you post all the command line output when you ran the
> > > > >> sequence of commands?
> > > > >>
> > > > >> -Yi
> > > > >>
> > > > >> On Thu, Sep 14, 2017 at 11:21 AM, Yi Pan <nickpa...@gmail.com>
> > wrote:
> > > > >>
> > > > >> > Hi, Ananarath,
> > > > >> >
> > > > >> > It is very strange that you are seeing this timeout exception
> > > > >> > that we do not see. I am trying to follow the exact steps you
> > > > >> > did to see whether there is anything broken. I will update
> > > > >> > you this
> > > afternoon.
> > > > >> >
> > > > >> > Meanwhile, could you check your hostname setup and firewall
> > > > >> > configuration to see whether your local laptop has blocked
> > > > >> > access via the public IP address to your laptop? Could you
> > > > >> > verify that your localhost is resolved to
> > > > >> > 127.0.0.1 and is accessible?
> > > > >> >
> > > > >> > -Yi
> > > > >> >
> > > > >> > On Thu, Sep 14, 2017 at 11:18 AM, Anantharaman, Srinatha
> > > > >> > (Contractor) < srinatha_ananthara...@comcast.com> wrote:
> > > > >> >
> > > > >> >> Yi,
> > > > >> >>
> > > > >> >> Is there any alternate way to install Samza Or solution to
> > > > >> >> the connection time out error?
> > > > >> >>
> > > > >> >> Regards,
> > > > >> >> ~Sri
> > > > >> >>
> > > > >> >> From: Anantharaman, Srinatha (Contractor)
> > > > >> >> Sent: Wednesday, September 13, 2017 11:37 AM
> > > > >> >> To: dev@samza.apache.org
> > > > >> >> Subject: RE: Connection timed out error while installing
> > > > >> >> "Hello
> > > > Samza"
> > > > >> >>
> > > > >> >>
> > > > >> >> Yi,
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> I am trying to build Samza locally by following the steps
> > > > >> >> provided by Navina.
> > > > >> >>
> > > > >> >> As per those steps kafka will be installed after Zookeeper,
> > > > >> >> I am getting Error while starting Zookeeper after it is
> > > > >> >> installed
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Steps Followed :
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Yes. You can clone apache/samza locally and build it with:
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> cd <samza-workspace>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> gradle -b bootstrap.gradle
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./gradlew clean build -x test
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./gradlew publishToMavenLocal ## This publishes a snapshot
> > > version
> > > > >> of
> > > > >> >> the latest apache/samza into your local maven repo
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Then, head to hello-samza workspace and build again:
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> cd <hello-samza-workspace>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> mvn clean package ## This should create a build target
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid install zookeeper
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid start zookeeper
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid install kafka
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid start kafka
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid install yarn
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> ./bin/grid start yarn
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> mkdir -p deploy/samza
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > > > >> >> deploy/samza
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> NOTE : BTW From the above steps I could not execute " gradle
> > > > >> >> -b bootstrap.gradle" since that command does not exists
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Regards,
> > > > >> >>
> > > > >> >> ~Sri
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> -----Original Message-----
> > > > >> >> From: Yi Pan [mailto:nickpa...@gmail.com]
> > > > >> >> Sent: Tuesday, September 12, 2017 7:13 PM
> > > > >> >> To: dev@samza.apache.org<mailto:dev@samza.apache.org>
> > > > >> >> Subject: Re: Connection timed out error while installing
> > > > >> >> "Hello
> > > > Samza"
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Hi, Anantharam,
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Could you confirm at which step your setup failed? It seems
> > > > >> >> that your zookeeper server is running. Could you check to
> > > > >> >> see whether your Kafka broker is running? You can either do
> > > > >> >> a telnet localhost
> > > > >> >> 9092 or do a ps auxww | grep kafka to see whether you got
> > > > >> >> any broker
> > > > running.
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Sometimes, the Kafka service takes time to start on a single
> > > laptop.
> > > > >> >> You can just try to run ./bin/grid start kafka
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> again to see whether the service is up.
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> Thanks!
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> -Yi
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> On Tue, Sep 12, 2017 at 11:38 AM, Anantharaman, Srinatha
> > > > >> >> (Contractor) <
> > > > >> >> srinatha_ananthara...@comcast.com<mailto:Srinatha_Anantharam
> > > > >> >> a...@comcast.com>> wrote:
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> > Find below Zookeeper logs:
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,124 [myid:] - INFO
> > > > >> >> > [main:QuorumPeerConfig@101]
> > > > >> >> > -
> > > > >> >>
> > > > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > > > >> >>
> > > > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,133 [myid:] - INFO
> > > > >> >>
> > > > >> >> > [main:DatadirCleanupManager@78] -
> > > > >> >> > autopurge.snapRetainCount set to
> > > > >> >> > 3
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > > > >> >>
> > > > >> >> > [main:DatadirCleanupManager@79] - autopurge.purgeInterval
> > > > >> >> > set to
> > > > >> >> > 0
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,134 [myid:] - INFO
> > > > >> >>
> > > > >> >> > [main:DatadirCleanupManager@101]
> > > > >> >>
> > > > >> >> > - Purge task is not scheduled.
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,135 [myid:] - WARN
> > > > >> >> > [main:QuorumPeerMain@113] -
> > > > >> >>
> > > > >> >> > Either no config or no quorum defined in config, running
> > > > >> >> > in
> > > > >> >>
> > > > >> >> > standalone mode
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,161 [myid:] - INFO
> > > > >> >> > [main:QuorumPeerConfig@101]
> > > > >> >> > -
> > > > >> >>
> > > > >> >> > Reading configuration from: /app/home/eventsvc/samza-git/
> > > > >> >>
> > > > >> >> > hello-samza/deploy/zookeeper/bin/../conf/zoo.cfg
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,162 [myid:] - INFO
> > > > >> >> > [main:ZooKeeperServerMain@95]
> > > > >> >>
> > > > >> >> > - Starting server
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,175 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:zookeeper.version=3.4.3-1240972, built on
> > > > >> >> > 02/06/2012
> > > > >> >> > 10:48
> > > > >> >>
> > > > >> >> > GMT
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:host.name=codehdplak-po-r19p.sys.comcast.net
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,176 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.version=1.8.0_31
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.vendor=Oracle Corporation
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,177 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.
> > > > >> >>
> > > > >> >> > 8.0.31-2.b13.el7.x86_64/jre
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.class.path=/app/home/eventsvc/samza-git/
> > > > >> >>
> > > > >> >> > hello-samza/deploy/zookeeper/bin/../build/classes:/app/
> > > > >> >>
> > > > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/.
> > > > >> >> > ./
> > > > >> >>
> > > > >> >> > build/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > > > >> >>
> > > > >> >> > samza/deploy/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:
> > > > >> >> > /
> > > > >> >>
> > > > >> >> > app/home/eventsvc/samza-git/hello-samza/deploy/zookeeper/
> > > > >> >>
> > > > >> >> > bin/../lib/slf4j-api-1.6.1.jar:/app/home/eventsvc/samza-
> > > > >> >>
> > > > >> >> > git/hello-samza/deploy/zookeeper/bin/../lib/netty-3.
> > > > >> >>
> > > > >> >> > 2.2.Final.jar:/app/home/eventsvc/samza-git/hello-
> > > > >> >>
> > > > >> >> > samza/deploy/zookeeper/bin/../lib/log4j-1.2.15.jar:/app/
> > > > >> >>
> > > > >> >> > home/eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/.
> > > > >> >> > ./
> > > > >> >>
> > > > >> >> > lib/jline-0.9.94.jar:/app/home/eventsvc/samza-git/hello-
> > > > >> >>
> > > > >> >> > samza/deploy/zookeeper/bin/../zookeeper-3.4.3.jar:/app/hom
> > > > >> >> > e/
> > > > >> >>
> > > > >> >> > eventsvc/samza-git/hello-samza/deploy/zookeeper/bin/../
> > > > >> >>
> > > > >> >> > src/java/lib/*.jar:/app/home/eventsvc/samza-git/hello-
> > > > >> >>
> > > > >> >> > samza/deploy/zookeeper/bin/../conf:
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,178 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.library.path=/usr/java/packages/lib/amd64
> > > > >> >> > :/
> > > > >> >>
> > > > >> >> > usr/lib64:/lib64:/lib:/usr/lib
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.io.tmpdir=/tmp
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,179 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:java.compiler=<NA>
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:os.name=Linux
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,180 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:os.arch=amd64
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:os.version=3.10.0-123.20.1.el7.x86_64
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,181 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:user.name=root
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:user.home=/root
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,182 [myid:] - INFO
> > > > >> >> > [main:Environment@98]
> > > > >> >> > - Server
> > > > >> >>
> > > > >> >> > environment:user.dir=/app/home/eventsvc/samza-git/hello-
> > > > >> >>
> > > > >> >> > samza/deploy/zookeeper
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > > >> >> > [main:ZooKeeperServer@733]
> > > > >> >> > -
> > > > >> >>
> > > > >> >> > tickTime set to 2000
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > > >> >> > [main:ZooKeeperServer@742]
> > > > >> >> > -
> > > > >> >>
> > > > >> >> > minSessionTimeout set to -1
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,195 [myid:] - INFO
> > > > >> >> > [main:ZooKeeperServer@751]
> > > > >> >> > -
> > > > >> >>
> > > > >> >> > maxSessionTimeout set to -1
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,213 [myid:] - INFO
> > > > >> >>
> > > > >> >> > [main:NIOServerCnxnFactory@110] - binding to port
> > > > >> >> > 0.0.0.0/0.0.0.0:2181
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,240 [myid:] - INFO
> > > > >> >> > [main:FileTxnSnapLog@238] -
> > > > >> >>
> > > > >> >> > Snapshotting: 0x0 to /tmp/zookeeper/version-2/snapshot.0
> > > > >> >>
> > > > >> >> > 2017-09-12 17:05:19,673 [myid:] - INFO
> > > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > > >> >>
> > > > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > > > >> >> > connection
> > > > >> >>
> > > > >> >> > from
> > > > >> >>
> > > > >> >> > /0:0:0:0:0:0:0:1:21754
> > > > >> >>
> > > > >> >> > 2017-09-12 17:17:40,265 [myid:] - WARN
> > > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > > >> >>
> > > > >> >> > 0.0.0.0:2181:NIOServerCnxn@349] - caught end of stream
> > > > >> >> > exception
> > > > >> >>
> > > > >> >> > EndOfStreamException: Unable to read additional data from
> > > > >> >> > client
> > > > >> >>
> > > > >> >> > sessionid 0x0, likely client has closed socket
> > > > >> >>
> > > > >> >> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> > > > >> >>
> > > > >> >> > NIOServerCnxn.java:220)
> > > > >> >>
> > > > >> >> > at
> > > > >> >> > org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> > > > >> >>
> > > > >> >> > NIOServerCnxnFactory.java:224)
> > > > >> >>
> > > > >> >> > at java.lang.Thread.run(Thread.java:745)
> > > > >> >>
> > > > >> >> > 2017-09-12 17:17:40,267 [myid:] - INFO
> > > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > > >> >>
> > > > >> >> > 0.0.0.0:2181:NIOServerCnxn@1000] - Closed socket
> > > > >> >> > connection for client
> > > > >> >>
> > > > >> >> > /0:0:0:0:0:0:0:1:21754 (no session established for client)
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,236 [myid:] - INFO
> > > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > > >> >>
> > > > >> >> > 0.0.0.0:2181:NIOServerCnxnFactory@213] - Accepted socket
> > > > >> >> > connection
> > > > >> >>
> > > > >> >> > from /
> > > > >> >>
> > > > >> >> > 127.0.0.1:48071
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,247 [myid:] - INFO
> > > > >> >> > [NIOServerCxn.Factory:0.0.0.0/
> > > > >> >>
> > > > >> >> > 0.0.0.0:2181:ZooKeeperServer@838] - Client attempting to
> > > > >> >> > establish new
> > > > >> >>
> > > > >> >> > session at /127.0.0.1:48071
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,250 [myid:] - INFO
> > > > >> >> > [SyncThread:0:FileTxnLog@199]
> > > > >> >>
> > > > >> >> > - Creating new log file: log.1
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,263 [myid:] - INFO
> > > > >> >>
> > > > >> >> > [SyncThread:0:ZooKeeperServer@604]
> > > > >> >>
> > > > >> >> > - Established session 0x15e770d61920000 with negotiated
> > > > >> >> > timeout
> > > > >> >> > 6000
> > > > >> >>
> > > > >> >> > for client /127.0.0.1:48071
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,321 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0x5
> > > > >> >> > zxid:0x3
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NoNode for /brokers
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,342 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0xb
> > > > >> >> > zxid:0x7
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/config
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NoNode for /config
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,356 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0x13 zxid:0xc
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/admin
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NoNode for /admin
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,457 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0x1b
> > > > >> >> > zxid:0x11
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/cluster
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NoNode for /cluster
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:06,973 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:setData
> > > > >> >> > cxid:0x25
> > > > >> >>
> > > > >> >> > zxid:0x15
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/controller_epoch
> > > > >> >>
> > > > >> >> > Error:KeeperErrorCode = NoNode for /controller_epoch
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:07,050 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:delete
> > > > >> >> > cxid:0x34
> > > > >> >> > zxid:0x17
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error
> > > > >> >> > Path:/admin/preferred_replica_election
> > > > >> >>
> > > > >> >> > Error:KeeperErrorCode = NoNode for
> > > > >> >> > /admin/preferred_replica_election
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:07,288 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0x3f
> > > > >> >> > zxid:0x18
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NodeExists for /brokers
> > > > >> >>
> > > > >> >> > 2017-09-12 17:18:07,290 [myid:] - INFO
> > > > >> >> > [ProcessThread(sid:0
> > > > >> cport:-1)::
> > > > >> >>
> > > > >> >> > PrepRequestProcessor@617] - Got user-level KeeperException
> > > > >> >> > when
> > > > >> >>
> > > > >> >> > processing sessionid:0x15e770d61920000 type:create
> > > > >> >> > cxid:0x40
> > > > >> >> > zxid:0x19
> > > > >> >>
> > > > >> >> > txntype:-1 reqpath:n/a Error Path:/brokers/ids
> > > > >> >> > Error:KeeperErrorCode =
> > > > >> >>
> > > > >> >> > NodeExists for /brokers/ids
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > -----Original Message-----
> > > > >> >>
> > > > >> >> > From: Yi Pan [mailto:nickpa...@gmail.com]
> > > > >> >>
> > > > >> >> > Sent: Tuesday, September 12, 2017 2:02 PM
> > > > >> >>
> > > > >> >> > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
> > > > >> >>
> > > > >> >> > Subject: Re: Connection timed out error while installing
> > > > >> >> > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > Hi, Anantharaman,
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > Could you post your zookeeper startup logs here?
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > On Tue, Sep 12, 2017 at 10:21 AM, Anantharaman, Srinatha
> > > > >> >> > (Contractor)
> > > > >> >>
> > > > >> >> > <
> > > > >> >> > srinatha_ananthara...@comcast.com<mailto:Srinatha_Ananthar
> > > > >> >> > am
> > > > >> >> a...@comcast.com>> wrote:
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >> > > It hangs while bringing up the service
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# pwd
> > > > >> >>
> > > > >> >> > > /app/home/eventsvc/samza-git/hello-samza
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid
> > > > >> >> > > install zookeeper
> > > > >> >>
> > > > >> >> > > EXECUTING: install zookeeper
> > > > >> >>
> > > > >> >> > > Using previously downloaded file /root/.samza/download/
> > > > >> >>
> > > > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > > > >> >> > > hello-samza]#
> > > > >> >>
> > > > >> >> > > ./bin/grid start zookeeper
> > > > >> >>
> > > > >> >> > > EXECUTING: start zookeeper
> > > > >> >>
> > > > >> >> > > JMX enabled by default
> > > > >> >>
> > > > >> >> > > Using config:
> > > > >> >>
> > > > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeepe
> > > > >> >> > > r/
> > > > >> >>
> > > > >> >> > > bin/../conf/zoo.cfg
> > > > >> >>
> > > > >> >> > > Starting zookeeper ... STARTED
> > > > >> >>
> > > > >> >> > > Waiting for zookeeper to start...
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ^C
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > > > >> >> > > zookeeper^C
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid
> > > > >> >> > > install kafka
> > > > >> >>
> > > > >> >> > > EXECUTING: install kafka
> > > > >> >>
> > > > >> >> > > Using previously downloaded file
> > /root/.samza/download/kafka_2.
> > > > >> >>
> > > > >> >> > > 11-0.10.1.1.tgz
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# ./bin/grid start
> > > > >> >> > > kafka
> > > > >> >>
> > > > >> >> > > EXECUTING: start kafka
> > > > >> >>
> > > > >> >> > > Waiting for kafka to start...
> > > > >> >>
> > > > >> >> > > Ncat: Connection refused.
> > > > >> >>
> > > > >> >> > > .Ncat: Connection refused.
> > > > >> >>
> > > > >> >> > > .Ncat: Connection refused.
> > > > >> >>
> > > > >> >> > > .^C
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]#
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > -----Original Message-----
> > > > >> >>
> > > > >> >> > > From: Navina Ramesh [mailto:nram...@linkedin.com]
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 12:43 PM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: Re: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Yes. You can clone apache/samza locally and build it with:
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > cd <samza-workspace>
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > gradle -b bootstrap.gradle
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./gradlew clean build -x test
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./gradlew publishToMavenLocal ## This publishes a
> snapshot
> > > > >> version
> > > > >> >> of
> > > > >> >>
> > > > >> >> > > the latest apache/samza into your local maven repo
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Then, head to hello-samza workspace and build again:
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > cd <hello-samza-workspace>
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > mvn clean package ## This should create a build target
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid install zookeeper
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid start zookeeper
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid install kafka
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid start kafka
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid install yarn
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ./bin/grid start yarn
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > mkdir -p deploy/samza
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > tar -xvf ./target/hello-samza-*-SNAPSHOT-dist.tar.gz -C
> > > > >> >> > > deploy/samza
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > After this, you can follow steps in the tutorial to "Run"
> > > > >> >> > > the
> > > > >> >>
> > > > >> >> > > example Samza job.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > HTH! Let me know if you need further help.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Navina
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ________________________________
> > > > >> >>
> > > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > > >> >> > > <Srinatha_Anantharaman@
> > > > >> >>
> > > > >> >> > > comcast.com>
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 9:21:53 AM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: RE: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Navina,
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Is there any other way we can install Hello Samza?
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Regards,
> > > > >> >>
> > > > >> >> > > ~Sri
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > -----Original Message-----
> > > > >> >>
> > > > >> >> > > From: Navina Ramesh [mailto:nram...@linkedin.com]
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 11:42 AM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: Re: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Ok. I tried again for the "latest" branch in hello-samza
> > > > >> >> > > and it
> > > > >> >>
> > > > >> >> > > still works.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > > While installing it says "Building samza from master..."
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > It is expected to build from "master" in apache/samza repo.
> > > > >> >> > > So, the
> > > > >> >>
> > > > >> >> > > output line is expected.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > It is weird that you are unable to connect. Is it
> > > > >> >> > > possible you are
> > > > >> >>
> > > > >> >> > > behind a firewall or something? Can you try to ping "
> > > > >> git.apache.org"
> > > > >> >> ?
> > > > >> >>
> > > > >> >> > > Or try the setup on a different box?
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Navina
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ________________________________
> > > > >> >>
> > > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > > >> >> > > <Srinatha_Anantharaman@
> > > > >> >>
> > > > >> >> > > comcast.com>
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 8:33:30 AM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: RE: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Navina,
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > I tried again but still same error
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > While installing it says "Building samza from master..."
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > But when after I cloned I executed " git checkout latest"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Regards,
> > > > >> >>
> > > > >> >> > > ~Sri
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > -----Original Message-----
> > > > >> >>
> > > > >> >> > > From: Navina Ramesh [mailto:nram...@linkedin.com]
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 11:10 AM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: Re: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > >> Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Hi Anantharaman,
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > It looks like a transient connection failure to connect
> > > > >> >> > > to Apache's
> > > > >> >>
> > > > >> >> > > git. I tried on my host and it seems to be working.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Can you give it another shot?
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > If it still doesn't work, please let me know if you are
> > > > >> >> > > running the
> > > > >> >>
> > > > >> >> > > command under the "master" or "latest" branch of
> > > > samza-hello-samza.
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Thanks!
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Navina
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > ________________________________
> > > > >> >>
> > > > >> >> > > From: Anantharaman, Srinatha (Contractor)
> > > > >> >> > > <Srinatha_Anantharaman@
> > > > >> >>
> > > > >> >> > > comcast.com>
> > > > >> >>
> > > > >> >> > > Sent: Tuesday, September 12, 2017 7:45:37 AM
> > > > >> >>
> > > > >> >> > > To: dev@samza.apache.org<mailto:dev@samza.apache.org>
> > > > >> >>
> > > > >> >> > > Subject: Connection timed out error while installing
> > > > >> >> > > "Hello
> > > > Samza"
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Hi,
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > I am trying to install "Hello Samza" on a single node
> > > > >> >> > > Initially I
> > > > >> >>
> > > > >> >> > > have installed Kafka, Yarn and Zookeeper using bin/grid
> > > > >> >> > > install
> > > > >> >>
> > > > >> >> > > kafka/yarn/zookeeper When I am trying bin/grid bootstrap
> > > > >> >> > > getting
> > > > >> >>
> > > > >> >> > > connection timed out error It also mentions no kafka,
> > > > >> >> > > yarn and
> > > > >> >>
> > > > >> >> > > zookeeper installed
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Please find below the error message
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p bin]# cd ..
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > > >> >> > > kafka
> > > > >> >>
> > > > >> >> > > EXECUTING: install kafka
> > > > >> >>
> > > > >> >> > > Using previously downloaded file
> > /root/.samza/download/kafka_2.
> > > > >> >>
> > > > >> >> > > 11-0.10.1.1.tgz
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > > >> >> > > yarn
> > > > >> >>
> > > > >> >> > > EXECUTING: install yarn
> > > > >> >>
> > > > >> >> > > Using previously downloaded file
> > > > >> >>
> > > > >> >> > > /root/.samza/download/hadoop-2.6.1.tar.gz
> > > > >> >>
> > > > >> >> > > [root@codehdplak-po-r19p hello-samza]# bin/grid install
> > > > >> >> > > zookeeper
> > > > >> >>
> > > > >> >> > > EXECUTING: install zookeeper
> > > > >> >>
> > > > >> >> > > Using previously downloaded file /root/.samza/download/
> > > > >> >>
> > > > >> >> > > zookeeper-3.4.3.tar.gz [root@codehdplak-po-r19p
> > > > >> >> > > hello-samza]#
> > > > >> >>
> > > > >> >> > > bin/grid bootstrap Bootstrapping the system...
> > > > >> >>
> > > > >> >> > > EXECUTING: stop kafka
> > > > >> >>
> > > > >> >> > > No kafka server to stop
> > > > >> >>
> > > > >> >> > > EXECUTING: stop yarn
> > > > >> >>
> > > > >> >> > > no resourcemanager to stop
> > > > >> >>
> > > > >> >> > > no nodemanager to stop
> > > > >> >>
> > > > >> >> > > EXECUTING: stop zookeeper
> > > > >> >>
> > > > >> >> > > JMX enabled by default
> > > > >> >>
> > > > >> >> > > Using config:
> > > > >> >>
> > > > >> >> > > /app/home/eventsvc/samza-git/hello-samza/deploy/zookeepe
> > > > >> >> > > r/
> > > > >> >>
> > > > >> >> > > bin/../conf/zoo.cfg
> > > > >> >>
> > > > >> >> > > Stopping zookeeper ... no zookeeper to stop (could not
> > > > >> >> > > find file
> > > > >> >>
> > > > >> >> > > /tmp/zookeeper/zookeeper_server.pid)
> > > > >> >>
> > > > >> >> > > EXECUTING: install samza
> > > > >> >>
> > > > >> >> > > Building samza from master...
> > > > >> >>
> > > > >> >> > > ~/.samza/download
> > > > >> >> > > /app/home/eventsvc/samza-git/hello-samza
> > > > >> >>
> > > > >> >> > > Cloning into 'samza'...
> > > > >> >>
> > > > >> >> > > fatal: unable to connect to git.apache.org:
> > > > >> >>
> > > > >> >> > > git.apache.org[0: 54.84.58.65]: errno=Connection timed
> > > > >> >> > > out
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Could you please help me to resolve this issue?
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> > > Regards,
> > > > >> >>
> > > > >> >> > > ~Sri
> > > > >> >>
> > > > >> >> > >
> > > > >> >>
> > > > >> >> >
> > > > >> >>
> > > > >> >
> > > > >> >
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Jagadish V,
> > > Graduate Student,
> > > Department of Computer Science,
> > > Stanford University
> > >
> >
> >
> >
> > --
> > Jagadish V,
> > Graduate Student,
> > Department of Computer Science,
> > Stanford University
> >
>
