Hello,
I am working on a Samza script currently and had a couple questions. I am
able to work with the Hello-Samza application and have been able to add to
that example. The goal is to be able to write one from scratch and be able
to implement and iterate upon it indefinitely. The questions I have are the
following.
I understand the StreamTask handles the logic. I can create a StreamTask
that just consumers and produces raw data but where my problem comes in is
with the consumer. The Wikipedia example connects to an IRC in order to have
a stream of constant data. Instead of connecting to IRC in my consumer I am
aiming to connect to a zookeeper connection that listens to an input Kafka
topic. Is there an example somewhere to see how to implement this, or any
direction? I understand the flow, I believe, am just struggling with the
code implementation.
Second question is an error that I am having which may be solved by a
solution to the above inquiry. I am receiving an error saying "Failed to
update metadata after 98 ms." I've attached a txt document with a log of the
information if you can provide any assistance.
Apologies for the probably obvious questions but I am really wanting to
fully understand this whole system so I can manipulate it to my liking soon.
Thank you,
Chas Pezanko
java version "1.7.0_75"
OpenJDK Runtime Environment (rhel-2.5.4.0.el6_6-x86_64 u75-b13)
OpenJDK 64-Bit Server VM (build 24.75-b04, mixed mode)
/usr/lib/jvm/jre-1.7.0-openjdk.x86_64/bin/java
-Dlog4j.configuration=file:deploy/samza/bin/log4j-console.xml
-Dsamza.log.dir=/home/users/cpezako/hello-samza/samza-test/deploy/samza
-Djava.io.tmpdir=/home/users/cpezako/hello-samza/samza-test/deploy/samza/tmp
-Xmx768M -XX:+PrintGCDateStamps
-Xloggc:/home/users/cpezako/hello-samza/samza-test/deploy/samza/gc.log
-XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10241024
-d64 -cp
/home/users/cpezako/.samza/conf:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/activation-1.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/akka-actor_2.10-2.1.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/aopalliance-1.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/asm-3.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/avro-1.7.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-beanutils-1.7.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-beanutils-core-1.8.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-cli-1.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-codec-1.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-collections-3.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-compress-1.4.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-configuration-1.6.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-daemon-1.0.13.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-digester-1.8.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-el-1.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-httpclient-3.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-io-2.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-lang-2.6.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-logging-1.1.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-math3-3.1.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-net-3.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/config-1.0.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/grizzled-slf4j_2.10-1.0.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/guava-11.0.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/guice-3.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/guice-servlet-3.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-annotations-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-auth-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-common-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-hdfs-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-yarn-api-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-yarn-client-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-yarn-common-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hello-samza-0.10.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/httpclient-4.1.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/httpcore-4.1.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/irclib-1.10.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jackson-core-asl-1.8.5.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jackson-jaxrs-1.8.5.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jackson-mapper-asl-1.8.5.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jackson-xc-1.8.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jasper-compiler-5.5.23.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jasper-runtime-5.5.23.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/javax.inject-1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/java-xmlbuilder-0.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/javax.servlet-3.0.0.v201112011016.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jaxb-api-2.2.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jaxb-impl-2.2.3-1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jersey-client-1.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jersey-core-1.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jersey-guice-1.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jersey-json-1.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jersey-server-1.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jets3t-0.9.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jettison-1.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-6.1.26.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-continuation-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-http-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-io-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-security-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-server-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-servlet-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-util-6.1.26.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-util-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-webapp-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-xml-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jline-0.9.94.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/joda-convert-1.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/joda-time-2.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jopt-simple-3.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jsch-0.1.42.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jsp-api-2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jsr305-1.3.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/junit-3.8.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/juniversalchardet-1.0.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/kafka_2.10-0.8.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/kafka-clients-0.8.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/log4j-1.2.16.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/lz4-1.2.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/metrics-core-2.2.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/mime-util-2.1.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/netty-3.7.0.Final.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/paranamer-2.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/protobuf-java-2.5.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/rl_2.10-0.4.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/rocksdbjni-3.10.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-api-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-core_2.10-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-kafka_2.10-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-kv_2.10-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-kv-rocksdb_2.10-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-log4j-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-yarn_2.10-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scala-compiler-2.10.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scala-library-2.10.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scala-reflect-2.10.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scalate-core_2.10-1.6.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scalate-util_2.10-1.6.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scalatra_2.10-2.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scalatra-common_2.10-2.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scalatra-scalate_2.10-2.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/servlet-api-2.5.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/slf4j-api-1.6.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/slf4j-log4j12-1.6.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/snappy-java-1.1.1.6.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/stax-api-1.0-2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/xmlenc-0.52.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/xz-1.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/zkclient-0.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/zookeeper-3.3.4.jar
org.apache.samza.job.JobRunner
--config-factory=org.apache.samza.config.factories.PropertiesConfigFactory
--config-path=file:///home/users/cpezako/hello-samza/samza-test/deploy/samza/config/test-words.properties
2015-06-08 11:19:44 JobRunner [INFO] job factory:
org.apache.samza.job.yarn.YarnJobFactory
2015-06-08 11:19:44 JobConfig [INFO] No coordinator system defined, so
defaulting to kafka
2015-06-08 11:19:46 VerifiableProperties [INFO] Verifying properties
2015-06-08 11:19:46 VerifiableProperties [INFO] Property auto.offset.reset is
overridden to largest
2015-06-08 11:19:46 VerifiableProperties [INFO] Property client.id is
overridden to samza_admin-test_words-1-1433776784956-0
2015-06-08 11:19:46 VerifiableProperties [INFO] Property group.id is overridden
to undefined-samza-consumer-group-79faa87b-7e13-4ff1-9f3a-e88dd289ab34
2015-06-08 11:19:46 VerifiableProperties [INFO] Property zookeeper.connect is
overridden to localhost:2181/
2015-06-08 11:19:46 JobConfig [WARN] Configuration
'task.checkpoint.replication.factor' is deprecated. Please use
job.coordinator.replication.factor.
2015-06-08 11:19:46 VerifiableProperties [INFO] Verifying properties
2015-06-08 11:19:46 VerifiableProperties [INFO] Property auto.offset.reset is
overridden to largest
2015-06-08 11:19:46 VerifiableProperties [INFO] Property client.id is
overridden to samza_consumer-test_words-1-1433776786514-1
2015-06-08 11:19:46 VerifiableProperties [INFO] Property group.id is overridden
to undefined-samza-consumer-group-9554334f-898e-4e20-baa5-b0c3f33b2455
2015-06-08 11:19:46 VerifiableProperties [INFO] Property zookeeper.connect is
overridden to localhost:2181/
2015-06-08 11:19:47 JobConfig [INFO] No coordinator system defined, so
defaulting to kafka
2015-06-08 11:19:47 VerifiableProperties [INFO] Verifying properties
2015-06-08 11:19:47 VerifiableProperties [INFO] Property auto.offset.reset is
overridden to largest
2015-06-08 11:19:47 VerifiableProperties [INFO] Property client.id is
overridden to samza_admin-test_words-1-1433776787241-2
2015-06-08 11:19:47 VerifiableProperties [INFO] Property group.id is overridden
to undefined-samza-consumer-group-44b83287-581e-4923-8e8a-d4018fbfb49e
2015-06-08 11:19:47 VerifiableProperties [INFO] Property zookeeper.connect is
overridden to localhost:2181/
2015-06-08 11:19:47 JobConfig [WARN] Configuration
'task.checkpoint.replication.factor' is deprecated. Please use
job.coordinator.replication.factor.
2015-06-08 11:19:47 JobRunner [INFO] Creating coordinator stream
2015-06-08 11:19:47 JobConfig [INFO] No coordinator system defined, so
defaulting to kafka
2015-06-08 11:19:47 VerifiableProperties [INFO] Verifying properties
2015-06-08 11:19:47 VerifiableProperties [INFO] Property auto.offset.reset is
overridden to largest
2015-06-08 11:19:47 VerifiableProperties [INFO] Property client.id is
overridden to samza_admin-test_words-1-1433776787301-4
2015-06-08 11:19:47 VerifiableProperties [INFO] Property group.id is overridden
to undefined-samza-consumer-group-12baa2da-a69c-4bce-975c-99dedfcfcda3
2015-06-08 11:19:47 VerifiableProperties [INFO] Property zookeeper.connect is
overridden to localhost:2181/
2015-06-08 11:19:47 JobConfig [WARN] Configuration
'task.checkpoint.replication.factor' is deprecated. Please use
job.coordinator.replication.factor.
2015-06-08 11:19:47 KafkaSystemAdmin [INFO] Attempting to create coordinator
stream __samza_coordinator_test-words_1.
2015-06-08 11:19:47 ZkEventThread [INFO] Starting ZkClient event thread.
2015-06-08 11:19:47 ZooKeeper [INFO] Client
environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 GMT
2015-06-08 11:19:47 ZooKeeper [INFO] Client environment:host.name=messagebroker1
2015-06-08 11:19:47 ZooKeeper [INFO] Client environment:java.version=1.7.0_75
2015-06-08 11:19:47 ZooKeeper [INFO] Client environment:java.vendor=Oracle
Corporation
2015-06-08 11:19:47 ZooKeeper [INFO] Client
environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.75.x86_64/jre
2015-06-08 11:19:47 ZooKeeper [INFO] Client
environment:java.class.path=/home/users/cpezako/.samza/conf:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/activation-1.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/akka-actor_2.10-2.1.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/aopalliance-1.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/asm-3.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/avro-1.7.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-beanutils-1.7.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-beanutils-core-1.8.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-cli-1.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-codec-1.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-collections-3.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-compress-1.4.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-configuration-1.6.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-daemon-1.0.13.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-digester-1.8.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-el-1.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-httpclient-3.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-io-2.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-lang-2.6.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-logging-1.1.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-math3-3.1.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/commons-net-3.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/config-1.0.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/grizzled-slf4j_2.10-1.0.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/guava-11.0.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/guice-3.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/guice-servlet-3.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-annotations-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-auth-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-common-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-hdfs-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-yarn-api-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-yarn-client-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hadoop-yarn-common-2.4.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/hello-samza-0.10.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/httpclient-4.1.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/httpcore-4.1.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/irclib-1.10.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jackson-core-asl-1.8.5.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jackson-jaxrs-1.8.5.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jackson-mapper-asl-1.8.5.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jackson-xc-1.8.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jasper-compiler-5.5.23.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jasper-runtime-5.5.23.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/javax.inject-1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/java-xmlbuilder-0.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/javax.servlet-3.0.0.v201112011016.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jaxb-api-2.2.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jaxb-impl-2.2.3-1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jersey-client-1.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jersey-core-1.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jersey-guice-1.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jersey-json-1.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jersey-server-1.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jets3t-0.9.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jettison-1.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-6.1.26.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-continuation-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-http-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-io-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-security-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-server-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-servlet-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-util-6.1.26.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-util-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-webapp-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jetty-xml-8.1.8.v20121106.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jline-0.9.94.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/joda-convert-1.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/joda-time-2.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jopt-simple-3.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jsch-0.1.42.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jsp-api-2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/jsr305-1.3.9.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/junit-3.8.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/juniversalchardet-1.0.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/kafka_2.10-0.8.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/kafka-clients-0.8.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/log4j-1.2.16.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/lz4-1.2.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/metrics-core-2.2.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/mime-util-2.1.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/netty-3.7.0.Final.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/paranamer-2.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/protobuf-java-2.5.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/rl_2.10-0.4.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/rocksdbjni-3.10.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-api-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-core_2.10-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-kafka_2.10-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-kv_2.10-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-kv-rocksdb_2.10-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-log4j-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/samza-yarn_2.10-0.10.0-SNAPSHOT.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scala-compiler-2.10.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scala-library-2.10.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scala-reflect-2.10.4.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scalate-core_2.10-1.6.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scalate-util_2.10-1.6.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scalatra_2.10-2.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scalatra-common_2.10-2.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/scalatra-scalate_2.10-2.2.1.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/servlet-api-2.5.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/slf4j-api-1.6.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/slf4j-log4j12-1.6.2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/snappy-java-1.1.1.6.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/stax-api-1.0-2.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/xmlenc-0.52.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/xz-1.0.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/zkclient-0.3.jar:/home/users/cpezako/hello-samza/samza-test/deploy/samza/lib/zookeeper-3.3.4.jar
2015-06-08 11:19:47 ZooKeeper [INFO] Client
environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2015-06-08 11:19:47 ZooKeeper [INFO] Client
environment:java.io.tmpdir=/home/users/cpezako/hello-samza/samza-test/deploy/samza/tmp
2015-06-08 11:19:47 ZooKeeper [INFO] Client environment:java.compiler=<NA>
2015-06-08 11:19:47 ZooKeeper [INFO] Client environment:os.name=Linux
2015-06-08 11:19:47 ZooKeeper [INFO] Client environment:os.arch=amd64
2015-06-08 11:19:47 ZooKeeper [INFO] Client
environment:os.version=2.6.32-504.3.3.el6.x86_64
2015-06-08 11:19:47 ZooKeeper [INFO] Client environment:user.name=cpezako
2015-06-08 11:19:47 ZooKeeper [INFO] Client
environment:user.home=/home/users/cpezako
2015-06-08 11:19:47 ZooKeeper [INFO] Client
environment:user.dir=/home/users/cpezako/hello-samza/samza-test
2015-06-08 11:19:47 ZooKeeper [INFO] Initiating client connection,
connectString=localhost:2181/ sessionTimeout=6000
watcher=org.I0Itec.zkclient.ZkClient@989f8c6
2015-06-08 11:19:47 ClientCnxn [INFO] Opening socket connection to server
localhost/0:0:0:0:0:0:0:1:2181
2015-06-08 11:19:47 ClientCnxn [INFO] Socket connection established to
localhost/0:0:0:0:0:0:0:1:2181, initiating session
2015-06-08 11:19:48 ClientCnxn [INFO] Session establishment complete on server
localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x14d6857243e0332, negotiated
timeout = 6000
2015-06-08 11:19:48 ZkClient [INFO] zookeeper state changed (SyncConnected)
2015-06-08 11:19:48 ZkEventThread [INFO] Terminate ZkClient event thread.
2015-06-08 11:19:48 ClientCnxn [INFO] EventThread shut down
2015-06-08 11:19:48 ZooKeeper [INFO] Session: 0x14d6857243e0332 closed
2015-06-08 11:19:48 KafkaSystemAdmin [INFO] Coordinator stream
__samza_coordinator_test-words_1 already exists.
2015-06-08 11:19:48 JobRunner [INFO] Storing config in coordinator stream.
2015-06-08 11:19:48 CoordinatorStreamSystemProducer [INFO] Starting coordinator
stream producer.
2015-06-08 11:19:48 KafkaSystemProducer [INFO] Creating a new producer for
system kafka.
2015-06-08 11:19:49 ProducerConfig [INFO] ProducerConfig values:
value.serializer = class
org.apache.kafka.common.serialization.ByteArraySerializer
key.serializer = class
org.apache.kafka.common.serialization.ByteArraySerializer
block.on.buffer.full = true
retry.backoff.ms = 100
buffer.memory = 33554432
batch.size = 16384
metrics.sample.window.ms = 30000
metadata.max.age.ms = 300000
receive.buffer.bytes = 32768
timeout.ms = 30000
max.in.flight.requests.per.connection = 1
bootstrap.servers = [localhost:9092]
metric.reporters = []
client.id = samza_producer-test_words-1-1433776787251-3
compression.type = none
retries = 2147483647
max.request.size = 1048576
send.buffer.bytes = 131072
acks = 1
reconnect.backoff.ms = 10
linger.ms = 0
metrics.num.samples = 2
metadata.fetch.timeout.ms = 60000
Exception in thread "main" org.apache.samza.SamzaException:
org.apache.kafka.common.errors.TimeoutException: Failed to update metadata
after 98 ms.
at
org.apache.samza.coordinator.stream.CoordinatorStreamSystemProducer.send(CoordinatorStreamSystemProducer.java:112)
at
org.apache.samza.coordinator.stream.CoordinatorStreamSystemProducer.writeConfig(CoordinatorStreamSystemProducer.java:129)
at org.apache.samza.job.JobRunner.run(JobRunner.scala:79)
at org.apache.samza.job.JobRunner$.main(JobRunner.scala:48)
at org.apache.samza.job.JobRunner.main(JobRunner.scala)
Caused by: org.apache.kafka.common.errors.TimeoutException: Failed to update
metadata after 98 ms.
