Hi, I checked the logs where it was mentioned
"Worker c7c36c15-17d6-49d3-9cfb-6b00543bc117 for storm kafka-storm-Phoenix-ClusterD-1-1421763749 on d1fbe85d-6d15-47c9-9c69-5cc738ca1937:6700 has finished loading 2015-01-20T19:52:36.234+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [6] 2015-01-20T19:52:36.431+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [7] 2015-01-20T19:52:36.743+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [8] 2015-01-20T19:52:37.101+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [9] 2015-01-20T19:52:37.462+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [10] 2015-01-20T19:52:37.824+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [11] 2015-01-20T19:52:38.189+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [12] 2015-01-20T19:52:38.555+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [13] 2015-01-20T19:52:38.925+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [14] 2015-01-20T19:52:39.295+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [15] 2015-01-20T19:52:39.668+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [16] 2015-01-20T19:52:40.043+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [17] 2015-01-20T19:52:40.420+0530 b.s.m.n.Client [INFO] Reconnect started for Netty-Client-dwh3/192.168.6.88:6701... [18]" the reconnect message in log is constant. I asssumed that the worker is not running as expected. Any thoughts? Thanks, Siddharth On Wed, Jan 21, 2015 at 9:55 AM, Kosala Dissanayake <[email protected]> wrote: > Hi Siddharth, > > How did you come to the conclusion that the supervisors and workers have > not started? Did you open the ports 6700-6703 on the supervisor machines? > > Cheers, > Kosala > > > > On Wed, Jan 21, 2015 at 1:25 AM, siddharth ubale < > [email protected]> wrote: > >> Hi, >> >> I am runnning a Kafka-storm topology . >> >> The topology works exactly as expected in LocalCluster mode. However in >> Distributed mode the Workers are not starting , supervisor has not started. >> Only nimbus starts >> >> I am trying to run the topology via eclipse. >> >> //Providing the details for zkHosts >> BrokerHosts hosts = new ZkHosts("hbase:2181","/brokers"); >> SpoutConfig spoutconf = new >> SpoutConfig(hosts,TOPIC_NAME,"/test101","sid"); >> spoutconf.scheme = new SchemeAsMultiScheme(new StringScheme()); >> spoutconf.forceFromStart = true; >> KafkaSpout Kspout = new KafkaSpout(spoutconf); >> builder.setSpout("spout", Kspout, 1); >> >> PhoenixBolt phoenixBolt = new PhoenixBolt("Phoenix-Bolt", true,true,new >> Fields("json")); >> builder.setBolt("Phoenix-Bolt", phoenixBolt, 1).shuffleGrouping("spout"); >> >> Config config = new Config(); >> >> config.put(Config.NIMBUS_THRIFT_PORT,6627); >> config.put(Config.STORM_ZOOKEEPER_PORT,2181); >> config.put(Config.STORM_ZOOKEEPER_SERVERS,Arrays.asList(new >> String[]{"hbase"})); >> config.put(Config.NIMBUS_HOST, "dwh3"); >> config.put("storm.zookeeper.root","/storm1"); >> config.put(Config.STORM_ZOOKEEPER_ROOT, "/storm1"); >> >> System.setProperty("storm.jar","/usr/local/apache-storm-0.9.3/bin/storm"); >> config.setDebug(true); >> config.setNumWorkers(5); >> config.put(Config.TOPOLOGY_DEBUG, true); >> System.out.println(config.toString()); >> >> //cluster.submitTopology("kafka-storm-Phoenix", config, >> //builder.createTopology()); >> StormSubmitter.submitTopology("kafka-storm-Phoenix-ClusterD", config, >> builder.createTopology()); >> >> >> worker logs are saying " Netty reconnect for hostname:6703" is issued >> again and again. >> >> >> Thanks, >> Siddharth >> >> >> >
