Hi Bryan, Can we talk about this during the second part of the Weekly meeting tomorrow?
Aaron On Sun, Nov 12, 2017 at 9:41 PM, SULLIVAN, BRYAN L (BRYAN L) < bryan.sulli...@research.att.com> wrote: > Hi Barometer team, > > > > I’d like to have a call asap this week, or an IRC chat, to discuss the > issues I’ve found in scripting the VES install, and other questions on how > this is intended to (or can) work. > > > > My WIP patch for VES is at https://gerrit.opnfv.org/gerrit/#/c/47101/. > Once this is working, you can refer to it in the guide as an example of how > to automate the process. This will be much less painful than following the > manual step-by-step process (which anyway will be documented in the > script), and will be used in CI for VES. > > > > Thanks, > > Bryan Sullivan | AT&T > > > > *From:* SULLIVAN, BRYAN L (BRYAN L) > *Sent:* Sunday, November 12, 2017 9:45 AM > *To:* 'opnfv-tech-discuss@lists.opnfv.org' <opnfv-tech-discuss@lists. > opnfv.org> > *Subject:* RE: [barometer] Issues in VES Guide > > > > Hi Barometer team, > > > > Getting beyond the issues noted below (which still need to be addressed in > the user guide): > > - Setting the hostname in /etc/hosts prevented the kafka server from > exiting > > > > Here are a couple of other issues that need to be addressed as well: > > - The “producer – consumer” test shown only works when you are > installing interactively, as the “consumer” part does not automatically > return control back to the shell or script. So when scripting this either > we have to just assume that the kafka server is running properly, or we > need a method of testing it that works in a script. > - At “Install development tools:” the guide only references how to do > this for Centos. It should also clarify for Ubuntu (there is no “group” > operation in apt-get). > > > > Thanks, > > Bryan Sullivan | AT&T > > > > *From:* SULLIVAN, BRYAN L (BRYAN L) > *Sent:* Friday, November 10, 2017 10:40 AM > *To:* 'opnfv-tech-discuss@lists.opnfv.org' <opnfv-tech-discuss@lists. > opnfv.org> > *Subject:* [barometer] Issues in VES Guide > > > > Hi Barometer team, > > > > Any help below is appreciated. I am scripting the setup for the new > version of the VES plugin per http://docs.opnfv.org/en/ > latest/submodules/barometer/docs/release/userguide/ > collectd.ves.userguide.html > > > > I have found a couple of issues as below. Here are the steps I am using > per the guide (note the additional step needed below, in bold): > > *# TODO: Guide should reference use of “apt-get” vs “apt”, per Ubuntu > advice on which works better in scripts* > > sudo apt-get install -y default-jre > > sudo apt-get install -y zookeeperd > > sudo apt-get install -y python-pip > > sudo pip install kafka-python > > wget "http://www-eu.apache.org/dist/kafka/0.11.0.0/kafka_2.11-0.11.0.0.tgz > " > > tar -xvzf kafka_2.11-0.11.0.0.tgz > > sed -i -- 's/#delete.topic.enable=true/delete.topic.enable=true/' > kafka_2.11-0.11.0.0/config/server.properties > > sudo nohup kafka_2.11-0.11.0.0/bin/kafka-server-start.sh \ > > kafka_2.11-0.11.0.0/config/server.properties > > kafka_2.11-0.11.0.0/kafka.log 2>&1 & > > *# TODO: missing step in guide: hostname must be in /etc/hosts* > > *echo "$(ip route get 8.8.8.8 | awk '{print $NF; exit}') $HOSTNAME" | sudo > tee -a /etc/hosts* > > sudo nohup kafka_2.11-0.11.0.0/bin/kafka-server-start.sh \ > > kafka_2.11-0.11.0.0/config/server.properties > > kafka_2.11-0.11.0.0/kafka.log 2>&1 & > > kafka_2.11-0.11.0.0/bin/kafka-console-consumer.sh --zookeeper > localhost:2181 --topic TopicTest --from-beginning > > > > When I run the server, it exits. I saw the note about the exit when I ran > the “Producer” test per the guide, which complained that there was no > Broker available (I guess due to the exit). After that I ran the “Consumer” > test (I did not see the note about the server exit yet), which has hanged, > and I can’t quit that command. Any ideas for: > > - what I do now, to get my terminal prompt back (other than wipe the > server and start again) > - what may have caused the server to exit > > > > ubuntu@opnfv01:~$ sudo nohup kafka_2.11-0.11.0.0/bin/kafka-server-start.sh > \ > > > kafka_2.11-0.11.0.0/config/server.properties > > kafka_2.11-0.11.0.0/kafka.log 2>&1 & > > [1] 6797 > > ubuntu@opnfv01:~$ > > ubuntu@opnfv01:~$ echo "Hello, World" | > kafka_2.11-0.11.0.0/bin/kafka-console-producer.sh > \ > > [1]+ Exit 1 sudo nohup > kafka_2.11-0.11.0.0/bin/kafka-server-start.sh > kafka_2.11-0.11.0.0/config/server.properties > > kafka_2.11-0.11.0.0/kafka.log 2>&1 > > > --broker-list localhost:9092 --topic TopicTest > /dev/null > > [2017-11-10 18:22:18,189] WARN Connection to node -1 could not be > established. Broker may not be available. (org.apache.kafka.clients. > NetworkClient) > > [2017-11-10 18:22:18,241] WARN Connection to node -1 could not be > established. Broker may not be available. (org.apache.kafka.clients. > NetworkClient) > > ... > > > > ubuntu@opnfv01:~$ kafka_2.11-0.11.0.0/bin/kafka-console-consumer.sh > --zookeeper localhost:2181 --topic TopicTest --from-beginning > > Using the ConsoleConsumer with old consumer is deprecated and will be > removed in a future major release. Consider using the new consumer by > passing [bootstrap-server] instead of [zookeeper]. > > [2017-11-10 18:25:34,303] WARN [console-consumer-18617_ > opnfv01-1510338334002-e1877230], no brokers found when trying to > rebalance. (kafka.consumer.ZookeeperConsumerConnector) > > ^C > > > > ^C^C^C^C^C^C^C^C^C > > > > > > Thanks, > > Bryan Sullivan | AT&T > > > > _______________________________________________ > opnfv-tech-discuss mailing list > opnfv-tech-discuss@lists.opnfv.org > https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss > > -- AARON SMITH SENIOR PRINCIPAL SOFTWARE ENGINEER, NFVPE Red Hat <https://www.redhat.com/> 314 Littleton Rd, Westford, MA 01886 aasm...@redhat.com M: 617.877.4814 <https://red.ht/sig>
_______________________________________________ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
