Dell - Internal Use - Confidential
Here are the steps I take to reset and start anew: · First clean up my barclamps: o I have this scripts that looks up the proposal name and then deletes the active one and the inactive: § for i in quantum database rabbitmq keystone swift glance cinder nova nova_dashboard tempest; do crowbar $i proposal list|while read sedon; do crowbar $i delete $sedon|crowbar $i proposal delete $sedon;done;done · I then delete each node, · wait for delete to complete · reboot each node · allow them to be discovered · Assign "aliases" for each node based on what I want them to do · Allocate them with the right options for that role. · Wait for all nodes to be ready · Then create new proposals and allocate Randy From: crowbar-bounces On Behalf Of Oguz Yarimtepe Sent: Thursday, November 07, 2013 4:41 AM To: crowbar Subject: Re: [Crowbar] Name already exists error On Wed, Nov 6, 2013 at 11:32 PM, <randy_perry...@dell.com<mailto:randy_perry...@dell.com>> wrote: Dell - Internal Use - Confidential Remember if you delete the Proposal you loose all passwords used to create any configs, like mysql databases. You will need to delete those databases/users/etc... -Randy I deleted the proposal ./crowbar keystone -d proposal delete proposal ./crowbar rabbitmq -d proposal delete rabbitmq ./crowbar database -d proposal delete database Then i tried to create database again. ./crowbar database -d proposal create proposal DEBUG: (a) hostname: 127.0.0.1:3000<http://127.0.0.1:3000> DEBUG: (a) request: /crowbar/database/1.0/proposals DEBUG: (a) method: PUT DEBUG: (a) return code: 401 DEBUG: (a) return body: HTTP Digest: Access denied. DEBUG: (a) return headers: x-runtime: 1 cache-control: no-cache connection: keep-alive status: 401 Unauthorized date: Thu, 07 Nov 2013 09:28:08 GMT www-authenticate: Digest realm="Crowbar - By selecting OK are agreeing to the License Agreement", qop="auth", algorithm=MD5, nonce="MTM4MzgxNjQ4ODoyODQ0YzUxOGZlNWFjZTJjMzJmNDQ2M2JiNGU4NzFmYg==", opaque="4e0f8e810ac2b632e063305ef226e10e" content-type: text/html; charset=utf-8 content-length: 28 DEBUG: (put) hostname: 127.0.0.1:3000<http://127.0.0.1:3000> DEBUG: (put) request: /crowbar/database/1.0/proposals DEBUG: (put) data: {"id":"proposal"} DEBUG: (put) return code: 500 DEBUG: (put) return body: 500 "Internal Server Error" Failed to talk to service proposal create: 500: 500 "Internal Server Error" I also tried running chef-client [Thu, 07 Nov 2013 11:31:47 +0200] INFO: *** Chef 10.18.2 *** [Thu, 07 Nov 2013 11:31:47 +0200] INFO: [inet6] no default interface, picking the first ipaddress [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Run List is [role[crowbar], role[deployer-client], role[crowbar-admin_crowbar_org]] [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Run List expands to [utils, sudo, crowbar, barclamp, repos, crowbar-hacks, ohai, kernel-panic, bmc-nat::router, network::switch_config, network, network::fast_nics_tune, resolver, logging::client, ntp, rabbitmq::rabbit, rabbitmq::monitor, ganglia::client, nagios::client, nagios::monitor_hw_client, provisioner::base] [Thu, 07 Nov 2013 11:31:48 +0200] INFO: HTTP Request Returned 404 Not Found: No routes match the request: /reports/nodes/admin.crowbar.org/runs<http://admin.crowbar.org/runs> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Starting Chef Run for admin.crowbar.org<http://admin.crowbar.org> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Running start handlers [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Start handlers complete. [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Loading cookbooks [apache2, barclamp, bluepill, bmc-nat, crowbar, crowbar-hacks, ganglia, ipmi, kernel-panic, logging, nagios, network, ntp, ohai, openssl, provisioner, rabbitmq, rails, repos, resolver, ruby, sudo, utils] [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Setting attributes without specifying a precedence is deprecated and will be removed in Chef 11.0. To set attributes at normal precedence, change code like: `node["key"] = "value"` # Not this to: `node.set["key"] = "value"` # This Called from: /usr/lib/ruby/vendor_ruby/chef/node/attribute.rb:449:in `method_missing' /usr/lib/ruby/vendor_ruby/chef/node.rb:346:in `send' /usr/lib/ruby/vendor_ruby/chef/node.rb:346:in `method_missing' /usr/local/bin/bluepill [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Setting attributes without specifying a precedence is deprecated and will be removed in Chef 11.0. To set attributes at normal precedence, change code like: `node["key"] = "value"` # Not this to: `node.set["key"] = "value"` # This Called from: /var/cache/chef/cookbooks/bluepill/recipes/default.rb:51:in `from_file' /var/cache/chef/cookbooks/bluepill/recipes/default.rb:48:in `each' /var/cache/chef/cookbooks/bluepill/recipes/default.rb:48:in `from_file' [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Cloning resource attributes for gem_package[i18n] from prior resource (CHEF-3694) [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Previous gem_package[i18n]: /var/cache/chef/cookbooks/bluepill/recipes/default.rb:20:in `from_file' [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Current gem_package[i18n]: /var/cache/chef/cookbooks/crowbar/recipes/default.rb:51:in `from_file' [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Running on ubuntu-12.04 [Thu, 07 Nov 2013 11:31:48 +0200] INFO: ohai plugins will be at: /etc/chef/ohai_plugins [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing directory[/var/run/ohai] action create (ohai::default line 24) [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing directory[/etc/chef/ohai_plugins] action create (ohai::default line 33) [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing remote_directory[/etc/chef/ohai_plugins] action create (ohai::default line 42) [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing cookbook_file[/etc/chef/ohai_plugins/crowbar.rb] action create (dynamically defined) [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing cookbook_file[/etc/chef/ohai_plugins/README] action create (dynamically defined) [Thu, 07 Nov 2013 11:31:48 +0200] INFO: [inet6] no default interface, picking the first ipaddress [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Processing package[bridge-utils] action install (network::default line 21) [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Processing package[vlan] action install (network::default line 21) [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Returning new interface #<Nic:0x7fa0f1a88df8 @nic="eth0", @dependents=nil, @addresses=[#<IP::IP4: 10.102.236.65/24<http://10.102.236.65/24>>], @nicdir="/sys/class/net/eth0"> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Using base interfaces ["eth0"] for network admin [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Using interface eth0 for network admin [Thu, 07 Nov 2013 11:31:49 +0200] INFO: admin: Will use 10.102.236.1 as our default route [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Returning new interface #<Nic:0x7fa0f1a83628 @nic="eth1", @dependents=nil, @addresses=[#<IP::IP4: 10.102.235.79/24<http://10.102.235.79/24>>], @nicdir="/sys/class/net/eth1"> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Returning new interface #<Nic:0x7fa0f1a818a0 @nic="lo", @dependents=nil, @addresses=[#<IP::IP4: 127.0.0.1/8<http://127.0.0.1/8>>, #<IP::IP6: ::1/128>], @nicdir="/sys/class/net/lo"> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: eth0: current addresses: ["10.102.236.65/24<http://10.102.236.65/24>"] [Thu, 07 Nov 2013 11:31:49 +0200] INFO: eth0: required addresses: ["10.102.236.65/24<http://10.102.236.65/24>"] [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Waiting up to 60 seconds for the net to come back [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Saving interfaces to crowbar_wall: {"eth0"=>{"type"=>"physical", "gateway"=>"10.102.236.1", "addresses"=>["10.102.236.65/24<http://10.102.236.65/24>"]}} [Thu, 07 Nov 2013 11:31:49 +0200] INFO: HTTP Request Returned 500 Internal Server Error: Connection refused - connect(2) [Thu, 07 Nov 2013 11:31:49 +0200] ERROR: Server returned error for http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 1/5 in 3s [Thu, 07 Nov 2013 11:31:53 +0200] INFO: HTTP Request Returned 500 Internal Server Error: Connection refused - connect(2) [Thu, 07 Nov 2013 11:31:53 +0200] ERROR: Server returned error for http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 2/5 in 8s [Thu, 07 Nov 2013 11:32:01 +0200] INFO: HTTP Request Returned 500 Internal Server Error: Connection refused - connect(2) [Thu, 07 Nov 2013 11:32:01 +0200] ERROR: Server returned error for http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 3/5 in 12s [Thu, 07 Nov 2013 11:32:13 +0200] INFO: HTTP Request Returned 500 Internal Server Error: Connection refused - connect(2) [Thu, 07 Nov 2013 11:32:13 +0200] ERROR: Server returned error for http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 4/5 in 31s [Thu, 07 Nov 2013 11:32:45 +0200] INFO: HTTP Request Returned 500 Internal Server Error: Connection refused - connect(2) [Thu, 07 Nov 2013 11:32:45 +0200] ERROR: Server returned error for http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 5/5 in 61s [Thu, 07 Nov 2013 11:33:46 +0200] INFO: HTTP Request Returned 500 Internal Server Error: Connection refused - connect(2) ================================================================================ Recipe Compile Error in /var/cache/chef/cookbooks/network/recipes/default.rb ================================================================================ Net::HTTPFatalError ------------------- 500 "Internal Server Error" Cookbook Trace: --------------- /var/cache/chef/cookbooks/network/recipes/default.rb:329:in `from_file' Relevant File Content: ---------------------- /var/cache/chef/cookbooks/network/recipes/default.rb: 322: saved_ifs[k]["addresses"] = addrs 323: } 324: Chef::Log.info("Saving interfaces to crowbar_wall: #{saved_ifs.inspect}") 325: 326: node.set["crowbar_wall"]["network"]["interfaces"] = saved_ifs 327: node.set["crowbar_wall"]["network"]["nets"] = if_mapping 328: node.set["crowbar_wall"]["network"]["addrs"] = addr_mapping 329>> node.save 330: 331: # Flag to let us know that networking on this node 332: # is now managed by the netowrk barclamp. 333: FileUtils.mkdir_p("/var/cache/crowbar/network") 334: FileUtils.touch("/var/cache/crowbar/network/managed") 335: 336: case node["platform"] 337: when "debian","ubuntu" 338: template "/etc/network/interfaces" do [Thu, 07 Nov 2013 11:33:46 +0200] ERROR: Running exception handlers [Thu, 07 Nov 2013 11:33:46 +0200] FATAL: Saving node information to /var/cache/chef/failed-run-data.json [Thu, 07 Nov 2013 11:33:46 +0200] ERROR: Exception handlers complete [Thu, 07 Nov 2013 11:33:46 +0200] FATAL: Stacktrace dumped to /var/cache/chef/chef-stacktrace.out [Thu, 07 Nov 2013 11:33:46 +0200] FATAL: Net::HTTPFatalError: 500 "Internal Server Error" So when the chef-client runs, it adds a defult routing. This may be causing the to the connection error to admin.crowbar.org<http://admin.crowbar.org> # ping admin.crowbar.org<http://admin.crowbar.org> PING admin.crowbar.org<http://admin.crowbar.org> (10.102.235.79) 56(84) bytes of data. 64 bytes from admin.crowbar.org<http://admin.crowbar.org> (10.102.235.79): icmp_req=1 ttl=64 time=0.038 ms is the normal situation. I removed the routing info when chef-client runs, ip route del default via 10.102.236.1 dev eth0 But still it can not access to the address. There is already a running instance: # ps aux | grep chef-client root 1245 0.1 0.6 77568 24556 ? Sl 09:06 0:15 bluepilld: chef-client root 1251 0.1 1.2 143308 52304 ? S 09:06 0:11 ruby /usr/bin/chef-client -c /etc/chef/client.rb -i 900 -s 20 # ifconfig eth0 Link encap:Ethernet HWaddr 00:1e:4f:3d:16:6d inet addr:10.102.236.65 Bcast:10.102.236.255 Mask:255.255.255.0 inet6 addr: fe80::21e:4fff:fe3d:166d/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:5934 errors:0 dropped:0 overruns:0 frame:0 TX packets:4114 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:1800816 (1.8 MB) TX bytes:630132 (630.1 KB) eth1 Link encap:Ethernet HWaddr 00:1e:4f:3d:16:6f inet addr:10.102.235.79 Bcast:10.102.235.255 Mask:255.255.255.0 inet6 addr: fe80::21e:4fff:fe3d:166f/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:31026 errors:0 dropped:36 overruns:0 frame:0 TX packets:16465 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:3920565 (3.9 MB) TX bytes:7849104 (7.8 MB) Any idea?
_______________________________________________ Crowbar mailing list Crowbar@dell.com https://lists.us.dell.com/mailman/listinfo/crowbar For more information: http://crowbar.github.com/
