Are you out of memory? 6GB minimum for admin server.
On Thu, Nov 7, 2013 at 4:40 AM, Oğuz Yarımtepe <oguzyarimt...@gmail.com>wrote: > > > > On Wed, Nov 6, 2013 at 11:32 PM, <randy_perry...@dell.com> wrote: > >> *Dell - Internal Use - Confidential * >> >> Remember if you delete the Proposal you loose all passwords used to >> create any configs, like mysql databases. You will need to delete those >> databases/users/etc… >> >> >> >> -Randy >> > > I deleted the proposal > > ./crowbar keystone -d proposal delete proposal > ./crowbar rabbitmq -d proposal delete rabbitmq > ./crowbar database -d proposal delete database > > Then i tried to create database again. > > ./crowbar database -d proposal create proposal > > DEBUG: (a) hostname: 127.0.0.1:3000 > DEBUG: (a) request: /crowbar/database/1.0/proposals > DEBUG: (a) method: PUT > DEBUG: (a) return code: 401 > DEBUG: (a) return body: HTTP Digest: Access denied. > DEBUG: (a) return headers: > x-runtime: 1 > cache-control: no-cache > connection: keep-alive > status: 401 Unauthorized > date: Thu, 07 Nov 2013 09:28:08 GMT > www-authenticate: Digest realm="Crowbar - By selecting OK are agreeing to > the License Agreement", qop="auth", algorithm=MD5, > nonce="MTM4MzgxNjQ4ODoyODQ0YzUxOGZlNWFjZTJjMzJmNDQ2M2JiNGU4NzFmYg==", > opaque="4e0f8e810ac2b632e063305ef226e10e" > content-type: text/html; charset=utf-8 > content-length: 28 > DEBUG: (put) hostname: 127.0.0.1:3000 > DEBUG: (put) request: /crowbar/database/1.0/proposals > DEBUG: (put) data: {"id":"proposal"} > DEBUG: (put) return code: 500 > DEBUG: (put) return body: 500 "Internal Server Error" > Failed to talk to service proposal create: 500: 500 "Internal Server Error" > > > I also tried running chef-client > > [Thu, 07 Nov 2013 11:31:47 +0200] INFO: *** Chef 10.18.2 *** > [Thu, 07 Nov 2013 11:31:47 +0200] INFO: [inet6] no default interface, > picking the first ipaddress > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Run List is [role[crowbar], > role[deployer-client], role[crowbar-admin_crowbar_org]] > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Run List expands to [utils, sudo, > crowbar, barclamp, repos, crowbar-hacks, ohai, kernel-panic, > bmc-nat::router, network::switch_config, network, network::fast_nics_tune, > resolver, logging::client, ntp, rabbitmq::rabbit, rabbitmq::monitor, > ganglia::client, nagios::client, nagios::monitor_hw_client, > provisioner::base] > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: HTTP Request Returned 404 Not > Found: No routes match the request: /reports/nodes/admin.crowbar.org/runs > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Starting Chef Run for > admin.crowbar.org > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Running start handlers > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Start handlers complete. > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Loading cookbooks [apache2, > barclamp, bluepill, bmc-nat, crowbar, crowbar-hacks, ganglia, ipmi, > kernel-panic, logging, nagios, network, ntp, ohai, openssl, provisioner, > rabbitmq, rails, repos, resolver, ruby, sudo, utils] > [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Setting attributes without > specifying a precedence is deprecated and will be > removed in Chef 11.0. To set attributes at normal precedence, change code > like: > `node["key"] = "value"` # Not this > to: > `node.set["key"] = "value"` # This > > Called from: > /usr/lib/ruby/vendor_ruby/chef/node/attribute.rb:449:in `method_missing' > /usr/lib/ruby/vendor_ruby/chef/node.rb:346:in `send' > /usr/lib/ruby/vendor_ruby/chef/node.rb:346:in `method_missing' > > /usr/local/bin/bluepill > [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Setting attributes without > specifying a precedence is deprecated and will be > removed in Chef 11.0. To set attributes at normal precedence, change code > like: > `node["key"] = "value"` # Not this > to: > `node.set["key"] = "value"` # This > > Called from: > /var/cache/chef/cookbooks/bluepill/recipes/default.rb:51:in `from_file' > /var/cache/chef/cookbooks/bluepill/recipes/default.rb:48:in `each' > /var/cache/chef/cookbooks/bluepill/recipes/default.rb:48:in `from_file' > > [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Cloning resource attributes for > gem_package[i18n] from prior resource (CHEF-3694) > [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Previous gem_package[i18n]: > /var/cache/chef/cookbooks/bluepill/recipes/default.rb:20:in `from_file' > [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Current gem_package[i18n]: > /var/cache/chef/cookbooks/crowbar/recipes/default.rb:51:in `from_file' > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Running on ubuntu-12.04 > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: ohai plugins will be at: > /etc/chef/ohai_plugins > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing > directory[/var/run/ohai] action create (ohai::default line 24) > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing > directory[/etc/chef/ohai_plugins] action create (ohai::default line 33) > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing > remote_directory[/etc/chef/ohai_plugins] action create (ohai::default line > 42) > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing > cookbook_file[/etc/chef/ohai_plugins/crowbar.rb] action create (dynamically > defined) > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing > cookbook_file[/etc/chef/ohai_plugins/README] action create (dynamically > defined) > [Thu, 07 Nov 2013 11:31:48 +0200] INFO: [inet6] no default interface, > picking the first ipaddress > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Processing package[bridge-utils] > action install (network::default line 21) > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Processing package[vlan] action > install (network::default line 21) > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Returning new interface > #<Nic:0x7fa0f1a88df8 @nic="eth0", @dependents=nil, @addresses=[#<IP::IP4: > 10.102.236.65/24>], @nicdir="/sys/class/net/eth0"> > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Using base interfaces ["eth0"] for > network admin > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Using interface eth0 for network > admin > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: admin: Will use 10.102.236.1 as > our default route > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Returning new interface > #<Nic:0x7fa0f1a83628 @nic="eth1", @dependents=nil, @addresses=[#<IP::IP4: > 10.102.235.79/24>], @nicdir="/sys/class/net/eth1"> > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Returning new interface > #<Nic:0x7fa0f1a818a0 @nic="lo", @dependents=nil, @addresses=[#<IP::IP4: > 127.0.0.1/8>, #<IP::IP6: ::1/128>], @nicdir="/sys/class/net/lo"> > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: eth0: current addresses: [" > 10.102.236.65/24"] > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: eth0: required addresses: [" > 10.102.236.65/24"] > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Waiting up to 60 seconds for the > net to come back > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Saving interfaces to crowbar_wall: > {"eth0"=>{"type"=>"physical", "gateway"=>"10.102.236.1", "addresses"=>[" > 10.102.236.65/24"]}} > [Thu, 07 Nov 2013 11:31:49 +0200] INFO: HTTP Request Returned 500 Internal > Server Error: Connection refused - connect(2) > [Thu, 07 Nov 2013 11:31:49 +0200] ERROR: Server returned error for > http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 1/5 in 3s > [Thu, 07 Nov 2013 11:31:53 +0200] INFO: HTTP Request Returned 500 Internal > Server Error: Connection refused - connect(2) > [Thu, 07 Nov 2013 11:31:53 +0200] ERROR: Server returned error for > http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 2/5 in 8s > [Thu, 07 Nov 2013 11:32:01 +0200] INFO: HTTP Request Returned 500 Internal > Server Error: Connection refused - connect(2) > [Thu, 07 Nov 2013 11:32:01 +0200] ERROR: Server returned error for > http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 3/5 in 12s > [Thu, 07 Nov 2013 11:32:13 +0200] INFO: HTTP Request Returned 500 Internal > Server Error: Connection refused - connect(2) > [Thu, 07 Nov 2013 11:32:13 +0200] ERROR: Server returned error for > http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 4/5 in 31s > [Thu, 07 Nov 2013 11:32:45 +0200] INFO: HTTP Request Returned 500 Internal > Server Error: Connection refused - connect(2) > [Thu, 07 Nov 2013 11:32:45 +0200] ERROR: Server returned error for > http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 5/5 in 61s > [Thu, 07 Nov 2013 11:33:46 +0200] INFO: HTTP Request Returned 500 Internal > Server Error: Connection refused - connect(2) > > > ================================================================================ > Recipe Compile Error in > /var/cache/chef/cookbooks/network/recipes/default.rb > > ================================================================================ > > Net::HTTPFatalError > ------------------- > 500 "Internal Server Error" > > Cookbook Trace: > --------------- > /var/cache/chef/cookbooks/network/recipes/default.rb:329:in `from_file' > > Relevant File Content: > ---------------------- > /var/cache/chef/cookbooks/network/recipes/default.rb: > > 322: saved_ifs[k]["addresses"] = addrs > 323: } > 324: Chef::Log.info("Saving interfaces to crowbar_wall: > #{saved_ifs.inspect}") > 325: > 326: node.set["crowbar_wall"]["network"]["interfaces"] = saved_ifs > 327: node.set["crowbar_wall"]["network"]["nets"] = if_mapping > 328: node.set["crowbar_wall"]["network"]["addrs"] = addr_mapping > 329>> node.save > 330: > 331: # Flag to let us know that networking on this node > 332: # is now managed by the netowrk barclamp. > 333: FileUtils.mkdir_p("/var/cache/crowbar/network") > 334: FileUtils.touch("/var/cache/crowbar/network/managed") > 335: > 336: case node["platform"] > 337: when "debian","ubuntu" > 338: template "/etc/network/interfaces" do > > [Thu, 07 Nov 2013 11:33:46 +0200] ERROR: Running exception handlers > [Thu, 07 Nov 2013 11:33:46 +0200] FATAL: Saving node information to > /var/cache/chef/failed-run-data.json > [Thu, 07 Nov 2013 11:33:46 +0200] ERROR: Exception handlers complete > [Thu, 07 Nov 2013 11:33:46 +0200] FATAL: Stacktrace dumped to > /var/cache/chef/chef-stacktrace.out > [Thu, 07 Nov 2013 11:33:46 +0200] FATAL: Net::HTTPFatalError: 500 > "Internal Server Error" > > > > So when the chef-client runs, it adds a defult routing. This may be > causing the to the connection error to admin.crowbar.org > > # ping admin.crowbar.org > PING admin.crowbar.org (10.102.235.79) 56(84) bytes of data. > 64 bytes from admin.crowbar.org (10.102.235.79): icmp_req=1 ttl=64 > time=0.038 ms > > is the normal situation. > > I removed the routing info when chef-client runs, > > ip route del default via 10.102.236.1 dev eth0 > > But still it can not access to the address. > > There is already a running instance: > > # ps aux | grep chef-client > root 1245 0.1 0.6 77568 24556 ? Sl 09:06 0:15 > bluepilld: > chef-client > > root 1251 0.1 1.2 143308 52304 ? S 09:06 0:11 ruby > /usr/bin/chef-client -c /etc/chef/client.rb -i 900 -s 20 > > > # ifconfig > eth0 Link encap:Ethernet HWaddr 00:1e:4f:3d:16:6d > inet addr:10.102.236.65 Bcast:10.102.236.255 Mask:255.255.255.0 > inet6 addr: fe80::21e:4fff:fe3d:166d/64 Scope:Link > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 > RX packets:5934 errors:0 dropped:0 overruns:0 frame:0 > TX packets:4114 errors:0 dropped:0 overruns:0 carrier:0 > collisions:0 txqueuelen:1000 > RX bytes:1800816 (1.8 MB) TX bytes:630132 (630.1 KB) > > eth1 Link encap:Ethernet HWaddr 00:1e:4f:3d:16:6f > inet addr:10.102.235.79 Bcast:10.102.235.255 Mask:255.255.255.0 > inet6 addr: fe80::21e:4fff:fe3d:166f/64 Scope:Link > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 > RX packets:31026 errors:0 dropped:36 overruns:0 frame:0 > TX packets:16465 errors:0 dropped:0 overruns:0 carrier:0 > collisions:0 txqueuelen:1000 > RX bytes:3920565 (3.9 MB) TX bytes:7849104 (7.8 MB) > > > Any idea? > > _______________________________________________ > Crowbar mailing list > Crowbar@dell.com > https://lists.us.dell.com/mailman/listinfo/crowbar > For more information: http://crowbar.github.com/ > -- Judd Maltin T: 917-882-1270 F: 501-694-7809 what could possibly go wrong?
_______________________________________________ Crowbar mailing list Crowbar@dell.com https://lists.us.dell.com/mailman/listinfo/crowbar For more information: http://crowbar.github.com/