Are you out of memory? 6GB minimum for admin server.
On Thu, Nov 7, 2013 at 4:40 AM, Oğuz Yarımtepe <oguzyarimt...@gmail.com>wrote:
>
>
>
> On Wed, Nov 6, 2013 at 11:32 PM, <randy_perry...@dell.com> wrote:
>
>> *Dell - Internal Use - Confidential *
>>
>> Remember if you delete the Proposal you loose all passwords used to
>> create any configs, like mysql databases. You will need to delete those
>> databases/users/etc…
>>
>>
>>
>> -Randy
>>
>
> I deleted the proposal
>
> ./crowbar keystone -d proposal delete proposal
> ./crowbar rabbitmq -d proposal delete rabbitmq
> ./crowbar database -d proposal delete database
>
> Then i tried to create database again.
>
> ./crowbar database -d proposal create proposal
>
> DEBUG: (a) hostname: 127.0.0.1:3000
> DEBUG: (a) request: /crowbar/database/1.0/proposals
> DEBUG: (a) method: PUT
> DEBUG: (a) return code: 401
> DEBUG: (a) return body: HTTP Digest: Access denied.
> DEBUG: (a) return headers:
> x-runtime: 1
> cache-control: no-cache
> connection: keep-alive
> status: 401 Unauthorized
> date: Thu, 07 Nov 2013 09:28:08 GMT
> www-authenticate: Digest realm="Crowbar - By selecting OK are agreeing to
> the License Agreement", qop="auth", algorithm=MD5,
> nonce="MTM4MzgxNjQ4ODoyODQ0YzUxOGZlNWFjZTJjMzJmNDQ2M2JiNGU4NzFmYg==",
> opaque="4e0f8e810ac2b632e063305ef226e10e"
> content-type: text/html; charset=utf-8
> content-length: 28
> DEBUG: (put) hostname: 127.0.0.1:3000
> DEBUG: (put) request: /crowbar/database/1.0/proposals
> DEBUG: (put) data: {"id":"proposal"}
> DEBUG: (put) return code: 500
> DEBUG: (put) return body: 500 "Internal Server Error"
> Failed to talk to service proposal create: 500: 500 "Internal Server Error"
>
>
> I also tried running chef-client
>
> [Thu, 07 Nov 2013 11:31:47 +0200] INFO: *** Chef 10.18.2 ***
> [Thu, 07 Nov 2013 11:31:47 +0200] INFO: [inet6] no default interface,
> picking the first ipaddress
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Run List is [role[crowbar],
> role[deployer-client], role[crowbar-admin_crowbar_org]]
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Run List expands to [utils, sudo,
> crowbar, barclamp, repos, crowbar-hacks, ohai, kernel-panic,
> bmc-nat::router, network::switch_config, network, network::fast_nics_tune,
> resolver, logging::client, ntp, rabbitmq::rabbit, rabbitmq::monitor,
> ganglia::client, nagios::client, nagios::monitor_hw_client,
> provisioner::base]
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: HTTP Request Returned 404 Not
> Found: No routes match the request: /reports/nodes/admin.crowbar.org/runs
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Starting Chef Run for
> admin.crowbar.org
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Running start handlers
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Start handlers complete.
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Loading cookbooks [apache2,
> barclamp, bluepill, bmc-nat, crowbar, crowbar-hacks, ganglia, ipmi,
> kernel-panic, logging, nagios, network, ntp, ohai, openssl, provisioner,
> rabbitmq, rails, repos, resolver, ruby, sudo, utils]
> [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Setting attributes without
> specifying a precedence is deprecated and will be
> removed in Chef 11.0. To set attributes at normal precedence, change code
> like:
> `node["key"] = "value"` # Not this
> to:
> `node.set["key"] = "value"` # This
>
> Called from:
> /usr/lib/ruby/vendor_ruby/chef/node/attribute.rb:449:in `method_missing'
> /usr/lib/ruby/vendor_ruby/chef/node.rb:346:in `send'
> /usr/lib/ruby/vendor_ruby/chef/node.rb:346:in `method_missing'
>
> /usr/local/bin/bluepill
> [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Setting attributes without
> specifying a precedence is deprecated and will be
> removed in Chef 11.0. To set attributes at normal precedence, change code
> like:
> `node["key"] = "value"` # Not this
> to:
> `node.set["key"] = "value"` # This
>
> Called from:
> /var/cache/chef/cookbooks/bluepill/recipes/default.rb:51:in `from_file'
> /var/cache/chef/cookbooks/bluepill/recipes/default.rb:48:in `each'
> /var/cache/chef/cookbooks/bluepill/recipes/default.rb:48:in `from_file'
>
> [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Cloning resource attributes for
> gem_package[i18n] from prior resource (CHEF-3694)
> [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Previous gem_package[i18n]:
> /var/cache/chef/cookbooks/bluepill/recipes/default.rb:20:in `from_file'
> [Thu, 07 Nov 2013 11:31:48 +0200] WARN: Current gem_package[i18n]:
> /var/cache/chef/cookbooks/crowbar/recipes/default.rb:51:in `from_file'
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Running on ubuntu-12.04
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: ohai plugins will be at:
> /etc/chef/ohai_plugins
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing
> directory[/var/run/ohai] action create (ohai::default line 24)
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing
> directory[/etc/chef/ohai_plugins] action create (ohai::default line 33)
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing
> remote_directory[/etc/chef/ohai_plugins] action create (ohai::default line
> 42)
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing
> cookbook_file[/etc/chef/ohai_plugins/crowbar.rb] action create (dynamically
> defined)
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: Processing
> cookbook_file[/etc/chef/ohai_plugins/README] action create (dynamically
> defined)
> [Thu, 07 Nov 2013 11:31:48 +0200] INFO: [inet6] no default interface,
> picking the first ipaddress
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Processing package[bridge-utils]
> action install (network::default line 21)
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Processing package[vlan] action
> install (network::default line 21)
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Returning new interface
> #<Nic:0x7fa0f1a88df8 @nic="eth0", @dependents=nil, @addresses=[#<IP::IP4:
> 10.102.236.65/24>], @nicdir="/sys/class/net/eth0">
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Using base interfaces ["eth0"] for
> network admin
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Using interface eth0 for network
> admin
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: admin: Will use 10.102.236.1 as
> our default route
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Returning new interface
> #<Nic:0x7fa0f1a83628 @nic="eth1", @dependents=nil, @addresses=[#<IP::IP4:
> 10.102.235.79/24>], @nicdir="/sys/class/net/eth1">
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Returning new interface
> #<Nic:0x7fa0f1a818a0 @nic="lo", @dependents=nil, @addresses=[#<IP::IP4:
> 127.0.0.1/8>, #<IP::IP6: ::1/128>], @nicdir="/sys/class/net/lo">
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: eth0: current addresses: ["
> 10.102.236.65/24"]
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: eth0: required addresses: ["
> 10.102.236.65/24"]
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Waiting up to 60 seconds for the
> net to come back
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: Saving interfaces to crowbar_wall:
> {"eth0"=>{"type"=>"physical", "gateway"=>"10.102.236.1", "addresses"=>["
> 10.102.236.65/24"]}}
> [Thu, 07 Nov 2013 11:31:49 +0200] INFO: HTTP Request Returned 500 Internal
> Server Error: Connection refused - connect(2)
> [Thu, 07 Nov 2013 11:31:49 +0200] ERROR: Server returned error for
> http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 1/5 in 3s
> [Thu, 07 Nov 2013 11:31:53 +0200] INFO: HTTP Request Returned 500 Internal
> Server Error: Connection refused - connect(2)
> [Thu, 07 Nov 2013 11:31:53 +0200] ERROR: Server returned error for
> http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 2/5 in 8s
> [Thu, 07 Nov 2013 11:32:01 +0200] INFO: HTTP Request Returned 500 Internal
> Server Error: Connection refused - connect(2)
> [Thu, 07 Nov 2013 11:32:01 +0200] ERROR: Server returned error for
> http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 3/5 in 12s
> [Thu, 07 Nov 2013 11:32:13 +0200] INFO: HTTP Request Returned 500 Internal
> Server Error: Connection refused - connect(2)
> [Thu, 07 Nov 2013 11:32:13 +0200] ERROR: Server returned error for
> http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 4/5 in 31s
> [Thu, 07 Nov 2013 11:32:45 +0200] INFO: HTTP Request Returned 500 Internal
> Server Error: Connection refused - connect(2)
> [Thu, 07 Nov 2013 11:32:45 +0200] ERROR: Server returned error for
> http://admin.crowbar.org:4000/nodes/admin.crowbar.org, retrying 5/5 in 61s
> [Thu, 07 Nov 2013 11:33:46 +0200] INFO: HTTP Request Returned 500 Internal
> Server Error: Connection refused - connect(2)
>
>
> ================================================================================
> Recipe Compile Error in
> /var/cache/chef/cookbooks/network/recipes/default.rb
>
> ================================================================================
>
> Net::HTTPFatalError
> -------------------
> 500 "Internal Server Error"
>
> Cookbook Trace:
> ---------------
> /var/cache/chef/cookbooks/network/recipes/default.rb:329:in `from_file'
>
> Relevant File Content:
> ----------------------
> /var/cache/chef/cookbooks/network/recipes/default.rb:
>
> 322: saved_ifs[k]["addresses"] = addrs
> 323: }
> 324: Chef::Log.info("Saving interfaces to crowbar_wall:
> #{saved_ifs.inspect}")
> 325:
> 326: node.set["crowbar_wall"]["network"]["interfaces"] = saved_ifs
> 327: node.set["crowbar_wall"]["network"]["nets"] = if_mapping
> 328: node.set["crowbar_wall"]["network"]["addrs"] = addr_mapping
> 329>> node.save
> 330:
> 331: # Flag to let us know that networking on this node
> 332: # is now managed by the netowrk barclamp.
> 333: FileUtils.mkdir_p("/var/cache/crowbar/network")
> 334: FileUtils.touch("/var/cache/crowbar/network/managed")
> 335:
> 336: case node["platform"]
> 337: when "debian","ubuntu"
> 338: template "/etc/network/interfaces" do
>
> [Thu, 07 Nov 2013 11:33:46 +0200] ERROR: Running exception handlers
> [Thu, 07 Nov 2013 11:33:46 +0200] FATAL: Saving node information to
> /var/cache/chef/failed-run-data.json
> [Thu, 07 Nov 2013 11:33:46 +0200] ERROR: Exception handlers complete
> [Thu, 07 Nov 2013 11:33:46 +0200] FATAL: Stacktrace dumped to
> /var/cache/chef/chef-stacktrace.out
> [Thu, 07 Nov 2013 11:33:46 +0200] FATAL: Net::HTTPFatalError: 500
> "Internal Server Error"
>
>
>
> So when the chef-client runs, it adds a defult routing. This may be
> causing the to the connection error to admin.crowbar.org
>
> # ping admin.crowbar.org
> PING admin.crowbar.org (10.102.235.79) 56(84) bytes of data.
> 64 bytes from admin.crowbar.org (10.102.235.79): icmp_req=1 ttl=64
> time=0.038 ms
>
> is the normal situation.
>
> I removed the routing info when chef-client runs,
>
> ip route del default via 10.102.236.1 dev eth0
>
> But still it can not access to the address.
>
> There is already a running instance:
>
> # ps aux | grep chef-client
> root 1245 0.1 0.6 77568 24556 ? Sl 09:06 0:15
> bluepilld:
> chef-client
>
> root 1251 0.1 1.2 143308 52304 ? S 09:06 0:11 ruby
> /usr/bin/chef-client -c /etc/chef/client.rb -i 900 -s 20
>
>
> # ifconfig
> eth0 Link encap:Ethernet HWaddr 00:1e:4f:3d:16:6d
> inet addr:10.102.236.65 Bcast:10.102.236.255 Mask:255.255.255.0
> inet6 addr: fe80::21e:4fff:fe3d:166d/64 Scope:Link
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:5934 errors:0 dropped:0 overruns:0 frame:0
> TX packets:4114 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:1800816 (1.8 MB) TX bytes:630132 (630.1 KB)
>
> eth1 Link encap:Ethernet HWaddr 00:1e:4f:3d:16:6f
> inet addr:10.102.235.79 Bcast:10.102.235.255 Mask:255.255.255.0
> inet6 addr: fe80::21e:4fff:fe3d:166f/64 Scope:Link
> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
> RX packets:31026 errors:0 dropped:36 overruns:0 frame:0
> TX packets:16465 errors:0 dropped:0 overruns:0 carrier:0
> collisions:0 txqueuelen:1000
> RX bytes:3920565 (3.9 MB) TX bytes:7849104 (7.8 MB)
>
>
> Any idea?
>
> _______________________________________________
> Crowbar mailing list
> Crowbar@dell.com
> https://lists.us.dell.com/mailman/listinfo/crowbar
> For more information: http://crowbar.github.com/
>
--
Judd Maltin
T: 917-882-1270
F: 501-694-7809
what could possibly go wrong?
_______________________________________________
Crowbar mailing list
Crowbar@dell.com
https://lists.us.dell.com/mailman/listinfo/crowbar
For more information: http://crowbar.github.com/
