Hi,
I am trying to configure*Openstack Sahara **Kilo* release on existing
*Openstack **Juno* setup. After successful integration of services and
dashboard everything works smooth until it start creating cluster.
- Create Node Group Templates for Plugin "vanilla" Hadoop Version "2.6"
- Create Cluster Template for Plugin "vanilla" Hadoop Version "2.6"
- Used sahara-image-elements and created qcow image of ubuntu for
version 2.6
- Register image with correct username "ubuntu"
- Generate key pair and attached to cluster
- Launch Cluster
When cluster launches it creates instances with networking enabled. I
can ping the nodes and ssh into them using keypair generated, but for
some reason controller is unable to run ssh commands. The following
error comes in *sahara-all**.log*(attached)
*/2015-06-01 11:33:37.022 814 ERROR root [-] Original exception being
dropped: ['Traceback (most recent call last):\n', ' File
"/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py",
line 630, in _run\n self._get_conn_params())\n', ' File
"/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/procutils.py",
line 51, in run_in_subprocess\n result = pickle.load(proc.stdout)\n',
' File "/usr/lib/python2.7/pickle.py", line 1378, in load\n return
Unpickler(file).load()\n', ' File "/usr/lib/python2.7/pickle.py", line
858, in load\n dispatch[key](self)\n', ' File
"/usr/lib/python2.7/pickle.py", line 880, in load_eof\n raise
EOFError\n', 'EOFError\n']
2015-06-01 11:33:37.023 814 ERROR root [-] Original exception being
dropped: ['Traceback (most recent call last):\n', ' File
"/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py",
line 630, in _run\n self._get_conn_params())\n', ' File
"/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/procutils.py",
line 51, in run_in_subprocess\n result = pickle.load(proc.stdout)\n',
' File "/usr/lib/python2.7/pickle.py", line 1378, in load\n return
Unpickler(file).load()\n', ' File "/usr/lib/python2.7/pickle.py", line
858, in load\n dispatch[key](self)\n', ' File
"/usr/lib/python2.7/pickle.py", line 880, in load_eof\n raise
EOFError\n', 'EOFError\n']/*
I have also attached sahara.conf file. Any help will be appreciated.
Thanks,
Amardeep
2015-06-01 11:33:29.614 814 DEBUG sahara.utils.poll_utils [-] Operation with name Wait for instances to become active was executed successfully in timeout 10800 poll /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/poll_utils.py:134
2015-06-01 11:33:29.615 814 INFO sahara.service.direct_engine [-] Cluster 6dd61bb4-8db5-4265-b45b-ead10ab84bfb: all instances are active
2015-06-01 11:33:33.417 814 DEBUG keystonemiddleware.auth_token [-] Removing headers from request environment: X-Service-Catalog,X-Identity-Status,X-Service-Identity-Status,X-Roles,X-Service-Roles,X-Domain-Name,X-Service-Domain-Name,X-Project-Id,X-Service-Project-Id,X-Project-Domain-Name,X-Service-Project-Domain-Name,X-User-Id,X-Service-User-Id,X-User-Name,X-Service-User-Name,X-Project-Name,X-Service-Project-Name,X-User-Domain-Id,X-Service-User-Domain-Id,X-Domain-Id,X-Service-Domain-Id,X-User-Domain-Name,X-Service-User-Domain-Name,X-Project-Domain-Id,X-Service-Project-Domain-Id,X-Role,X-User,X-Tenant-Name,X-Tenant-Id,X-Tenant _remove_auth_headers /opt/openstack/current/sahara/local/lib/python2.7/site-packages/keystonemiddleware/auth_token/__init__.py:672
2015-06-01 11:33:33.418 814 DEBUG keystonemiddleware.auth_token [-] Authenticating user token __call__ /opt/openstack/current/sahara/local/lib/python2.7/site-packages/keystonemiddleware/auth_token/__init__.py:581
2015-06-01 11:33:33.418 814 DEBUG keystonemiddleware.auth_token [-] Returning cached token _cache_get /opt/openstack/current/sahara/local/lib/python2.7/site-packages/keystonemiddleware/auth_token/_cache.py:296
2015-06-01 11:33:33.419 814 DEBUG keystonemiddleware.auth_token [-] Authenticating service token __call__ /opt/openstack/current/sahara/local/lib/python2.7/site-packages/keystonemiddleware/auth_token/__init__.py:603
2015-06-01 11:33:33.419 814 DEBUG keystonemiddleware.auth_token [-] Received request from user: user_id 7fe53d11db1941cea7003edde76a3b55, project_id 37a3a09c97f649a08a9bc3fc6e4a4fb1, roles _member_,admin service: user_id None, project_id None, roles None __call__ /opt/openstack/current/sahara/local/lib/python2.7/site-packages/keystonemiddleware/auth_token/__init__.py:632
2015-06-01 11:33:33.419 814 DEBUG sahara.utils.api [-] Rest.route.decorator.handler, kwargs={'tenant_id': u'37a3a09c97f649a08a9bc3fc6e4a4fb1', 'cluster_id': u'6dd61bb4-8db5-4265-b45b-ead10ab84bfb'} handler /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/api.py:67
2015-06-01 11:33:33.535 814 INFO sahara.utils.wsgi [-] 172.16.0.100 - - [01/Jun/2015 11:33:33] "GET /v1.1/37a3a09c97f649a08a9bc3fc6e4a4fb1/clusters/6dd61bb4-8db5-4265-b45b-ead10ab84bfb HTTP/1.1" 200 4684 0.117938
2015-06-01 11:33:36.142 814 DEBUG sahara.utils.poll_utils [-] Operation with name Assign IPs was executed successfully in timeout 10800 poll /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/poll_utils.py:134
2015-06-01 11:33:36.143 814 INFO sahara.service.engine [-] Cluster 6dd61bb4-8db5-4265-b45b-ead10ab84bfb: all instances have IPs assigned
2015-06-01 11:33:36.859 814 DEBUG sahara.utils.ssh_remote [-] [new-data-001] Executing "ls .ssh/authorized_keys" _log_command /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py:767
2015-06-01 11:33:36.914 814 DEBUG sahara.utils.ssh_remote [-] [new-main-001] Executing "ls .ssh/authorized_keys" _log_command /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py:767
2015-06-01 11:33:36.946 814 DEBUG sahara.utils.ssh_remote [-] [new-data-002] Executing "ls .ssh/authorized_keys" _log_command /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py:767
2015-06-01 11:33:36.978 814 DEBUG sahara.utils.ssh_remote [-] [new-data-003] Executing "ls .ssh/authorized_keys" _log_command /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py:767
2015-06-01 11:33:37.022 814 ERROR root [-] Original exception being dropped: ['Traceback (most recent call last):\n', ' File "/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py", line 630, in _run\n self._get_conn_params())\n', ' File "/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/procutils.py", line 51, in run_in_subprocess\n result = pickle.load(proc.stdout)\n', ' File "/usr/lib/python2.7/pickle.py", line 1378, in load\n return Unpickler(file).load()\n', ' File "/usr/lib/python2.7/pickle.py", line 858, in load\n dispatch[key](self)\n', ' File "/usr/lib/python2.7/pickle.py", line 880, in load_eof\n raise EOFError\n', 'EOFError\n']
2015-06-01 11:33:37.023 814 ERROR root [-] Original exception being dropped: ['Traceback (most recent call last):\n', ' File "/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py", line 630, in _run\n self._get_conn_params())\n', ' File "/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/procutils.py", line 51, in run_in_subprocess\n result = pickle.load(proc.stdout)\n', ' File "/usr/lib/python2.7/pickle.py", line 1378, in load\n return Unpickler(file).load()\n', ' File "/usr/lib/python2.7/pickle.py", line 858, in load\n dispatch[key](self)\n', ' File "/usr/lib/python2.7/pickle.py", line 880, in load_eof\n raise EOFError\n', 'EOFError\n']
2015-06-01 11:33:37.024 814 ERROR root [-] Original exception being dropped: ['Traceback (most recent call last):\n', ' File "/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py", line 630, in _run\n self._get_conn_params())\n', ' File "/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/procutils.py", line 51, in run_in_subprocess\n result = pickle.load(proc.stdout)\n', ' File "/usr/lib/python2.7/pickle.py", line 1378, in load\n return Unpickler(file).load()\n', ' File "/usr/lib/python2.7/pickle.py", line 858, in load\n dispatch[key](self)\n', ' File "/usr/lib/python2.7/pickle.py", line 880, in load_eof\n raise EOFError\n', 'EOFError\n']
2015-06-01 11:33:37.024 814 DEBUG sahara.utils.ssh_remote [-] [new-main-001] _execute_command took 0.1 seconds to complete _log_command /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py:767
2015-06-01 11:33:37.024 814 DEBUG sahara.service.engine [-] Can't login to node new-main-001 192.168.88.30, reason [Errno 32] Broken pipe _is_accessible /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/service/engine.py:128
2015-06-01 11:33:37.025 814 DEBUG sahara.utils.ssh_remote [-] [new-data-001] _execute_command took 0.2 seconds to complete _log_command /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py:767
2015-06-01 11:33:37.025 814 DEBUG sahara.service.engine [-] Can't login to node new-data-001 192.168.88.31, reason [Errno 32] Broken pipe _is_accessible /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/service/engine.py:128
2015-06-01 11:33:37.025 814 DEBUG sahara.utils.ssh_remote [-] [new-data-002] _execute_command took 0.1 seconds to complete _log_command /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py:767
2015-06-01 11:33:37.025 814 DEBUG sahara.service.engine [-] Can't login to node new-data-002 192.168.88.32, reason [Errno 32] Broken pipe _is_accessible /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/service/engine.py:128
2015-06-01 11:33:37.026 814 ERROR root [-] Original exception being dropped: ['Traceback (most recent call last):\n', ' File "/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py", line 630, in _run\n self._get_conn_params())\n', ' File "/opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/procutils.py", line 51, in run_in_subprocess\n result = pickle.load(proc.stdout)\n', ' File "/usr/lib/python2.7/pickle.py", line 1378, in load\n return Unpickler(file).load()\n', ' File "/usr/lib/python2.7/pickle.py", line 858, in load\n dispatch[key](self)\n', ' File "/usr/lib/python2.7/pickle.py", line 880, in load_eof\n raise EOFError\n', 'EOFError\n']
2015-06-01 11:33:37.026 814 DEBUG sahara.utils.ssh_remote [-] [new-data-003] _execute_command took 0.0 seconds to complete _log_command /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/utils/ssh_remote.py:767
2015-06-01 11:33:37.027 814 DEBUG sahara.service.engine [-] Can't login to node new-data-003 192.168.88.33, reason [Errno 32] Broken pipe _is_accessible /opt/openstack/current/sahara/local/lib/python2.7/site-packages/sahara/service/engine.py:128
[DEFAULT]
debug = True
verbose = False
# Use Neutron or Nova Network (boolean value)
use_neutron=true
use_floating_ips=true
log_dir = /var/log/sahara
log_file = sahara-all.log
[database]
connection=mysql://sahara:password@localhost/sahara
[keystone_authtoken]
identity_uri = https://openstack.example.org:35358
auth_uri = https://openstack.example.org:5001/v2.0
admin_user = sahara
admin_password=password
admin_tenant_name = service
cafile = /etc/ssl/certs/ca-certificates.crt
[nova]
api_insecure = False
ca_file = /etc/ssl/certs/ca-certificates.crt
[neutron]
api_insecure = False
ca_file = /etc/ssl/certs/ca-certificates.crt
[cinder]
api_insecure = False
ca_file = /etc/ssl/certs/ca-certificates.crt
_______________________________________________
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
