hi,
when i create cluster with cmd:
openstack dataprocessing cluster create --json my_cluster_create_vmdk.json
Cluster status change to Error after:
Cluster status has been changed. New status=Spawning
[lv@localhost ~(sahara)]$ openstack dataprocessing cluster list
+-------------------+--------------------------------------+-------------+---------+--------+
| Name | Id | Plugin name |
Version | Status |
+-------------------+--------------------------------------+-------------+---------+--------+
| my-cluster-vmdk-1 | 9ac21967-9166-4c7f-8621-965a4306e634 | vanilla |
2.7.1 | Error |
+-------------------+--------------------------------------+-------------+---------+--------+
error message in sahara.log:
...
2016-06-28 02:04:07.223 45905 INFO sahara.utils.cluster
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] Cluster status has been changed. New
status=InfraUpdating
2016-06-28 02:04:07.843 45905 INFO sahara.utils.cluster
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] Cluster status has been changed. New
status=Spawning
2016-06-28 02:04:08.075 45905 DEBUG sahara.service.heat.templates
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] Creating Heat stack with args: {'files':
{u'file://master.yaml': 'description: \'Data Processing Cluster by Sahara\n\n
Sahara cluster name: my-cluster-vmdk-1\n\n Sahara engine: heat.3.0\n\n Node
group master\'\nheat_template_version: \'2013-05-23\'\noutputs:\n instance:\n
value:\n name:\n get_attr: [inst, name]\n physical_id:
{get_resource: inst}\nparameters:\n instance_index: {type:
string}\nresources:\n floating_ip:\n properties: {pool: public}\n type:
OS::Nova::FloatingIP\n floating_ip_assoc:\n properties:\n floating_ip:
{get_resource: floating_ip}\n server_id: {get_resource: inst}\n type:
OS::Nova::FloatingIPAssociation\n inst:\n properties:\n admin_user:
sahara\n flavor: \'2\'\n image:
3355bf5d-798f-4f50-b83c-daa417fe4189\n key_name: my_stack\n name:\n
list_join:\n - \'-\'\n - - my-cluster-vmdk-1\n -
master\n - {get_param: instance_index}\n security_groups:\n
- {get_resource: my-cluster-vmdk-1-master-23b43725}\n user_data:\n
str_replace:\n params:\n wc_notify:\n
get_attr: [master-wc-handle, curl_cli]\n template: "#!/bin/bash\\necho
\\"ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQCutc0Dt24OY/S9NG5bafYXSfAV1g3d9zdmhEd0A7dOQyrYoje576fI7N8k54V52phRgRrUG823Ar1zAg2YLTH6HXLm6qAkm8hxu11XTKYtj76GXfOVzZ6745d11KNfKoVvBXjStxmtoATx+knCBBxNO4xiHOmlynSDsxxcDM0k22FAvK+afITNhtirNgV4rnqkR6HRjFr5QiXPV9YGC9DWnlezbqSPfH+Dibh0MGgcua4S0Tp8Qid3iZsPo3veRfxpGOr9xifKK+GiVM3REPNasYaTliUgIXf+ruu+9jPkfekYQxs1YMEwG/+BbJBorIa74Lracn7HxOJ50LnyrfQD\\\n
\\ Generated-by-Sahara\\n\\" >>
/home/sahara//.ssh/authorized_keys\\n\\n# ======\\\n \\ COMMENT OUT
Defaults requiretty in /etc/sudoers ========\\nsed \'/^Defaults\\\n
\\ requiretty*/ s/^/#/\' -i /etc/sudoers\\n\\n\\n\\nwhile true; do\\n
wc_notify\\\n \\ --insecure --data-binary \'{\\"status\\":
\\"SUCCESS\\"}\'\\n if [ $? -eq\\\n \\ 0 ]; then\\n
break\\n fi\\n sleep 10\\ndone\\n"\n type: OS::Nova::Server\n
master-wc-handle: {type: \'OS::Heat::WaitConditionHandle\'}\n
master-wc-waiter:\n depends_on: inst\n properties:\n handle:
{get_resource: master-wc-handle}\n timeout: 3600\n type:
OS::Heat::WaitCondition\n my-cluster-vmdk-1-master-23b43725:\n
properties:\n GroupDescription: \'Data Processing Cluster by Sahara\n\n
Sahara cluster name: my-cluster-vmdk-1\n\n Sahara engine:
heat.3.0\n\n Auto security group for Sahara Node Group: master\'\n
SecurityGroupIngress:\n - {CidrIp: 0.0.0.0/0, FromPort: \'8088\',
IpProtocol: tcp, ToPort: \'8088\'}\n - {CidrIp: \'::/0\', FromPort:
\'8088\', IpProtocol: tcp, ToPort: \'8088\'}\n - {CidrIp: 0.0.0.0/0,
FromPort: \'8032\', IpProtocol: tcp, ToPort: \'8032\'}\n - {CidrIp:
\'::/0\', FromPort: \'8032\', IpProtocol: tcp, ToPort: \'8032\'}\n -
{CidrIp: 0.0.0.0/0, FromPort: \'50070\', IpProtocol: tcp, ToPort: \'50070\'}\n
- {CidrIp: \'::/0\', FromPort: \'50070\', IpProtocol: tcp, ToPort:
\'50070\'}\n - {CidrIp: 0.0.0.0/0, FromPort: \'9000\', IpProtocol: tcp,
ToPort: \'9000\'}\n - {CidrIp: \'::/0\', FromPort: \'9000\', IpProtocol:
tcp, ToPort: \'9000\'}\n - {CidrIp: 0.0.0.0/0, FromPort: \'22\',
IpProtocol: tcp, ToPort: \'22\'}\n - {CidrIp: \'::/0\', FromPort: \'22\',
IpProtocol: tcp, ToPort: \'22\'}\n type: AWS::EC2::SecurityGroup\n',
u'file://worker.yaml': 'description: \'Data Processing Cluster by Sahara\n\n
Sahara cluster name: my-cluster-vmdk-1\n\n Sahara engine: heat.3.0\n\n Node
group worker\'\nheat_template_version: \'2013-05-23\'\noutputs:\n instance:\n
value:\n name:\n get_attr: [inst, name]\n physical_id:
{get_resource: inst}\nparameters:\n instance_index: {type:
string}\nresources:\n floating_ip:\n properties: {pool: public}\n type:
OS::Nova::FloatingIP\n floating_ip_assoc:\n properties:\n floating_ip:
{get_resource: floating_ip}\n server_id: {get_resource: inst}\n type:
OS::Nova::FloatingIPAssociation\n inst:\n properties:\n admin_user:
sahara\n flavor: \'2\'\n image:
3355bf5d-798f-4f50-b83c-daa417fe4189\n key_name: my_stack\n name:\n
list_join:\n - \'-\'\n - - my-cluster-vmdk-1\n -
worker\n - {get_param: instance_index}\n security_groups:\n
- {get_resource: my-cluster-vmdk-1-worker-1743cf8b}\n user_data:\n
str_replace:\n params:\n wc_notify:\n
get_attr: [worker-wc-handle, curl_cli]\n template: "#!/bin/bash\\necho
\\"ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQCutc0Dt24OY/S9NG5bafYXSfAV1g3d9zdmhEd0A7dOQyrYoje576fI7N8k54V52phRgRrUG823Ar1zAg2YLTH6HXLm6qAkm8hxu11XTKYtj76GXfOVzZ6745d11KNfKoVvBXjStxmtoATx+knCBBxNO4xiHOmlynSDsxxcDM0k22FAvK+afITNhtirNgV4rnqkR6HRjFr5QiXPV9YGC9DWnlezbqSPfH+Dibh0MGgcua4S0Tp8Qid3iZsPo3veRfxpGOr9xifKK+GiVM3REPNasYaTliUgIXf+ruu+9jPkfekYQxs1YMEwG/+BbJBorIa74Lracn7HxOJ50LnyrfQD\\\n
\\ Generated-by-Sahara\\n\\" >>
/home/sahara//.ssh/authorized_keys\\n\\n# ======\\\n \\ COMMENT OUT
Defaults requiretty in /etc/sudoers ========\\nsed \'/^Defaults\\\n
\\ requiretty*/ s/^/#/\' -i /etc/sudoers\\n\\n\\n\\nwhile true; do\\n
wc_notify\\\n \\ --insecure --data-binary \'{\\"status\\":
\\"SUCCESS\\"}\'\\n if [ $? -eq\\\n \\ 0 ]; then\\n
break\\n fi\\n sleep 10\\ndone\\n"\n type: OS::Nova::Server\n
my-cluster-vmdk-1-worker-1743cf8b:\n properties:\n GroupDescription:
\'Data Processing Cluster by Sahara\n\n Sahara cluster name:
my-cluster-vmdk-1\n\n Sahara engine: heat.3.0\n\n Auto security
group for Sahara Node Group: worker\'\n SecurityGroupIngress:\n -
{CidrIp: 0.0.0.0/0, FromPort: \'50010\', IpProtocol: tcp, ToPort: \'50010\'}\n
- {CidrIp: \'::/0\', FromPort: \'50010\', IpProtocol: tcp, ToPort:
\'50010\'}\n - {CidrIp: 0.0.0.0/0, FromPort: \'50075\', IpProtocol: tcp,
ToPort: \'50075\'}\n - {CidrIp: \'::/0\', FromPort: \'50075\', IpProtocol:
tcp, ToPort: \'50075\'}\n - {CidrIp: 0.0.0.0/0, FromPort: \'50020\',
IpProtocol: tcp, ToPort: \'50020\'}\n - {CidrIp: \'::/0\', FromPort:
\'50020\', IpProtocol: tcp, ToPort: \'50020\'}\n - {CidrIp: 0.0.0.0/0,
FromPort: \'8042\', IpProtocol: tcp, ToPort: \'8042\'}\n - {CidrIp:
\'::/0\', FromPort: \'8042\', IpProtocol: tcp, ToPort: \'8042\'}\n -
{CidrIp: 0.0.0.0/0, FromPort: \'22\', IpProtocol: tcp, ToPort: \'22\'}\n -
{CidrIp: \'::/0\', FromPort: \'22\', IpProtocol: tcp, ToPort: \'22\'}\n
type: AWS::EC2::SecurityGroup\n worker-wc-handle: {type:
\'OS::Heat::WaitConditionHandle\'}\n worker-wc-waiter:\n depends_on: inst\n
properties:\n handle: {get_resource: worker-wc-handle}\n timeout:
3600\n type: OS::Heat::WaitCondition\n'}, 'disable_rollback': True,
'parameters': {}, 'tags': 'data-processing-cluster', 'stack_name':
u'my-cluster-vmdk-19ac21967', 'template': "description: 'Data Processing
Cluster by Sahara\n\n Sahara cluster name: my-cluster-vmdk-1\n\n Sahara
engine: heat.3.0'\nheat_template_version: '2013-05-23'\noutputs:\n
master-instances:\n value:\n get_attr: [master, instance]\n
worker-instances:\n value:\n get_attr: [worker, instance]\nresources:\n
master:\n properties:\n count: 1\n resource_def:\n
properties: {instance_index: '%index%'}\n type: file://master.yaml\n
type: OS::Heat::ResourceGroup\n worker:\n properties:\n count: 3\n
resource_def:\n properties: {instance_index: '%index%'}\n type:
file://worker.yaml\n type: OS::Heat::ResourceGroup\n", 'timeout_mins': 180}
instantiate
/usr/lib/python2.7/site-packages/sahara/service/heat/templates.py:182
2016-06-28 02:04:08.080 45905 DEBUG heatclient.common.http
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] curl -g -i -X POST -H 'Accept:
application/json' -H 'User-Agent: python-heatclient' -H 'Content-Type:
application/json' -H 'X-Auth-User: sahara' -H 'X-Auth-Token:
{SHA1}4039f77338321e299efb73bcc3fa26af370d3647' -d '{"files":
{"file://master.yaml": "description: 'Data Processing Cluster by Sahara\n\n
Sahara cluster name: my-cluster-vmdk-1\n\n Sahara engine: heat.3.0\n\n Node
group master'\nheat_template_version: '2013-05-23'\noutputs:\n instance:\n
value:\n name:\n get_attr: [inst, name]\n physical_id:
{get_resource: inst}\nparameters:\n instance_index: {type:
string}\nresources:\n floating_ip:\n properties: {pool: public}\n type:
OS::Nova::FloatingIP\n floating_ip_assoc:\n properties:\n floating_ip:
{get_resource: floating_ip}\n server_id: {get_resource: inst}\n type:
OS::Nova::FloatingIPAssociation\n inst:\n properties:\n admin_user:
sahara\n flavor: '2'\n image: 3355bf5d-798f-4f50-b83c-daa417fe4189\n
key_name: my_stack\n name:\n list_join:\n - '-'\n
- - my-cluster-vmdk-1\n - master\n - {get_param:
instance_index}\n security_groups:\n - {get_resource:
my-cluster-vmdk-1-master-23b43725}\n user_data:\n str_replace:\n
params:\n wc_notify:\n get_attr:
[master-wc-handle, curl_cli]\n template: \"#!/bin/bash\\necho
\\\"ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQCutc0Dt24OY/S9NG5bafYXSfAV1g3d9zdmhEd0A7dOQyrYoje576fI7N8k54V52phRgRrUG823Ar1zAg2YLTH6HXLm6qAkm8hxu11XTKYtj76GXfOVzZ6745d11KNfKoVvBXjStxmtoATx+knCBBxNO4xiHOmlynSDsxxcDM0k22FAvK+afITNhtirNgV4rnqkR6HRjFr5QiXPV9YGC9DWnlezbqSPfH+Dibh0MGgcua4S0Tp8Qid3iZsPo3veRfxpGOr9xifKK+GiVM3REPNasYaTliUgIXf+ruu+9jPkfekYQxs1YMEwG/+BbJBorIa74Lracn7HxOJ50LnyrfQD\\\n
\\ Generated-by-Sahara\\n\\\" >>
/home/sahara//.ssh/authorized_keys\\n\\n# ======\\\n \\ COMMENT OUT
Defaults requiretty in /etc/sudoers ========\\nsed '/^Defaults\\\n
\\ requiretty*/ s/^/#/' -i /etc/sudoers\\n\\n\\n\\nwhile true; do\\n
wc_notify\\\n \\ --insecure --data-binary '{\\\"status\\\":
\\\"SUCCESS\\\"}'\\n if [ $? -eq\\\n \\ 0 ]; then\\n
break\\n fi\\n sleep 10\\ndone\\n\"\n type: OS::Nova::Server\n
master-wc-handle: {type: 'OS::Heat::WaitConditionHandle'}\n
master-wc-waiter:\n depends_on: inst\n properties:\n handle:
{get_resource: master-wc-handle}\n timeout: 3600\n type:
OS::Heat::WaitCondition\n my-cluster-vmdk-1-master-23b43725:\n
properties:\n GroupDescription: 'Data Processing Cluster by Sahara\n\n
Sahara cluster name: my-cluster-vmdk-1\n\n Sahara engine:
heat.3.0\n\n Auto security group for Sahara Node Group: master'\n
SecurityGroupIngress:\n - {CidrIp: 0.0.0.0/0, FromPort: '8088',
IpProtocol: tcp, ToPort: '8088'}\n - {CidrIp: '::/0', FromPort: '8088',
IpProtocol: tcp, ToPort: '8088'}\n - {CidrIp: 0.0.0.0/0, FromPort: '8032',
IpProtocol: tcp, ToPort: '8032'}\n - {CidrIp: '::/0', FromPort: '8032',
IpProtocol: tcp, ToPort: '8032'}\n - {CidrIp: 0.0.0.0/0, FromPort:
'50070', IpProtocol: tcp, ToPort: '50070'}\n - {CidrIp: '::/0', FromPort:
'50070', IpProtocol: tcp, ToPort: '50070'}\n - {CidrIp: 0.0.0.0/0,
FromPort: '9000', IpProtocol: tcp, ToPort: '9000'}\n - {CidrIp: '::/0',
FromPort: '9000', IpProtocol: tcp, ToPort: '9000'}\n - {CidrIp: 0.0.0.0/0,
FromPort: '22', IpProtocol: tcp, ToPort: '22'}\n - {CidrIp: '::/0',
FromPort: '22', IpProtocol: tcp, ToPort: '22'}\n type:
AWS::EC2::SecurityGroup\n", "file://worker.yaml": "description: 'Data
Processing Cluster by Sahara\n\n Sahara cluster name: my-cluster-vmdk-1\n\n
Sahara engine: heat.3.0\n\n Node group worker'\nheat_template_version:
'2013-05-23'\noutputs:\n instance:\n value:\n name:\n get_attr:
[inst, name]\n physical_id: {get_resource: inst}\nparameters:\n
instance_index: {type: string}\nresources:\n floating_ip:\n properties:
{pool: public}\n type: OS::Nova::FloatingIP\n floating_ip_assoc:\n
properties:\n floating_ip: {get_resource: floating_ip}\n server_id:
{get_resource: inst}\n type: OS::Nova::FloatingIPAssociation\n inst:\n
properties:\n admin_user: sahara\n flavor: '2'\n image:
3355bf5d-798f-4f50-b83c-daa417fe4189\n key_name: my_stack\n name:\n
list_join:\n - '-'\n - - my-cluster-vmdk-1\n -
worker\n - {get_param: instance_index}\n security_groups:\n
- {get_resource: my-cluster-vmdk-1-worker-1743cf8b}\n user_data:\n
str_replace:\n params:\n wc_notify:\n
get_attr: [worker-wc-handle, curl_cli]\n template:
\"#!/bin/bash\\necho \\\"ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQCutc0Dt24OY/S9NG5bafYXSfAV1g3d9zdmhEd0A7dOQyrYoje576fI7N8k54V52phRgRrUG823Ar1zAg2YLTH6HXLm6qAkm8hxu11XTKYtj76GXfOVzZ6745d11KNfKoVvBXjStxmtoATx+knCBBxNO4xiHOmlynSDsxxcDM0k22FAvK+afITNhtirNgV4rnqkR6HRjFr5QiXPV9YGC9DWnlezbqSPfH+Dibh0MGgcua4S0Tp8Qid3iZsPo3veRfxpGOr9xifKK+GiVM3REPNasYaTliUgIXf+ruu+9jPkfekYQxs1YMEwG/+BbJBorIa74Lracn7HxOJ50LnyrfQD\\\n
\\ Generated-by-Sahara\\n\\\" >>
/home/sahara//.ssh/authorized_keys\\n\\n# ======\\\n \\ COMMENT OUT
Defaults requiretty in /etc/sudoers ========\\nsed '/^Defaults\\\n
\\ requiretty*/ s/^/#/' -i /etc/sudoers\\n\\n\\n\\nwhile true; do\\n
wc_notify\\\n \\ --insecure --data-binary '{\\\"status\\\":
\\\"SUCCESS\\\"}'\\n if [ $? -eq\\\n \\ 0 ]; then\\n
break\\n fi\\n sleep 10\\ndone\\n\"\n type: OS::Nova::Server\n
my-cluster-vmdk-1-worker-1743cf8b:\n properties:\n GroupDescription:
'Data Processing Cluster by Sahara\n\n Sahara cluster name:
my-cluster-vmdk-1\n\n Sahara engine: heat.3.0\n\n Auto security
group for Sahara Node Group: worker'\n SecurityGroupIngress:\n -
{CidrIp: 0.0.0.0/0, FromPort: '50010', IpProtocol: tcp, ToPort: '50010'}\n
- {CidrIp: '::/0', FromPort: '50010', IpProtocol: tcp, ToPort: '50010'}\n
- {CidrIp: 0.0.0.0/0, FromPort: '50075', IpProtocol: tcp, ToPort: '50075'}\n
- {CidrIp: '::/0', FromPort: '50075', IpProtocol: tcp, ToPort: '50075'}\n
- {CidrIp: 0.0.0.0/0, FromPort: '50020', IpProtocol: tcp, ToPort: '50020'}\n
- {CidrIp: '::/0', FromPort: '50020', IpProtocol: tcp, ToPort: '50020'}\n
- {CidrIp: 0.0.0.0/0, FromPort: '8042', IpProtocol: tcp, ToPort: '8042'}\n
- {CidrIp: '::/0', FromPort: '8042', IpProtocol: tcp, ToPort: '8042'}\n
- {CidrIp: 0.0.0.0/0, FromPort: '22', IpProtocol: tcp, ToPort: '22'}\n -
{CidrIp: '::/0', FromPort: '22', IpProtocol: tcp, ToPort: '22'}\n type:
AWS::EC2::SecurityGroup\n worker-wc-handle: {type:
'OS::Heat::WaitConditionHandle'}\n worker-wc-waiter:\n depends_on: inst\n
properties:\n handle: {get_resource: worker-wc-handle}\n timeout:
3600\n type: OS::Heat::WaitCondition\n"}, "disable_rollback": true,
"parameters": {}, "tags": "data-processing-cluster", "stack_name":
"my-cluster-vmdk-19ac21967", "template": "description: 'Data Processing Cluster
by Sahara\n\n Sahara cluster name: my-cluster-vmdk-1\n\n Sahara engine:
heat.3.0'\nheat_template_version: '2013-05-23'\noutputs:\n master-instances:\n
value:\n get_attr: [master, instance]\n worker-instances:\n
value:\n get_attr: [worker, instance]\nresources:\n master:\n
properties:\n count: 1\n resource_def:\n properties:
{instance_index: '%index%'}\n type: file://master.yaml\n type:
OS::Heat::ResourceGroup\n worker:\n properties:\n count: 3\n
resource_def:\n properties: {instance_index: '%index%'}\n type:
file://worker.yaml\n type: OS::Heat::ResourceGroup\n", "timeout_mins": 180}'
http://10.0.0.132:8004/v1/6cb156a82d0f486a9f50132be9438eb6/stacks
log_curl_request /usr/lib/python2.7/site-packages/heatclient/common/http.py:129
2016-06-28 02:04:10.024 45905 DEBUG heatclient.common.http
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634]
HTTP/1.1 400 Bad Request
Date: Tue, 28 Jun 2016 06:04:10 GMT
Connection: keep-alive
Content-Type: application/json; charset=UTF-8
Content-Length: 396
X-Openstack-Request-Id: req-147104a5-bbd8-4f19-ac0c-4776a5e7d542
{"explanation": "The server could not comply with the request since it is
either malformed or otherwise incorrect.", "code": 400, "error": {"message":
"Failed to validate: Failed to validate: resources[0]: HEAT-E99001 Service nova
is not available for resource type OS::Nova::FloatingIP, reason: Authorization
failed.", "traceback": null, "type": "StackValidationFailed"}, "title": "Bad
Request"}
log_http_response
/usr/lib/python2.7/site-packages/heatclient/common/http.py:142
2016-06-28 02:04:10.025 45905 DEBUG sahara.utils.openstack.base
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] Permanent error occurred during "create"
execution: ERROR: Failed to validate: Failed to validate: resources[0]:
HEAT-E99001 Service nova is not available for resource type
OS::Nova::FloatingIP, reason: Authorization failed.. execute_with_retries
/usr/lib/python2.7/site-packages/sahara/utils/openstack/base.py:99
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] Error during operating on cluster
(reason: ERROR: Failed to validate: Failed to validate: resources[0]:
HEAT-E99001 Service nova is not available for resource type
OS::Nova::FloatingIP, reason: Authorization failed.)
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] Traceback (most recent call
last):
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] File
"/usr/lib/python2.7/site-packages/sahara/service/ops.py", line 192, in wrapper
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] f(cluster_id, *args, **kwds)
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] File
"/usr/lib/python2.7/site-packages/sahara/service/ops.py", line 285, in
_provision_cluster
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] INFRA.create_cluster(cluster)
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] File
"/usr/lib/python2.7/site-packages/sahara/service/heat/heat_engine.py", line 63,
in create_cluster
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634]
self._launch_instances(cluster, target_count, CREATE_STAGES)
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] File
"/usr/lib/python2.7/site-packages/sahara/service/heat/heat_engine.py", line
224, in _launch_instances
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] cluster, target_count,
update_stack, disable_rollback)
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] File
"/usr/lib/python2.7/site-packages/sahara/utils/cluster_progress_ops.py", line
139, in handler
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] add_fail_event(instance, e)
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] File
"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] self.force_reraise()
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] File
"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in
force_reraise
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] six.reraise(self.type_,
self.value, self.tb)
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] File
"/usr/lib/python2.7/site-packages/sahara/utils/cluster_progress_ops.py", line
136, in handler
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] value = func(*args, **kwargs)
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] File
"/usr/lib/python2.7/site-packages/sahara/service/heat/heat_engine.py", line
212, in _create_instances
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634]
disable_rollback=disable_rollback)
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] File
"/usr/lib/python2.7/site-packages/sahara/service/heat/templates.py", line 183,
in instantiate
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634]
b.execute_with_retries(h.client().stacks.create, **kwargs)
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] File
"/usr/lib/python2.7/site-packages/sahara/utils/openstack/base.py", line 100, in
execute_with_retries
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] raise e
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634] HTTPBadRequest: ERROR: Failed to
validate: Failed to validate: resources[0]: HEAT-E99001 Service nova is not
available for resource type OS::Nova::FloatingIP, reason: Authorization failed.
2016-06-28 02:04:10.359 45905 ERROR sahara.service.ops [instance: none,
cluster: 9ac21967-9166-4c7f-8621-965a4306e634]
2016-06-28 02:04:10.530 45905 DEBUG keystoneclient.auth.identity.v3.base
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] Making authentication request to
http://10.0.0.132:5000/v3/auth/tokens get_auth_ref
/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/v3/base.py:188
2016-06-28 02:04:10.834 45905 DEBUG heatclient.common.http
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] curl -g -i -X DELETE -H 'X-Auth-Token:
{SHA1}c3934f02a956b2358032a40151e6d37673566847' -H 'Content-Type:
application/octet-stream' -H 'X-Auth-User: sahara' -H 'User-Agent:
python-heatclient'
http://10.0.0.132:8004/v1/6cb156a82d0f486a9f50132be9438eb6/stacks/my-cluster-vmdk-19ac21967
log_curl_request /usr/lib/python2.7/site-packages/heatclient/common/http.py:129
2016-06-28 02:04:11.745 45905 DEBUG heatclient.common.http
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634]
HTTP/1.1 404 Not Found
Date: Tue, 28 Jun 2016 06:04:11 GMT
Connection: keep-alive
Content-Type: application/json; charset=UTF-8
Content-Length: 214
X-Openstack-Request-Id: req-f9c71842-fc98-45f3-a051-dc06d8569fa9
{"explanation": "The resource could not be found.", "code": 404, "error":
{"message": "The Stack (my-cluster-vmdk-19ac21967) could not be found.",
"traceback": null, "type": "EntityNotFound"}, "title": "Not Found"}
log_http_response
/usr/lib/python2.7/site-packages/heatclient/common/http.py:142
2016-06-28 02:04:11.747 45905 DEBUG sahara.utils.openstack.base
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] Permanent error occurred during "delete"
execution: ERROR: The Stack (my-cluster-vmdk-19ac21967) could not be found..
execute_with_retries
/usr/lib/python2.7/site-packages/sahara/utils/openstack/base.py:99
2016-06-28 02:04:11.748 45905 WARNING sahara.service.heat.heat_engine
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] Did not find stack for cluster. Trying to
delete cluster manually.
2016-06-28 02:04:11.822 45905 WARNING sahara.service.heat.heat_engine
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] Cluster creation rollback (reason: ERROR:
Failed to validate: Failed to validate: resources[0]: HEAT-E99001 Service nova
is not available for resource type OS::Nova::FloatingIP, reason: Authorization
failed.)
2016-06-28 02:04:12.195 45905 INFO sahara.utils.cluster
[req-9223a608-70ae-4aa5-88c6-1e9eefe35783 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
9ac21967-9166-4c7f-8621-965a4306e634] Cluster status has been changed. New
status=Error
2016-06-28 02:04:18.295 45891 DEBUG oslo_service.periodic_task [-] Running
periodic task SaharaPeriodicTasks.update_job_statuses run_periodic_tasks
/usr/lib/python2.7/site-packages/oslo_service/periodic_task.py:215
2016-06-28 02:04:18.296 45891 DEBUG sahara.service.periodic
[req-015f5f4b-ceb1-434d-986a-f2e0c4ca6ce1 - - - - -] Updating job statuses
update_job_statuses
/usr/lib/python2.7/site-packages/sahara/service/periodic.py:154
...
how to deel with 'HEAT-E99001 Service nova is not available for resource type
OS::Nova::FloatingIP' error?
thanks !_______________________________________________
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
