hi everyone,
when i create cluster:
openstack dataprocessing cluster create --json my_cluster_create_vmdk.json
with??
sudo vim my_worker_template_create_vmdk.json
{
"plugin_name": "vanilla-vmdk",
"hadoop_version": "2.7.1",
"node_processes": [
"nodemanager",
"datanode"
],
"name": "vanilla-vmdk-worker",
"floating_ip_pool": "public",
"flavor_id": "2",
"auto_security_group": true
}
sudo vim my_master_template_create_vmdk.json
{
"plugin_name": "vanilla",
"hadoop_version": "2.7.1",
"node_processes": [
"namenode",
"resourcemanager"
],
"name": "vanilla-vmdk-master",
"floating_ip_pool": "public",
"flavor_id": "2",
"auto_security_group": true
}
it is error in sahara.log:
2016-07-05 11:37:08.427 45905 DEBUG heatclient.common.http
[req-83467fbd-ca47-42eb-9988-5b138df783c9 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
0271f779-0900-456b-a34f-a951f77e3114] curl -g -i -X POST -H 'Accept:
application/json' -H 'User-Agent: python-heatclient' -H 'Content-Type:
application/json' -H 'X-Auth-User: sahara' -H 'X-Auth-Token:
{SHA1}9ffea1e4748e333888f830a439074ebfa6c0513d' -d '{"files":
{"file://master.yaml": "description: 'Data Processing Cluster by Sahara\n\n
Sahara cluster name: my-cluster-vmdk-2\n\n Sahara engine: heat.3.0\n\n Node
group master'\nheat_template_version: '2013-05-23'\noutputs:\n instance:\n
value:\n name:\n get_attr: [inst, name]\n physical_id:
{get_resource: inst}\nparameters:\n instance_index: {type:
string}\nresources:\n floating_ip:\n properties: {pool: public}\n type:
OS::Nova::FloatingIP\n floating_ip_assoc:\n properties:\n floating_ip:
{get_resource: floating_ip}\n server_id: {get_resource: inst}\n type:
OS::Nova::FloatingIPAssociation\n inst:\n properties:\n admin_user:
sahara\n flavor: '2'\n image: 3355bf5d-798f-4f50-b83c-daa417fe4189\n
key_name: my_stack\n name:\n list_join:\n - '-'\n
- - my-cluster-vmdk-2\n - master\n - {get_param:
instance_index}\n security_groups:\n - {get_resource:
my-cluster-vmdk-2-master-ef810b61}\n user_data:\n str_replace:\n
params:\n wc_notify:\n get_attr:
[master-wc-handle, curl_cli]\n template: \"#!/bin/bash\\necho
\\\"ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQC/DWL+Mq3JV3LU6PvFowPIJSeu2BTCTNi1gUScGd7f15ykQzisczg0upM5Xd12uVqIGgPmC7grB2LTxL2T7Kqe9GOyqZskgff18YjCBCWRpsdWqmnQVQGpGvfYHPgvWxUPc+3Cu60JBWe775w5AFrBbZCRHE/dgrvhgXxJUUnkmxrTgf4oEc+sEq8o0s7s5ro4wOrT6Fqeo5QkDYMkKkGqBL41NGQrRQnuY8HwT64u9ZY6aoqHYkRDVwJManpemauwpuRywooP0fiQPy5lxNZYCko6KEUpzm7zlP4NTirEEeZxKgFaF0WE70BbJQVi5r3IsQTd0IdIW05I3TvOw6J5\\\n
\\ Generated-by-Sahara\\n\\\" >>
/home/sahara//.ssh/authorized_keys\\n\\n# ======\\\n \\ COMMENT OUT
Defaults requiretty in /etc/sudoers ========\\nsed '/^Defaults\\\n
\\ requiretty*/ s/^/#/' -i /etc/sudoers\\n\\n\\n\\nwhile true; do\\n
wc_notify\\\n \\ --insecure --data-binary '{\\\"status\\\":
\\\"SUCCESS\\\"}'\\n if [ $? -eq\\\n \\ 0 ]; then\\n
break\\n fi\\n sleep 10\\ndone\\n\"\n type: OS::Nova::Server\n
master-wc-handle: {type: 'OS::Heat::WaitConditionHandle'}\n
master-wc-waiter:\n depends_on: inst\n properties:\n handle:
{get_resource: master-wc-handle}\n timeout: 3600\n type:
OS::Heat::WaitCondition\n my-cluster-vmdk-2-master-ef810b61:\n
properties:\n GroupDescription: 'Data Processing Cluster by Sahara\n\n
Sahara cluster name: my-cluster-vmdk-2\n\n Sahara engine:
heat.3.0\n\n Auto security group for Sahara Node Group: master'\n
SecurityGroupIngress:\n - {CidrIp: 0.0.0.0/0, FromPort: '8088',
IpProtocol: tcp, ToPort: '8088'}\n - {CidrIp: '::/0', FromPort: '8088',
IpProtocol: tcp, ToPort: '8088'}\n - {CidrIp: 0.0.0.0/0, FromPort: '8032',
IpProtocol: tcp, ToPort: '8032'}\n - {CidrIp: '::/0', FromPort: '8032',
IpProtocol: tcp, ToPort: '8032'}\n - {CidrIp: 0.0.0.0/0, FromPort:
'50070', IpProtocol: tcp, ToPort: '50070'}\n - {CidrIp: '::/0', FromPort:
'50070', IpProtocol: tcp, ToPort: '50070'}\n - {CidrIp: 0.0.0.0/0,
FromPort: '9000', IpProtocol: tcp, ToPort: '9000'}\n - {CidrIp: '::/0',
FromPort: '9000', IpProtocol: tcp, ToPort: '9000'}\n - {CidrIp: 0.0.0.0/0,
FromPort: '22', IpProtocol: tcp, ToPort: '22'}\n - {CidrIp: '::/0',
FromPort: '22', IpProtocol: tcp, ToPort: '22'}\n type:
AWS::EC2::SecurityGroup\n", "file://worker.yaml": "description: 'Data
Processing Cluster by Sahara\n\n Sahara cluster name: my-cluster-vmdk-2\n\n
Sahara engine: heat.3.0\n\n Node group worker'\nheat_template_version:
'2013-05-23'\noutputs:\n instance:\n value:\n name:\n get_attr:
[inst, name]\n physical_id: {get_resource: inst}\nparameters:\n
instance_index: {type: string}\nresources:\n floating_ip:\n properties:
{pool: public}\n type: OS::Nova::FloatingIP\n floating_ip_assoc:\n
properties:\n floating_ip: {get_resource: floating_ip}\n server_id:
{get_resource: inst}\n type: OS::Nova::FloatingIPAssociation\n inst:\n
properties:\n admin_user: sahara\n flavor: '2'\n image:
3355bf5d-798f-4f50-b83c-daa417fe4189\n key_name: my_stack\n name:\n
list_join:\n - '-'\n - - my-cluster-vmdk-2\n -
worker\n - {get_param: instance_index}\n security_groups:\n
- {get_resource: my-cluster-vmdk-2-worker-123d84f1}\n user_data:\n
str_replace:\n params:\n wc_notify:\n
get_attr: [worker-wc-handle, curl_cli]\n template:
\"#!/bin/bash\\necho \\\"ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQC/DWL+Mq3JV3LU6PvFowPIJSeu2BTCTNi1gUScGd7f15ykQzisczg0upM5Xd12uVqIGgPmC7grB2LTxL2T7Kqe9GOyqZskgff18YjCBCWRpsdWqmnQVQGpGvfYHPgvWxUPc+3Cu60JBWe775w5AFrBbZCRHE/dgrvhgXxJUUnkmxrTgf4oEc+sEq8o0s7s5ro4wOrT6Fqeo5QkDYMkKkGqBL41NGQrRQnuY8HwT64u9ZY6aoqHYkRDVwJManpemauwpuRywooP0fiQPy5lxNZYCko6KEUpzm7zlP4NTirEEeZxKgFaF0WE70BbJQVi5r3IsQTd0IdIW05I3TvOw6J5\\\n
\\ Generated-by-Sahara\\n\\\" >>
/home/sahara//.ssh/authorized_keys\\n\\n# ======\\\n \\ COMMENT OUT
Defaults requiretty in /etc/sudoers ========\\nsed '/^Defaults\\\n
\\ requiretty*/ s/^/#/' -i /etc/sudoers\\n\\n\\n\\nwhile true; do\\n
wc_notify\\\n \\ --insecure --data-binary '{\\\"status\\\":
\\\"SUCCESS\\\"}'\\n if [ $? -eq\\\n \\ 0 ]; then\\n
break\\n fi\\n sleep 10\\ndone\\n\"\n type: OS::Nova::Server\n
my-cluster-vmdk-2-worker-123d84f1:\n properties:\n GroupDescription:
'Data Processing Cluster by Sahara\n\n Sahara cluster name:
my-cluster-vmdk-2\n\n Sahara engine: heat.3.0\n\n Auto security
group for Sahara Node Group: worker'\n SecurityGroupIngress:\n -
{CidrIp: 0.0.0.0/0, FromPort: '50010', IpProtocol: tcp, ToPort: '50010'}\n
- {CidrIp: '::/0', FromPort: '50010', IpProtocol: tcp, ToPort: '50010'}\n
- {CidrIp: 0.0.0.0/0, FromPort: '50075', IpProtocol: tcp, ToPort: '50075'}\n
- {CidrIp: '::/0', FromPort: '50075', IpProtocol: tcp, ToPort: '50075'}\n
- {CidrIp: 0.0.0.0/0, FromPort: '50020', IpProtocol: tcp, ToPort: '50020'}\n
- {CidrIp: '::/0', FromPort: '50020', IpProtocol: tcp, ToPort: '50020'}\n
- {CidrIp: 0.0.0.0/0, FromPort: '8042', IpProtocol: tcp, ToPort: '8042'}\n
- {CidrIp: '::/0', FromPort: '8042', IpProtocol: tcp, ToPort: '8042'}\n
- {CidrIp: 0.0.0.0/0, FromPort: '22', IpProtocol: tcp, ToPort: '22'}\n -
{CidrIp: '::/0', FromPort: '22', IpProtocol: tcp, ToPort: '22'}\n type:
AWS::EC2::SecurityGroup\n worker-wc-handle: {type:
'OS::Heat::WaitConditionHandle'}\n worker-wc-waiter:\n depends_on: inst\n
properties:\n handle: {get_resource: worker-wc-handle}\n timeout:
3600\n type: OS::Heat::WaitCondition\n"}, "disable_rollback": true,
"parameters": {}, "tags": "data-processing-cluster", "stack_name":
"my-cluster-vmdk-20271f779", "template": "description: 'Data Processing Cluster
by Sahara\n\n Sahara cluster name: my-cluster-vmdk-2\n\n Sahara engine:
heat.3.0'\nheat_template_version: '2013-05-23'\noutputs:\n master-instances:\n
value:\n get_attr: [master, instance]\n worker-instances:\n
value:\n get_attr: [worker, instance]\nresources:\n master:\n
properties:\n count: 1\n resource_def:\n properties:
{instance_index: '%index%'}\n type: file://master.yaml\n type:
OS::Heat::ResourceGroup\n worker:\n properties:\n count: 3\n
resource_def:\n properties: {instance_index: '%index%'}\n type:
file://worker.yaml\n type: OS::Heat::ResourceGroup\n", "timeout_mins": 180}'
http://10.0.0.132:8004/v1/6cb156a82d0f486a9f50132be9438eb6/stacks
log_curl_request /usr/lib/python2.7/site-packages/heatclient/common/http.py:129
HTTP/1.1 200 OK
Date: Tue, 05 Jul 2016 15:37:49 GMT
Connection: keep-alive
Content-Type: application/json; charset=UTF-8
Content-Length: 896
X-Openstack-Request-Id: req-39ee1ae6-62a3-4857-863c-e11aae1fd68b
{"stacks": [{"description": "Data Processing Cluster by Sahara\nSahara cluster
name: my-cluster-vmdk-2\nSahara engine: heat.3.0", "parent": null,
"stack_status_reason": "Resource CREATE failed: OverQuotaClient:
resources.master.resources[0].resources.my-cluster-vmdk-2-master-ef810b61:
Quota exceeded for resources: ['security_group'].\nNeutron server returns
request_ids: ['req-596515c6-531a-49ff-8a26-cd1aae850ec2']", "stack_name":
"my-cluster-vmdk-20271f779", "stack_user_project_id":
"5ccd3a62add74f6ab24cccd1cfc2d9a3", "tags": ["data-processing-cluster"],
"creation_time": "2016-07-05T15:37:10", "links": [{"href":
"http://10.0.0.132:8004/v1/6cb156a82d0f486a9f50132be9438eb6/stacks/my-cluster-vmdk-20271f779/aae6c09b-5cdd-49f4-b574-f3a5540d7e08";,
"rel": "self"}], "updated_time": null, "stack_owner": "sahara",
"stack_status": "CREATE_FAILED", "id": "aae6c09b-5cdd-49f4-b574-f3a5540d7e08"}]}
log_http_response
/usr/lib/python2.7/site-packages/heatclient/common/http.py:142
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops
[req-83467fbd-ca47-42eb-9988-5b138df783c9 7fff70fbbf83441a9b3c4d91a5613825
6cb156a82d0f486a9f50132be9438eb6 - - -] [instance: none, cluster:
0271f779-0900-456b-a34f-a951f77e3114] Error during operating on cluster
(reason: Heat stack failed with status Resource CREATE failed: OverQuotaClient:
resources.master.resources[0].resources.my-cluster-vmdk-2-master-ef810b61:
Quota exceeded for resources: ['security_group'].
Neutron server returns request_ids: ['req-596515c6-531a-49ff-8a26-cd1aae850ec2']
Error ID: bc978fee-9b6c-41d6-a8d1-67c3cbc3e5d0)
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] Traceback (most recent call
last):
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] File
"/usr/lib/python2.7/site-packages/sahara/service/ops.py", line 192, in wrapper
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] f(cluster_id, *args, **kwds)
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] File
"/usr/lib/python2.7/site-packages/sahara/service/ops.py", line 285, in
_provision_cluster
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] INFRA.create_cluster(cluster)
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] File
"/usr/lib/python2.7/site-packages/sahara/service/heat/heat_engine.py", line 63,
in create_cluster
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114]
self._launch_instances(cluster, target_count, CREATE_STAGES)
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] File
"/usr/lib/python2.7/site-packages/sahara/service/heat/heat_engine.py", line
224, in _launch_instances
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] cluster, target_count,
update_stack, disable_rollback)
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] File
"/usr/lib/python2.7/site-packages/sahara/utils/cluster_progress_ops.py", line
139, in handler
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] add_fail_event(instance, e)
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] File
"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] self.force_reraise()
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] File
"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in
force_reraise
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] six.reraise(self.type_,
self.value, self.tb)
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] File
"/usr/lib/python2.7/site-packages/sahara/utils/cluster_progress_ops.py", line
136, in handler
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] value = func(*args, **kwargs)
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] File
"/usr/lib/python2.7/site-packages/sahara/service/heat/heat_engine.py", line
215, in _create_instances
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114]
last_updated_time=stack.last_updated_time)
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] File
"/usr/lib/python2.7/site-packages/sahara/utils/openstack/heat.py", line 112, in
wait_stack_completion
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] raise
ex.HeatStackException(stack.stack_status_reason)
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] HeatStackException: Heat stack
failed with status Resource CREATE failed: OverQuotaClient:
resources.master.resources[0].resources.my-cluster-vmdk-2-master-ef810b61:
Quota exceeded for resources: ['security_group'].
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] Neutron server returns
request_ids: ['req-596515c6-531a-49ff-8a26-cd1aae850ec2']
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114] Error ID:
bc978fee-9b6c-41d6-a8d1-67c3cbc3e5d0
2016-07-05 11:37:51.186 45905 ERROR sahara.service.ops [instance: none,
cluster: 0271f779-0900-456b-a34f-a951f77e3114]
How to deal it ,thanks !_______________________________________________
OpenStack-operators mailing list
[email protected]
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
