Hi,
what meters are you looking for specifically? as Ganpat mentioned, we only derive a few meters from Nova notifications[1]. i don't understand your comment about being able to see events on kafka. by 'events' do you mean Ceilometer Events[2]? [1] https://github.com/openstack/ceilometer/blob/master/ceilometer/meter/data/meters.yaml#L83-L127 [2] http://docs.openstack.org/developer/ceilometer/events.html Yes,here I am referring to Events[2]. My requirement is to get sample/counter with "instance" name ,with event_type compute.instance.* For example: {u'counter_name': u'instance', u'user_id': u'0eddb9bb412b4b2783fbdb04c7786fbd', u'message_signature': u'a575aee7540c8aac5d481fbeb6c96e8a967814c7f7d712b3b3da0a4ebccabb1d', u'timestamp': u'2016-11-01 07:34:42.994144', u'resource_id': u'1784a230-5038-46e9-9a2e-f96dabc1ea26', u'message_id': u'a7bac522-a005-11e6-abbb-52540074f46a', u'source': u'openstack', u'counter_unit': u'instance', u'counter_volume': 1, u'project_id': u'33dbef1a1442476b9c5935287df86f2c', u'resource_metadata': {u'state_description': u'', u'event_type': u'compute.instance.delete.end', u'availability_zone': u'nova', u'terminated_at': u'2016-11-01T07:34:42.167439', u'ephemeral_gb': 0, u'instance_type_id': 5, u'deleted_at': u'2016-11-01T07:34:42.000000', u'reservation_id': u'r-bhq970mr', u'memory_mb': 2048, u'display_name': u'mysite_exampleservice-1', u'hostname': u'mysite-exampleservice-1', u'state': u'deleted', u'progress': u'', u'launched_at': u'2016-10-31T21:54:53.000000', u'node': u'chilly-police.cord.lab', u'ramdisk_id': u'', u'access_ip_v6': None, u'disk_gb': 20, u'access_ip_v4': None, u'kernel_id': u'', u'host': u'compute.chilly-police', u'user_id': u'0eddb9bb412b4b2783fbdb04c7786fbd', u'image_ref_url': u'http://10.1.0.18:9292/images/8f2185b2-1669-46df-8a01-88b3abd88aa5', u'cell_name': u'', u'root_gb': 20, u'tenant_id': u'33dbef1a1442476b9c5935287df86f2c', u'created_at': u'2016-10-31 21:54:32+00:00', u'instance_id': u'1784a230-5038-46e9-9a2e-f96dabc1ea26', u'instance_type': u'm1.small', u'vcpus': 1, u'image_meta': {u'min_disk': u'20', u'container_format': u'bare', u'min_ram': u'0', u'disk_format': u'raw', u'base_image_ref': u'8f2185b2-1669-46df-8a01-88b3abd88aa5'}, u'architecture': None, u'os_type': None, u'instance_flavor_id': u'2'}, u'counter_type': u'gauge'}' Now I am able to do this by creating event_definitions.yaml ,event_pipeline.yaml as mentioned bt Ganpat and updating conf files: 1,ceilometer.conf: notification_topics = notifications [notification] store_events = True [event] drop_unmatched_notifications = False definitions_cfg_file = /etc/ceilometer/event_definitions.yaml With Best Regards Raghunath Dudyala Tata Consultancy Services Limited Mailto: raghunat...@tcs.com Website: http://www.tcs.com ____________________________________________ Experience certainty. IT Services Business Solutions Consulting ____________________________________________ -----gordon chung <g...@live.ca> wrote: ----- To: "openstack-dev@lists.openstack.org" <openstack-dev@lists.openstack.org> From: gordon chung <g...@live.ca> Date: 10/31/2016 09:54PM Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer ! what meters are you looking for specifically? as Ganpat mentioned, we only derive a few meters from Nova notifications[1]. i don't understand your comment about being able to see events on kafka. by 'events' do you mean Ceilometer Events[2]? [1] https://github.com/openstack/ceilometer/blob/master/ceilometer/meter/data/meters.yaml#L83-L127 [2] http://docs.openstack.org/developer/ceilometer/events.html On 31/10/16 04:27 AM, Raghunath D wrote: > Hi Ganpat, > > I want the samples related with these events. > > With Best Regards > Raghunath Dudyala > Tata Consultancy Services Limited > Mailto: raghunat...@tcs.com > Website: http://www.tcs.com > ____________________________________________ > Experience certainty. IT Services > Business Solutions > Consulting > ____________________________________________ > > > -----Ganpat Agarwal <gans.develo...@gmail.com> wrote: ----- > To: "OpenStack Development Mailing List (not for usage questions)" > <openstack-dev@lists.openstack.org> > From: Ganpat Agarwal <gans.develo...@gmail.com> > Date: 10/27/2016 12:02PM > Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and > deletion metrics in ceilometer ! > > Hi Raghunath, > > I am not able to understand your use case for compute.instance.* events. > > You are trying to catch the instance start and end events OR you want > the samples related with these events? > > Regards, > Ganpat > > On Wed, Oct 26, 2016 at 6:00 PM, Raghunath D <raghunat...@tcs.com > <mailto:raghunat...@tcs.com>> wrote: > > Hi Ganpat/Gord, > > Callback for compute.instance.create.end events under > ceilometer.compute.notifications should be invoked for those > notification events on the nova exchange using the > notifications.info <http://notifications.info> topic. > But this is not happening,we can see events related to them and can > receive events over kafka. > > I can see from logs which print my debug print during the loading of > notification plugin. > "2016-10-26 03:46:32.010 34977 INFO > ceilometer.compute.notifications.instance > [req-1ad3d5c9-5eab-404d-9fbe-f1605e93691f - - - - -] Check > ComputeInstanceNotificationBase notification:" > > ÿ Do we need to change any thing in the configuration file of > ÿ ÿ ceilometer or nova to achive this. > ÿ ÿ It would be great help for me if this is fixed. > > ÿ ÿ With Best Regards > ÿ ÿ Raghunath Dudyala > ÿ ÿ Tata Consultancy Services Limited > ÿ ÿ Mailto: raghunat...@tcs.com <mailto:raghunat...@tcs.com> > ÿ ÿ Website: http://www.tcs.com > ÿ ÿ ____________________________________________ > ÿ ÿ Experience certainty. IT Services > ÿ ÿ Business Solutions > ÿ ÿ Consulting > ÿ ÿ ____________________________________________ > > > ÿ ÿ -----Ganpat Agarwal <gans.develo...@gmail.com > ÿ ÿ <mailto:gans.develo...@gmail.com>> wrote: ----- > ÿ ÿ To: "OpenStack Development Mailing List (not for usage questions)" > ÿ ÿ <openstack-dev@lists.openstack.org > ÿ ÿ <mailto:openstack-dev@lists.openstack.org>> > ÿ ÿ From: Ganpat Agarwal <gans.develo...@gmail.com > ÿ ÿ <mailto:gans.develo...@gmail.com>> > ÿ ÿ Date: 10/25/2016 09:32PM > > ÿ ÿ Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and > ÿ ÿ deletion metrics in ceilometer ! > > ÿ ÿ Hi Raghunath, > > ÿ ÿ You can look at this file for details of meters related with > ÿ ÿ compute.instance.* > > ÿ ÿ ceilometer/meter/data/meters.yaml > > ÿ ÿ Additionally, you can look at this link for compute meters documentation > > ÿ ÿ http://docs.openstack.org/admin-guide/telemetry-measurements.html > ÿ ÿ <http://docs.openstack.org/admin-guide/telemetry-measurements.html> > > > ÿ ÿ Also, have a look at "Meters definitions" section on this link > > ÿ ÿ > http://docs.openstack.org/admin-guide/telemetry-data-collection.html#meter-definitions > ÿ ÿ > <http://docs.openstack.org/admin-guide/telemetry-data-collection.html#meter-definitions> > > ÿ ÿ Regards, > ÿ ÿ Ganpat > > > ÿ ÿ On Tue, Oct 25, 2016 at 5:45 PM, Raghunath D <raghunat...@tcs.com > ÿ ÿ <mailto:raghunat...@tcs.com>> wrote: > > ÿ ÿ ÿ ÿ Hi Ganpat, > > ÿ ÿ ÿ ÿ ÿAre you able to see merers/samples related to > ÿ ÿ ÿ ÿ compute.instance.* in ceilometer meter-list or ceilometer > ÿ ÿ ÿ ÿ sample-list. > ÿ ÿ ÿ ÿ My application which will read info from ceilometer publisher > ÿ ÿ ÿ ÿ (pipeline.yaml) and I am looking for meters realted to > ÿ ÿ ÿ ÿ ceilometer.instance.* > > ÿ ÿ ÿ ÿ With Best Regards > ÿ ÿ ÿ ÿ Raghunath Dudyala > ÿ ÿ ÿ ÿ Tata Consultancy Services Limited > ÿ ÿ ÿ ÿ Mailto: raghunat...@tcs.com <mailto:raghunat...@tcs.com> > ÿ ÿ ÿ ÿ Website: http://www.tcs.com > ÿ ÿ ÿ ÿ ____________________________________________ > ÿ ÿ ÿ ÿ Experience certainty. IT Services > ÿ ÿ ÿ ÿ Business Solutions > ÿ ÿ ÿ ÿ Consulting > ÿ ÿ ÿ ÿ ____________________________________________ > > > ÿ ÿ ÿ ÿ -----Ganpat Agarwal <gans.develo...@gmail.com > ÿ ÿ ÿ ÿ <mailto:gans.develo...@gmail.com>> wrote: ----- > ÿ ÿ ÿ ÿ To: "OpenStack Development Mailing List (not for usage > ÿ ÿ ÿ ÿ questions)" <openstack-dev@lists.openstack.org > ÿ ÿ ÿ ÿ <mailto:openstack-dev@lists.openstack.org>> > ÿ ÿ ÿ ÿ From: Ganpat Agarwal <gans.develo...@gmail.com > ÿ ÿ ÿ ÿ <mailto:gans.develo...@gmail.com>> > ÿ ÿ ÿ ÿ Date: 10/25/2016 05:05PM > ÿ ÿ ÿ ÿ Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and > ÿ ÿ ÿ ÿ deletion metrics in ceilometer ! > > > ÿ ÿ ÿ ÿ Hi, > > ÿ ÿ ÿ ÿ I am able to get event notifications on kafka by applying these > ÿ ÿ ÿ ÿ configurations: > > ÿ ÿ ÿ ÿ nova.conf > > ÿ ÿ ÿ ÿ instance_usage_audit = True > > ÿ ÿ ÿ ÿ instance_usage_audit_period = hour > > ÿ ÿ ÿ ÿ notify_on_state_change = vm_and_task_state > > ÿ ÿ ÿ ÿ notification_driver = messagingv2 > > > ÿ ÿ ÿ ÿ Restart nova compute service > > ÿ ÿ ÿ ÿ ceilometer.conf > > ÿ ÿ ÿ ÿ [event] > > ÿ ÿ ÿ ÿ drop_unmatched_notifications = False > > ÿ ÿ ÿ ÿ definitions_cfg_file = /etc/ceilometer/event_definitions.yaml > > > ÿ ÿ ÿ ÿ event_pipeline.yaml > > ÿ ÿ ÿ ÿ --- > > ÿ ÿ ÿ ÿ sources: > > ÿ ÿ ÿ ÿ ÿ ÿ - name: event_source > > ÿ ÿ ÿ ÿ ÿ ÿ ÿ events: > > ÿ ÿ ÿ ÿ ÿ ÿ ÿ ÿ ÿ- compute.instance.* > > ÿ ÿ ÿ ÿ ÿ ÿ ÿ sinks: > > ÿ ÿ ÿ ÿ ÿ ÿ ÿ ÿ ÿ - event_sink > > ÿ ÿ ÿ ÿ sinks: > > ÿ ÿ ÿ ÿ ÿ ÿ - name: event_sink > > ÿ ÿ ÿ ÿ ÿ ÿ ÿ transformers: > > ÿ ÿ ÿ ÿ ÿ ÿ ÿ triggers: > > ÿ ÿ ÿ ÿ ÿ ÿ ÿ publishers: > > ÿ ÿ ÿ ÿ ÿ ÿ ÿ ÿ ÿ #- notifier:// > > ÿ ÿ ÿ ÿ ÿ ÿ ÿ ÿ ÿ #- > ÿ ÿ ÿ ÿ file:///home/stack/test?max_bytes=10000000&backup_count=5 > > ÿ ÿ ÿ ÿ ÿ ÿ ÿ ÿ ÿ - kafka://kafka-broker:9092?topic=ceilometer > > > ÿ ÿ ÿ ÿ service ceilometer-api restart > > ÿ ÿ ÿ ÿ service ceilometer-agent-notification restart > > > ÿ ÿ ÿ ÿ Wait for couple of minutes and you should be getting the events > ÿ ÿ ÿ ÿ on your kafka consumer and in ceilometer notifications logs as well > > ÿ ÿ ÿ ÿ tail -f /var/log/ceilometer/ceilometer-agent-notification.log > > > ÿ ÿ ÿ ÿ Let me know if it helps. > > > ÿ ÿ ÿ ÿ Regards, > > ÿ ÿ ÿ ÿ Ganpat > > > > ÿ ÿ ÿ ÿ On Tue, Oct 25, 2016 at 3:02 PM, Raghunath D > ÿ ÿ ÿ ÿ <raghunat...@tcs.com <mailto:raghunat...@tcs.com>> wrote: > > ÿ ÿ ÿ ÿ ÿ ÿ Hi , > > ÿ ÿ ÿ ÿ ÿ ÿ Can some one please suggest how to instance notifications in > ÿ ÿ ÿ ÿ ÿ ÿ ceilometer. > > ÿ ÿ ÿ ÿ ÿ ÿ With Best Regards > ÿ ÿ ÿ ÿ ÿ ÿ Raghunath Dudyala > ÿ ÿ ÿ ÿ ÿ ÿ Tata Consultancy Services Limited > ÿ ÿ ÿ ÿ ÿ ÿ Mailto: raghunat...@tcs.com <mailto:raghunat...@tcs.com> > ÿ ÿ ÿ ÿ ÿ ÿ Website: http://www.tcs.com > ÿ ÿ ÿ ÿ ÿ ÿ ____________________________________________ > ÿ ÿ ÿ ÿ ÿ ÿ Experience certainty. IT Services > ÿ ÿ ÿ ÿ ÿ ÿ Business Solutions > ÿ ÿ ÿ ÿ ÿ ÿ Consulting > ÿ ÿ ÿ ÿ ÿ ÿ ____________________________________________ > > > ÿ ÿ ÿ ÿ ÿ ÿ -----Raghunath D/HYD/TCS wrote: ----- > ÿ ÿ ÿ ÿ ÿ ÿ To: openstack-dev@lists.openstack.org > ÿ ÿ ÿ ÿ ÿ ÿ <mailto:openstack-dev@lists.openstack.org> > ÿ ÿ ÿ ÿ ÿ ÿ From: Raghunath D/HYD/TCS > ÿ ÿ ÿ ÿ ÿ ÿ Date: 10/18/2016 08:01PM > ÿ ÿ ÿ ÿ ÿ ÿ Subject: [openstack-dev] [Ceilometer]: Instance creation and > ÿ ÿ ÿ ÿ ÿ ÿ deletion metrics in ceilometer ! > > > ÿ ÿ ÿ ÿ ÿ ÿ Hi , > > ÿ ÿ ÿ ÿ ÿ ÿ How can instance created and deleted information/sample can > ÿ ÿ ÿ ÿ ÿ ÿ be retrieved from ceilometer. > ÿ ÿ ÿ ÿ ÿ ÿ What entries should be there in pipeline.yaml ÿto get > ÿ ÿ ÿ ÿ ÿ ÿ instance deleted information. > > ÿ ÿ ÿ ÿ ÿ ÿ I tried to have meters- "instance" in pipeline.yam but it > ÿ ÿ ÿ ÿ ÿ ÿ always gives active instance details, > ÿ ÿ ÿ ÿ ÿ ÿ and no details of deleted instances. > > ÿ ÿ ÿ ÿ ÿ ÿ With Best Regards > ÿ ÿ ÿ ÿ ÿ ÿ Raghunath Dudyala > ÿ ÿ ÿ ÿ ÿ ÿ Tata Consultancy Services Limited > ÿ ÿ ÿ ÿ ÿ ÿ Mailto: raghunat...@tcs.com <mailto:raghunat...@tcs.com> > ÿ ÿ ÿ ÿ ÿ ÿ Website: http://www.tcs.com > ÿ ÿ ÿ ÿ ÿ ÿ ____________________________________________ > ÿ ÿ ÿ ÿ ÿ ÿ Experience certainty. IT Services > ÿ ÿ ÿ ÿ ÿ ÿ Business Solutions > ÿ ÿ ÿ ÿ ÿ ÿ Consulting > ÿ ÿ ÿ ÿ ÿ ÿ ____________________________________________ > > ÿ ÿ ÿ ÿ ÿ ÿ =====-----=====-----===== > ÿ ÿ ÿ ÿ ÿ ÿ Notice: The information contained in this e-mail > ÿ ÿ ÿ ÿ ÿ ÿ message and/or attachments to it may contain > ÿ ÿ ÿ ÿ ÿ ÿ confidential or privileged information. If you are > ÿ ÿ ÿ ÿ ÿ ÿ not the intended recipient, any dissemination, use, > ÿ ÿ ÿ ÿ ÿ ÿ review, distribution, printing or copying of the > ÿ ÿ ÿ ÿ ÿ ÿ information contained in this e-mail message > ÿ ÿ ÿ ÿ ÿ ÿ and/or attachments to it are strictly prohibited. If > ÿ ÿ ÿ ÿ ÿ ÿ you have received this communication in error, > ÿ ÿ ÿ ÿ ÿ ÿ please notify us by reply e-mail or telephone and > ÿ ÿ ÿ ÿ ÿ ÿ immediately and permanently delete the message > ÿ ÿ ÿ ÿ ÿ ÿ and any attachments. Thank you > > > ÿ ÿ ÿ ÿ ÿ ÿ > __________________________________________________________________________ > ÿ ÿ ÿ ÿ ÿ ÿ OpenStack Development Mailing List (not for usage questions) > ÿ ÿ ÿ ÿ ÿ ÿ Unsubscribe: > ÿ ÿ ÿ ÿ ÿ ÿ openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > <http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> > ÿ ÿ ÿ ÿ ÿ ÿ http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > ÿ ÿ ÿ ÿ ÿ ÿ > <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev> > > > ÿ ÿ ÿ ÿ > __________________________________________________________________________ > ÿ ÿ ÿ ÿ OpenStack Development Mailing List (not for usage questions) > ÿ ÿ ÿ ÿ Unsubscribe: > ÿ ÿ ÿ ÿ openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > ÿ ÿ ÿ ÿ <http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> > ÿ ÿ ÿ ÿ > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-devÿ<http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev> > > ÿ ÿ ÿ ÿ > __________________________________________________________________________ > ÿ ÿ ÿ ÿ OpenStack Development Mailing List (not for usage questions) > ÿ ÿ ÿ ÿ Unsubscribe: > ÿ ÿ ÿ ÿ openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > ÿ ÿ ÿ ÿ <http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> > ÿ ÿ ÿ ÿ > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-devÿ<http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev> > > > ÿ ÿ __________________________________________________________________________ > ÿ ÿ OpenStack Development Mailing List (not for usage questions) > ÿ ÿ Unsubscribe: > ÿ ÿ openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > ÿ ÿ <http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> > ÿ ÿ http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > ÿ ÿ <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev> > > ÿ ÿ __________________________________________________________________________ > ÿ ÿ OpenStack Development Mailing List (not for usage questions) > ÿ ÿ Unsubscribe: > ÿ ÿ openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > ÿ ÿ <http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> > ÿ ÿ http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > ÿ ÿ <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev> > > > __________________________________________________________________________ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > > __________________________________________________________________________ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > -- gord __________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
__________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
