[ceph-users] Replication

Hi All, I have a four node ceph storage cluster. By default all the storage objects are replicated in Ceph. My installation consists of three OSDs. If I create some volumes as block devices in ceph and write some data onto it, how to verify or test that the data is replicated ? Is it by stoppi

[ceph-users] Information

Hi All, I need a diagram or a pictorial representation of some sort which outlines the relationship among ceph components like OSD, Pools, PG etc. Also let me know if Inktank conducts any trainings for certification on Ceph. Thanks Kumar This message is for

[ceph-users] Storage

Hi All, I have a ceph storage cluster with four nodes. I have created block storage using cinder in openstack and ceph as its storage backend. So, I see a volume is created in ceph in one of the pools. But how to get information like on which OSD, PG, the volume is created in ? Thanks Kumar

[ceph-users] Storage

Hi All, I have a ceph storage cluster with four nodes. I have created block storage using cinder in openstack and ceph as its storage backend. So, I see a volume is created in ceph in one of the pools. But how to get information like on which OSD, PG, the volume is created in ? Thanks Kumar

[ceph-users] Health

Hi All, I have a four node ceph cluster. But the command ceph -s shows health warning. How should I safely synchronize time across the nodes. The OS platform is Ubuntu. --- root@cephadmin:/home/oss# ceph -s cluster 9acd33d7-759b-45f4-b48f-a4682fd6c674 health HEALTH_WARN clock

[ceph-users] Ceph issue

Hi All, I have four node ceph cluster. I have another three node setup for openstack. I have integrated Ceph with openstack. Whenever I try to create storage with ceph as storage backend for the openstack vm, the creation process goes on forever in the horizon dashboard. It never completes.

[ceph-users] Cannot attach volumes

Hi All, I have four node ceph cluster. I have another three node setup for openstack. I have integrated Ceph with openstack. Whenever I try to create storage with ceph as storage backend for the openstack vm, the creation process goes on forever in the horizon dashboard. It never completes.

Re: [ceph-users] Cannot attach volumes

Hi Karan, I have checked the cinder logs but could not find anything suspicious. Thanks Kumar From: Karan Singh [mailto:karan.si...@csc.fi] Sent: Tuesday, June 10, 2014 3:14 PM To: Gnan Kumar, Yalla Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Cannot attach volumes Hi Kumar "Clock

[ceph-users] Monitor down

I have a four node ceph storage cluster. Ceph -s is showing one monitor as down . How to start it and in which server do I have to start it ? --- root@cephadmin:/home/oss# ceph -w cluster 9acd33d7-759b-45f4-b48f-a4682fd6c674 health HEALTH_WARN 1 mons down, quorum 0,1 cephno

[ceph-users] Unable to remove mds

Hi All, I have a four node ceph cluster. The metadata service is showing as degraded in health. How to remove the mds service from ceph ? =- root@cephadmin:/home/oss# ceph -s cluster 9acd33d7-759b-45f4-b48f-a4682fd6c674 health HEALTH_WARN mds cluster is degraded monmap

[ceph-users] Striping

Hi All, I have a ceph cluster. If a user wants just striping or distributed or replicated storages , can we provide these types of storages exclusively ? Thanks Kumar This message is for the designated recipient only and may contain privileged, proprietar

[ceph-users] OSDs

Hi All, Upto how many OSD failures can ceph tolerate ? Thanks Kumar This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender im

[ceph-users] Unable to add monitor nodes

Hi, I am new user of ceph. I have installed a three node cluster following the ceph document. I have added OSDs and initial monitor. But while adding additional monitors, I am receiving this error as shown below. user1@cephadmin:~/my-cluster$ ceph-deploy

Re: [ceph-users] Unable to add monitor nodes

Hi, Now I am integrating ceph with openstack. I have installed openstack . Now to test ceph, how do I create a ceph block device and store the sample cirrOS image in it and use it for booting VMs ? Thanks Kumar -Original Message- From: Alfredo Deza [mailto:alfredo.d...@inktank.co

Re: [ceph-users] Unable to add monitor nodes

Hi, I want to implement two scenarios: --- 1. Store the sample cirrOS image in ceph block device and use it to boot the VMs. 2. Use the ceph block device as a volume and attach it to the VMs. Thanks Kumar -Original Message- From: Gnan Kumar, Yalla Sent: Wednesday, Febr

[ceph-users] Unable top start instance in openstack

Hi, I have followed the link http://ceph.com/docs/master/rbd/rbd-openstack/ and configured ceph with openstack. But when I try to launch instances, they are going into Error state. I have found the below log in the controller node of openstack: --- injection_path = image(\'disk\').

Re: [ceph-users] Unable to add monitor nodes

Hi Karan, Thank you very much for the reply. Unfortunately I am unable to access the blogspot link. The second link deals with KVM in general. But I have installed Havana openstack. Could you please send me the list of steps to configure Openstack to use the rados block device both as a volum

Re: [ceph-users] Unable to add monitor nodes

Hi Karan, Moreover my openstack setup consist of three nodes with three services each on all the nodes. Controller node : Keystone, Nova service, Horizon Compute node: Nova-compute, Glance and Cinder. Neutron node: Mysql, RabbitMQ, Neutron service. Thanks Kumar From: Gnan Kumar, Yalla Sent:

Re: [ceph-users] Unable to add monitor nodes

Hi Alfred, Could you please let me know how to integrate openstack with ceph and test it . The existing document seems to be incomplete. Thanks Kumar From: Karan Singh [mailto:karan.si...@csc.fi] Sent: Wednesday, February 19, 2014 2:23 PM To: Gnan Kumar, Yalla Cc: alfredo.d...@inktank.com; cep

Re: [ceph-users] Unable to add monitor nodes

Hi Karan, I have followed your document and integrated Openstack Havana with ceph. But I am unable to attach the ceph volume to the instance. --- root@compute:/usr# virsh attach-device instance-0030 /usr/disk.xml error: Failed to attach device from /usr/disk.xml error: operation f

Re: [ceph-users] Unable to add monitor nodes

Hi All, Can anyone help me with this issue ? Thanks Kumar From: Gnan Kumar, Yalla Sent: Monday, February 24, 2014 4:33 PM To: 'Karan Singh' Cc: ceph-users Subject: RE: [ceph-users] Unable to add monitor nodes Hi Karan, I have followed your document and integrated Openstack Havana with ceph.

[ceph-users] storage

Hi All, By default in which directory/directories, does ceph store the block device files ? Is it in the /dev or other filesystem ? Thanks Kumar This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidenti

Re: [ceph-users] storage

Thanks Sebastien. -Original Message- From: Sebastien Han [mailto:sebastien@enovance.com] Sent: Tuesday, February 25, 2014 8:23 PM To: Gnan Kumar, Yalla Cc: ceph-users Subject: Re: [ceph-users] storage Hi, RBD blocks are stored as objects on a filesystem usually under: /var/lib/cep

[ceph-users] Remove volume

Hi All, I have ceph installed on Ubuntu nodes. At present I have the following volumes in Volumes pool: - root@compute:/home/oss# rbd -p volumes ls volume-53f0dc29-956f-48f1-8db1-b0f9c1b0e9f1 volume-55abf0d4-01a7-41d0-9e7e-407ad0db213c volume-a73d1bd0-2937-41c4-bbca-2545454eefac volume-bd

Re: [ceph-users] Remove volume

Hi Jean, Thanks a lot. I have the following images in ' images' pool: root@compute:/home/oss# rbd -p images ls 0c605116-0634-4aed-9b3f-12d9483cd38a 9f1a5bdc-3450-4934-99b3-d1b834ad9592 b16aac0e-621f-4f36-a027-39c86d28011f When I try deleting them I get this error: -- root@comp

Re: [ceph-users] Remove volume

Hi Jean, I have deleted all images from openstack. Glance list has no images. root@compute:/home/oss# rbd -p images snap ls 0c605116-0634-4aed-9b3f-12d9483cd38a SNAPID NAME SIZE 2 snap 12839 kB root@compute:/home/oss# rbd -p images snap purge 0c605116-0634-4aed-9b3f-12d9483cd

Re: [ceph-users] Remove volume

Hi All, Any ideas ? As a temporary necessity , I have deleted the entire 'images' pool. How to delete individual images ? Thanks Kumar From: Gnan Kumar, Yalla Sent: Thursday, March 13, 2014 12:48 PM To: 'Jean-Charles Lopez' Cc: ceph-users@lists.ceph.com Subject: RE: [ceph-users] Remove volume

Re: [ceph-users] Remove volume

Hi All, I have deleted the pool and created a fresh images pool. I am unable to delete the existing image. - root@compute:/home/oss# rbd -p images rm c6dbff15-9ea7-4870-92f2-15de1bdd1150 2014-03-13 09:08:08.076116 7f06b1bc0780 -1 librbd: image has snapshots - not removing Removing

[ceph-users] Remove ceph

Hi All, I have a ceph cluster with four nodes including the admin node. I have integrated it with openstack. Now, if I create volumes or boot up a VM for volumes, it creates the block storage in Ceph. One of the openstack node acts as ceph client. Now I want to remove ceph from openstack . Wh

Re: [ceph-users] Remove ceph

Hi All, Can anyone let me know how to accomplish this ? Thanks Kumar From: Gnan Kumar, Yalla Sent: Friday, March 21, 2014 5:04 PM To: 'ceph-users@lists.ceph.com' Subject: Remove ceph Hi All, I have a ceph cluster with four nodes including the admin node. I have integrated it with openstack

[ceph-users] Information needed

Hi All, I have created a ceph volume in a pool which I have defined. A hard drive is also attached to the ceph node. How do we know on which hard drive ceph created this volume on ? What is its path ? Thanks Kumar This message is for the designated recipie

[ceph-users] RAID implementation.

Hi All, I have setup a three node ceph storage cluster on Ubunut. I want to implement RAID 5, RAID 1 and RAID 1+0 volumes using ceph. Any information or link providing information on this will help a lot. Thanks Kumar This message is for the designated recipie

[ceph-users] Performance stats

Hi All, Is there a way by which we can measure the performance of Ceph block devices ? (Example : I/O stats, data to identify bottlenecks etc). Also what are the available ways in which we can compare Ceph storage performance with other storage solutions ? Thanks Kumar _

[ceph-users] Performance stats

Hi All, Is there a way by which we can measure the performance of Ceph block devices ? (Example : I/O stats, data to identify bottlenecks etc). Also what are the available ways in which we can compare Ceph storage performance with other storage solutions ? Thanks Kumar

Re: [ceph-users] Performance stats

Hi, Thanks for the reply. I need an FIO installation file for Ubuntu platform and also could you send any links for examples and documentation. Thanks Kumar From: Jean-Charles LOPEZ [mailto:jc.lo...@inktank.com] Sent: Thursday, May 15, 2014 12:40 PM To: Gnan Kumar, Yalla Cc: LOPEZ Jean-Charles

[ceph-users] Information needed

Hi All, What are the kinds of raid levels of storage provided by Ceph block devices ? Thanks Kumar This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in err

Re: [ceph-users] raid levels (Information needed)

Hi Jerker, Thanks for the reply. The link you posted describes only object storage. I need information of raid levels implementation for block devices. Thanks Kumar -Original Message- From: Jerker Nyberg [mailto:jer...@update.uu.se] Sent: Friday, May 16, 2014 2:43 PM To: Gnan Kumar,

[ceph-users] Erasure coding

Hi All, What exactly is erasure coding and why is it used in ceph ? I could not get enough explanatory information from the documentation. Thanks Kumar This message is for the designated recipient only and may contain privileged, proprietary, or otherwise con

Re: [ceph-users] Erasure coding

Hi Loic, Thanks for the reply. Thanks Kumar -Original Message- From: Loic Dachary [mailto:l...@dachary.org] Sent: Monday, May 19, 2014 6:04 PM To: Gnan Kumar, Yalla; ceph-users@lists.ceph.com Subject: Re: [ceph-users] Erasure coding Hi, The general idea to preserve resilience but sa

Re: [ceph-users] Erasure coding

Hi John, Thanks for the reply. It seems that to understand the internal mechanism and the algorithmic structure of ceph, knowledge of Information theory is necessary ☺. Thanks Kumar From: John Wilkins [mailto:john.wilk...@inktank.com] Sent: Monday, May 19, 2014 10:18 PM To: Gnan Kumar, Yalla