Re: [ceph-users] ceph benchmark

2016-06-16 Thread Karan Singh
Agree with David Its being cached , you can try - oflag options for dd - monitor system cache during dd - Karan - On Fri, Jun 17, 2016 at 1:58 AM, David wrote: > I'm probably misunderstanding the question but if you're getting 3GB/s > from your dd, you're already caching. Can you provide some

Re: [ceph-users] osd not removed from crush map after ceph osd crush remove

2016-02-23 Thread Karan Singh
Dimitar Is it fixed ? - is your cluster pool size is 2 - you can consider running ceph pg repair {pgid} or ceph osd lost 4 ( this is a bit dangerous command ) Karan Singh Systems Specialist , Storage Platforms CSC - IT Center

Re: [ceph-users] Help: pool not responding

2016-02-15 Thread Karan Singh
Hey Mario Agreed to Ferhat. Recheck your network ( bonds , interfaces , network switches , even cables ) I have seen this several times before and in most of the cases its because of network. BTW are you using Mellanox ? - Karan - > On 15 Feb 2016, at 10:12, Mario Giammarco wrote: > > kouko

Re: [ceph-users] Using straw2 crush also with Hammer

2015-11-13 Thread Karan Singh
> On 11 Nov 2015, at 22:49, David Clarke wrote: > > On 12/11/15 09:37, Gregory Farnum wrote: >> On Wednesday, November 11, 2015, Wido den Hollander > > wrote: >> >>On 11/10/2015 09:49 PM, Vickey Singh wrote: >>> On Mon, Nov 9, 2015 at 8:16 PM, Wido den Hollander >

[ceph-users] Several OSD's Crashed : unable to bind to any port in range 6800-7300: (98) Address already in use

2015-08-11 Thread Karan Singh
ernel : 2.6.32-431.el6.x86_64 CentOS release 6.5 (Final) I have 4 OSD nodes but just 2 of them has shown this error I have reported this under http://tracker.ceph.com/issues/12655 <http://tracker.ceph.com/issues/12655> **** Karan

Re: [ceph-users] Did maximum performance reached?

2015-07-28 Thread Karan Singh
Hi What type of clients do you have. - Are they Linux physical OR VM mounting Ceph RBD or CephFS ?? - Or they are simply openstack / cloud instances using Ceph as cinder volumes or something like that ?? - Karan - > On 28 Jul 2015, at 11:53, Shneur Zalman Mattern wrote: > > We've built Ceph

Re: [ceph-users] Anyone using Ganesha with CephFS?

2015-06-23 Thread Karan Singh
Hi Yes i have been using it under one of our test systems , but have not done any rigorous tests. Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keilaranta 14, P. O. Box 405, FIN-02101 Espoo

Re: [ceph-users] what's the difference between pg and pgp?

2015-05-22 Thread Karan Singh
rebalancing. Now, when you increase the pgp_num value for the same pool, PGs start to migrate from the parent to some other OSD, and cluster rebalancing starts. This is how PGP plays an important role. Karan Singh Systems Specialist

Re: [ceph-users] Can not access the Ceph's main page ceph.com intermittently

2015-04-30 Thread Karan Singh
Hi Wenjun Are you sure , is everything all right at your end. ceph.com <http://ceph.com/> seems to be working fine for me from Finland **** Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keilara

Re: [ceph-users] about rgw region and zone

2015-04-28 Thread Karan Singh
You should try to create a new user without —system option so basically create a normal user , then create some bucket and object and finally try to resync cluster. Karan Singh Systems Specialist , Storage Platforms CSC - IT

Re: [ceph-users] about rgw region and zone

2015-04-28 Thread Karan Singh
Hi > On 28 Apr 2015, at 07:12, TERRY <316828...@qq.com> wrote: > > Hi: all > > when I Configuring Federated Gateways, I got the error as below: > > sudo radosgw-agent -c /etc/ceph/ceph-data-sync.conf > ERROR:root:Could not retrieve region map from destination You should check that t

Re: [ceph-users] Radosgw: upgrade Firefly to Hammer, impossible to create bucket

2015-04-13 Thread Karan Singh
Also what version of s3cmd you are using ?? To me the error “S3 error: 403 (SignatureDoesNotMatch)” seems to be from s3cmd side rather RGW. But lets diagnose. Karan Singh Systems Specialist , Storage Platforms CSC - IT Center

Re: [ceph-users] Radosgw: upgrade Firefly to Hammer, impossible to create bucket

2015-04-13 Thread Karan Singh
You can give a try with swift API as well. Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keilaranta 14, P. O. Box 405, FIN-02101 Espoo, Finland mobile: +358 503 812758 tel. +358 9 4572001 fax +358

Re: [ceph-users] Radosgw: upgrade Firefly to Hammer, impossible to create bucket

2015-04-13 Thread Karan Singh
-radosgw1 FQDN . ostore.athome.priv looks like a different host to me. host_base->ostore.athome.priv host_bucket->%(bucket)s.ostore.athome.priv **** Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keil

Re: [ceph-users] Ceph and Openstack

2015-04-02 Thread Karan Singh
Geddes If you are still struggling with this , ping me in IRC #CEPH ( ksingh ) Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keilaranta 14, P. O. Box 405, FIN-02101 Espoo, Finland mobile: +358

Re: [ceph-users] Ceph and Openstack

2015-04-02 Thread Karan Singh
/python2.7/site-packages/oslo/config/cfg.py:2004 If Cinder and Glance are able to initialize RBD driver , then everything should work like charm. ******** Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keilar

Re: [ceph-users] Production Ceph :: PG data lost : Cluster PG incomplete, inactive, unclean

2015-04-01 Thread Karan Singh
# ceph pg 3.7d0 query http://paste.ubuntu.com/10720107/ <http://paste.ubuntu.com/10720107/> - Karan - > On 20 Mar 2015, at 22:43, Craig Lewis wrote: > > > osdmap e261536: 239 osds: 239 up, 238 in > > Why is that last OSD not IN? The history you need is probably t

Re: [ceph-users] Migrating objects from one pool to another?

2015-03-27 Thread Karan Singh
. Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keilaranta 14, P. O. Box 405, FIN-02101 Espoo, Finland mobile: +358 503 812758 tel. +358 9 4572001 fax +358 9 4572302 http://www.csc.fi

[ceph-users] Production Ceph :: PG data lost : Cluster PG incomplete, inactive, unclean

2015-03-20 Thread Karan Singh
Hello Guys My CEPH cluster lost data and not its not recovering. This problem occurred when Ceph performed recovery when one of the node was down. Now all the nodes are up but Ceph is showing PG as incomplete , unclean , recovering. I have tried several things to recover them like , scrub , d

[ceph-users] Production Ceph :: PG data lost : Cluster PG incomplete, inactive, unclean

2015-03-20 Thread Karan Singh
Hello Guys My CEPH cluster lost data and not its not recovering. This problem occurred when Ceph performed recovery when one of the node was down. Now all the nodes are up but Ceph is showing PG as incomplete , unclean , recovering. I have tried several things to recover them like , scrub , d

Re: [ceph-users] Ceph BIG outage : 200+ OSD are down , OSD cannot create thread

2015-03-11 Thread Karan Singh
a good hint, on the other hand it >> also may confuse people, since changing this setting is not required for >> common hardware. > > If we make it warn only if it reaches > 50% of the threshold that is > probably safe... > > sage > > >> >>

Re: [ceph-users] ceph days

2015-03-11 Thread Karan Singh
Check out ceph youtube page. - Karan - > On 11 Mar 2015, at 00:45, Tom Deneau wrote: > > Are the slides or videos from ceph days presentations made available > somewhere? I noticed some links in the Frankfurt Ceph day, but not for the > other Ceph Days. > > -- Tom > > > > _

Re: [ceph-users] Ceph BIG outage : 200+ OSD are down , OSD cannot create thread

2015-03-09 Thread Karan Singh
in the cluster, which I think > has triggered your problem. > > Set the "kernel.pid_max" setting to 4194303 (the maximum) like Azad > Aliyar suggested, and the problem should be gone. > > Regards, > Christian > > Am 09.03.2015 11:41, schrieb Karan Singh: &g

[ceph-users] Ceph BIG outage : 200+ OSD are down , OSD cannot create thread

2015-03-09 Thread Karan Singh
t Ceph Tracker Issue : http://tracker.ceph.com/issues/10988#change-49018 <http://tracker.ceph.com/issues/10988#change-49018> ******** Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keilaranta 14, P. O

Re: [ceph-users] Ceph Dumpling/Firefly/Hammer SSD/Memstore performance comparison

2015-02-17 Thread Karan Singh
Thanks Mark , for a superb explanation . This is indeed very useful. Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keilaranta 14, P. O. Box 405, FIN-02101 Espoo, Finland mobile: +358 503 812758 tel

Re: [ceph-users] Introducing "Learning Ceph" : The First ever Book on Ceph

2015-02-13 Thread Karan Singh
Here is the new link for sample book : https://www.dropbox.com/s/2zcxawtv4q29fm9/Learning_Ceph_Sample.pdf?dl=0 <https://www.dropbox.com/s/2zcxawtv4q29fm9/Learning_Ceph_Sample.pdf?dl=0> **** Karan Singh Systems Specialist , S

[ceph-users] Introducing "Learning Ceph" : The First ever Book on Ceph

2015-02-12 Thread Karan Singh
would like it and surely will learn a lot from it. Amazon : http://www.amazon.com/Learning-Ceph-Karan-Singh/dp/1783985623/ref=sr_1_1?s=books&ie=UTF8&qid=1423174441&sr=1-1&keywords=ceph <http://www.amazon.com/Learning-Ceph-Karan-Singh/dp/1783985623/ref=sr_1_1?s=books&ie=UTF

[ceph-users] Introducing "Learning Ceph" : The First ever Book on Ceph

2015-02-06 Thread Karan Singh
would like it and surely will learn a lot from it. Amazon : http://www.amazon.com/Learning-Ceph-Karan-Singh/dp/1783985623/ref=sr_1_1?s=books&ie=UTF8&qid=1423174441&sr=1-1&keywords=ceph <http://www.amazon.com/Learning-Ceph-Karan-Singh/dp/1783985623/ref=sr_1_1?s=books&ie=UTF

Re: [ceph-users] Help with Integrating Ceph with various Cloud Storage

2014-12-17 Thread Karan Singh
. Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keilaranta 14, P. O. Box 405, FIN-02101 Espoo, Finland mobile: +358 503 812758 tel. +358 9 4572001 fax +358 9 4572302 http://www.csc.fi/ On 17 Dec 2014, at

Re: [ceph-users] can not add osd

2014-12-16 Thread Karan Singh
Hi You logs does not provides much information , if you are following any other documentation for Ceph , i would recommend you to follow official Ceph docs. http://ceph.com/docs/master/start/quick-start-preflight/ Karan Singh

[ceph-users] Setting up Ceph calamari :: Made Simple

2014-09-24 Thread Karan Singh
Hello Cepher’s Now here comes my new blog on setting up Ceph Calamari. I hope you would like this step-by-step guide http://karan-mj.blogspot.fi/2014/09/ceph-calamari-survival-guide.html - Karan - ___ ceph-users mailing list ceph-users@lists.ceph.

Re: [ceph-users] Cache tier unable to auto flush data to storage tier

2014-09-14 Thread Karan Singh
ed relatively to target_max_bytes and > target_max_objects. The first threshold reached will trigger flush or > eviction (num objects or num bytes) > > JC > > > > On Sep 13, 2014, at 15:23, Karan Singh wrote: > >> Hello Cephers >> >> I have crea

[ceph-users] Cache tier unable to auto flush data to storage tier

2014-09-13 Thread Karan Singh
-pool cache-flush-evict-all file1 [root@ceph-node1 ~]# [root@ceph-node1 ~]# rados -p data ls file1 [root@ceph-node1 ~]# rados -p cache-pool ls [root@ceph-node1 ~]# Regards Karan Singh ___ ceph-users mailing list ceph-users@lists.ceph.com http

[ceph-users] Unable to create swift type sub user in Rados Gateway :: Ceph Firefly 0.85

2014-08-28 Thread Karan Singh
key": "tCWCXrlGWAx\/kVjO\/Vqsqn1BflaLyAbzS7t7uM4N"}], "swift_keys": [ { "user": "csc:swift", "secret_key": "secretkey"}], "caps": [], "op_mask": "read, write, delete", "default_

Re: [ceph-users] wired output of ceph df : Firefly 0.80.5

2014-08-12 Thread Karan Singh
osdmap e194215: 402 osds: 402 up, 402 in pgmap v743051: 31168 pgs, 22 pools, 8 EB data, 378 kobjects 17508 GB used, 1284 TB / 1301 TB avail 31168 active+clean - Karan Singh - On 12 Aug 2014, at 16:45, Karan Singh wrote: > Hello Developers > > I ha

[ceph-users] wired output of ceph df : Firefly 0.80.5

2014-08-12 Thread Karan Singh
-p cache-pool ls # Is this a bug , if yes , then is is already known. Do you want me to raise a bug ticket in tracker.ceph.com ? Karan Singh Cloud computing group CSC - IT Center for Science, Keilaranta

Re: [ceph-users] Issues with installing 2 node system

2014-08-12 Thread Karan Singh
Try to add proxy settings in wgetrc file (/etc/wgetrc) and rpm macros (/etc/rpm/macros) # cat /etc/wgetrc | grep -i proxy #https_proxy = http://proxy.yoyodyne.com:18023/ http_proxy = : #ftp_proxy = http://proxy.yoyodyne.com:18023/ # If you do not want to use proxy at all, set this to off. use_pr

Re: [ceph-users] HEALTH_WARN 4 pgs incomplete; 4 pgs stuck inactive; 4 pgs stuck unclean

2014-08-12 Thread Karan Singh
rule rbd { > ruleset 2 > type replicated > min_size 1 > max_size 10 > step take default > step chooseleaf firstn 0 type host > step emit > } > > # end crush map > > root@ceph-admin-storage:~# ceph osd dump | grep -i pool > pool 0 &#

Re: [ceph-users] Fobidden 403 and fail to create subuser key when use radosgw

2014-08-12 Thread Karan Singh
For your item number 3 , can you try : Removing the keys for sub user ( testuser:swf0001 ) Once Key is removed for sub user , try recreating the key [ # radosgw-admin key create --subuser=testuser:swf0001 --key-type=swift --gen-secret ] - Karan - On 12 Aug 2014, at 11:26, debian Only wro

Re: [ceph-users] HEALTH_WARN 4 pgs incomplete; 4 pgs stuck inactive; 4 pgs stuck unclean

2014-08-12 Thread Karan Singh
Can you provide your cluster’s ceph osd dump | grep -i pooland crush map output. - Karan - On 12 Aug 2014, at 10:40, Riederer, Michael wrote: > Hi all, > > How do I get my Ceph Cluster back to a healthy state? > > root@ceph-admin-storage:~# ceph -v > ceph version 0.80.5 (38b73c67d375a2

Re: [ceph-users] Can't start OSD

2014-08-08 Thread Karan Singh
Try to make these OSD IN ceph osd in osd.12 osd.13 osd.14 osd.15 Then restart osd services - Karan Singh - On 08 Aug 2014, at 00:55, O'Reilly, Dan wrote: > # idweight type name up/down reweight > -1 7.2 root default > -2 1.8 host tm

Re: [ceph-users] ceph rbd volume can't remove because image still has watchers

2014-08-07 Thread Karan Singh
Make sure the volume "volume-17d9397b-d6e5-45e0-80fa-4bc7b7998842” does no have a snapshot or cloned linked to it , it might sometimes cause problems while deletion. - Karan Singh On 07 Aug 2014, at 08:55, 杨万元 wrote: > Hi all: > we use ceph rbd with openstack ,recently the

Re: [ceph-users] OSD weight 0

2014-07-28 Thread Karan Singh
other clues. - Karan Singh - On 25 Jul 2014, at 12:49, Kapil Sharma wrote: > Hi, > > I am using ceph-deploy to deploy my cluster. Whenever I try to add more > than one osd in a node, except the first osd, all the other osds get a > weight of 0, and they are in a state of down a

Re: [ceph-users] firefly osds stuck in state booting

2014-07-28 Thread Karan Singh
The output that you have provided says that OSDs are not IN , Try the below ceph osd in osd.0 ceph osd in osd.1 service ceph start osd.0 service ceph start osd.1 If you have 1 more host with 1 disk , add it , starting Ceph Firefly default rep size is 3 - Karan - On 27 Jul 2014, at 11:17, 10

Re: [ceph-users] Could not find module rbd. CentOs 6.4

2014-07-28 Thread Karan Singh
Yes you can use other features like CephFS and Object Store on this kernel release that you are running. - Karan Singh On 28 Jul 2014, at 07:45, Pratik Rupala wrote: > Hi Karan, > > I have basic setup of Ceph storage cluster in active+clean state on Linux > kernel 2.6.32.

Re: [ceph-users] Could not find module rbd. CentOs 6.4

2014-07-25 Thread Karan Singh
Hi Pratik Ceph RBD support has been added in mainline Linux kernel starting 2.6.34 , The following errors shows that , RBD module is not present in kernel. Its advisable to run latest stable kernel release if you need RBD to be working. > ERROR: modinfo: could not find module rbd > FATAL: Modu

Re: [ceph-users] basic questions about pool

2014-07-15 Thread Karan Singh
use further. Default pool are data and metadata . RadosGW :- End user will storage objects using S3 or Swift API. - Karan Singh - On 15 Jul 2014, at 07:42, pragya jain wrote: > thank you very much, Craig, for your clear explanation against my questions. > > Now I am very clear

Re: [ceph-users] inktank-mellanox webinar access ?

2014-07-14 Thread Karan Singh
Thanks Georgios I will wait. - Karan Singh - On 14 Jul 2014, at 15:37, Georgios Dimitrakakis wrote: > Hi Karan! > > Due to the late reception of the login info I 've also missed > a very big part of the webinar. > > They did send me an e-mail though saying that they w

Re: [ceph-users] inktank-mellanox webinar access ?

2014-07-14 Thread Karan Singh
Hey i have missed the webinar , is this available for later review or slides. - Karan - On 10 Jul 2014, at 18:27, Georgios Dimitrakakis wrote: > That makes two of us... > > G. > > On Thu, 10 Jul 2014 17:12:08 +0200 (CEST), Alexandre DERUMIER wrote: >> Ok, sorry, we have finally receive the

Re: [ceph-users] Problem installing ceph from package manager / ceph repositories

2014-06-11 Thread Karan Singh
Hi Dimitri It was already resolved , moderator took a long time to approve my email to get posted to mailing list. Thanks for your solution . - Karan - On 12 Jun 2014, at 00:02, Dimitri Maziuk wrote: > On 06/09/2014 03:08 PM, Karan Singh wrote: > >>1. When installing Ceph u

Re: [ceph-users] Problem installing ceph from package manager / ceph repositories

2014-06-10 Thread Karan Singh
Thanks Dan / Alfredo Yep priority=1 helped a little bit and yum-plugin-priority fixed all. - karan - On 10 Jun 2014, at 15:22, Alfredo Deza wrote: > On Tue, Jun 10, 2014 at 4:34 AM, Dan Van Der Ster > wrote: >> Hi, >> >> On 10 Jun 2014, at 10:30, Karan Singh wro

Re: [ceph-users] Fail to Block Devices and OpenStack

2014-06-10 Thread Karan Singh
volumes, then enable debug=true in cinder config file and check cinder-volume and scheduler logs . You will get some clue where the error is. - Karan Singh - On 10 Jun 2014, at 09:21, 山下 良民 wrote: > Hi, > > I can mount from connect to Ceph BlockDevice mount. > > glance image-creat

Re: [ceph-users] Cannot attach volumes

2014-06-10 Thread Karan Singh
, try to check out cinder volume logs and scheduler logs , you would surely find something there. If not try increasing debug level of cinder and check for some clues. - Karan Singh - On 10 Jun 2014, at 09:53, yalla.gnan.ku...@accenture.com wrote: > Hi All, > > > I have fo

[ceph-users] Problem installing ceph from package manager / ceph repositories

2014-06-10 Thread Karan Singh
Hello Cephers First of all this problem is not related to ceph-deploy , ceph-deploy 1.5.4 works like charm :-) , thanks for Alfredo Problem : 1. When installing Ceph using package manger ( # yum install ceph or # yum update cehp) that uses ceph repositories (cep.repo) , the package manage

Re: [ceph-users] ceph-deploy 1.5.4 (addressing packages coming from EPEL)

2014-06-09 Thread Karan Singh
Thanks Alfredo , happy to see your email. I was a victim of this problem , hope 1.5.4 will take away my pain :-) - Karan Sing - On 09 Jun 2014, at 15:33, Alfredo Deza wrote: > http://ceph.com/ceph-deploy/docs/changelog.html#id1 ___ ceph-users maili

Re: [ceph-users] Calamari Goes Open Source

2014-05-31 Thread Karan Singh
Its a great news , Thanks INKTANK (now red hat) experts for developing Calamari and making it Open. - Karan Singh - On 31 May 2014, at 01:11, Mark Nelson wrote: > YAY! > > On 05/30/2014 05:04 PM, Patrick McGarry wrote: >> Hey cephers, >> >> Sorry to push thi

Re: [ceph-users] ceph-deploy or manual?

2014-05-27 Thread Karan Singh
-deploy underneath. So ansible is just a wrapper for us and ceph-deploy is the undercover agent. How are you managing / deploying your cluster. ? - Karan Singh - On 27 May 2014, at 19:19, Don Talton (dotalton) wrote: > I'd love to know how people are deploying their production clouds n

Re: [ceph-users] Screencast/tutorial on setting up Ceph

2014-05-23 Thread Karan Singh
use my blogs if you like http://karan-mj.blogspot.fi/2013/12/ceph-storage-part-2.html - Karan Singh - On 23 May 2014, at 12:30, wrote: >> -Ursprüngliche Nachricht- >> Von: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] Im Auftrag >> von Sankar P >&g

Re: [ceph-users] pgs incomplete; pgs stuck inactive; pgs stuck unclean

2014-05-23 Thread Karan Singh
Try increasing the placement groups for pools ceph osd pool set data pg_num 128 ceph osd pool set data pgp_num 128 similarly for other 2 pools as well. - karan - On 23 May 2014, at 11:50, jan.zel...@id.unibe.ch wrote: > Dear ceph, > > I am trying to setup ceph 0.80.1 with the following com

Re: [ceph-users] 70+ OSD are DOWN and not coming up

2014-05-21 Thread Karan Singh
r its generating HUGE logs http://pastebin.com/mDYnjAni The problem now is if i manually visit every host and check for “service ceph status “ all services are running on all 15 hosts. But this is not getting reflected to ceph osd tree and ceph -s and they continue to show as OSD DOWN.

[ceph-users] 70+ OSD are DOWN and not coming up

2014-05-20 Thread Karan Singh
cently no activity performed on cluster , except some pool and keys creation for cinder /glance integration 6. Nodes have enough free resources for osds. 7. No issues with network , osds are down on all cluster nodes. not from a single node. ***

Re: [ceph-users] Working at RedHat & Ceph User Committee

2014-05-19 Thread Karan Singh
Nice to hear. I would say its a good move from RH to hire you :-) , good luck and keep contributing to ceph *core features* as you already been doing. - Karan Singh - On 19 May 2014, at 12:21, Wido den Hollander wrote: > On 05/19/2014 10:46 AM, Loic Dachary wrote: >> Hi Ceph, >

Re: [ceph-users] ceph manual deploy doesnt start at step 15

2014-04-24 Thread Karan Singh
would have. - karan Singh - On 24 Apr 2014, at 11:34, *sm1Ly wrote: > Hi Karan > > thx for u cooperation. > I got some help on #ceph, so now I got mon[123] and mds[123] and ods[12345]. > also I got one client on centos6,5 with elrepo lt kernel, which provides me > nonfuse

Re: [ceph-users] ceph manual deploy doesnt start at step 15

2014-04-23 Thread Karan Singh
Hi Alexander Try adding your monitor details in /etc/ceph/ceph.conf file (please check for typos) [mon] [mon.nfs2.abboom.world] host = nfs2.abboom.world mon addr = 10.60.0.111:6789 [mon.nfs3.abboom.world] host = nfs3.abboom.world mon addr = 10.60.0.112:6789 [mon.nfs4.abboom

Re: [ceph-users] Hey , I need some help about ceph-deploy install

2014-04-23 Thread Karan Singh
+ if you have not already done # yum clean all , give it a try. - Karan - On 22 Apr 2014, at 20:33, Alfredo Deza wrote: > On Tue, Apr 22, 2014 at 1:31 PM, Alfredo Deza > wrote: >> On Tue, Apr 22, 2014 at 1:29 PM, Alfredo Deza >> wrote: >>> On Sun, Apr 20, 2014 at 11:06 PM, peng wrote:

Re: [ceph-users] rbd: add failed: (34) Numerical result out of range ( Please help me)

2014-04-16 Thread Karan Singh
You ceph.conf please Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keilaranta 14, P. O. Box 405, FIN-02101 Espoo, Finland mobile: +358 503 812758 tel. +358 9 4572001 fax +358 9 4572302 http

Re: [ceph-users] Ceph v0.79 Firefly RC :: erasure-code-profile command set not present

2014-04-10 Thread Karan Singh
fredo for your timely support. Karan Singh CSC - IT Center for Science, Keilaranta 14, P. O. Box 405, FIN-02101 Espoo, Finland mobile: +358 503 812758 tel. +358 9 4572001 fax +358 9 4572302 http://www.c

Re: [ceph-users] Ceph v0.79 Firefly RC :: erasure-code-profile command set not present

2014-04-08 Thread Karan Singh
pgmap v2818: 4288 pgs, 21 pools, 51212 kB data, 23 objects 15854 MB used, 418 TB / 418 TB avail 395 stale+active+clean 3893 active+clean Karan Singh CSC - IT Center for Science

Re: [ceph-users] Ceph v0.79 Firefly RC :: erasure-code-profile command set not present

2014-04-08 Thread Karan Singh
pool stats {} Error EINVAL: invalid command # **** Karan Singh CSC - IT Center for Science, Keilaranta 14, P. O. Box 405, FIN-02101 Espoo, Finland mobile: +358 503 812758 tel. +358 9 4572001 fax +358 9 45723

[ceph-users] Ceph v0.79 Firefly RC :: erasure-code-profile command set not present

2014-04-08 Thread Karan Singh
command # Karan Singh CSC - IT Center for Science, Keilaranta 14, P. O. Box 405, FIN-02101 Espoo, Finland mobile: +358 503 812758 tel. +358 9 4572001 fax +358 9 4572302 http://www.csc.fi

Re: [ceph-users] Backup & Restore?

2014-04-02 Thread Karan Singh
day **** Karan Singh CSC - IT Center for Science, Keilaranta 14, P. O. Box 405, FIN-02101 Espoo, Finland mobile: +358 503 812758 tel. +358 9 4572001 fax +358 9 4572302 http://www.csc

Re: [ceph-users] RDO - CEPH

2014-04-01 Thread Karan Singh
Check if RDO is properly configured to use ceph , also look for MON and OSD logs at cep bend , you should get some messages from when qemu fails to crate volume Karan Singh Systems Specialist , Storage Platforms CSC - IT Center

Re: [ceph-users] firefly timing

2014-03-18 Thread Karan Singh
documentation if its not already in your pipeline. Karan Singh CSC - IT Center for Science Ltd. P.O. Box 405, FI-02101 Espoo, FINLAND http://www.csc.fi/ | +358 (0) 503 812758 On 18 Mar 2014, at 09:13, Ирек Фасихов wrote: > I'm ready to test the tiering. > > > 2014-03-18 11:07

Re: [ceph-users] No more Journals ?

2014-03-15 Thread Karan Singh
Hello Everyone If you see ceph day presentation delivered by Sebastien ( slide number 23 ) http://www.slideshare.net/Inktank_Ceph/ceph-performance It looks like Firefly has dropped support to Journals , How concrete is this news ??? -Karan- On 14 Mar 2014, at 15:35, Jake Young wrote: >

Re: [ceph-users] Issue with Openstack Glance integration with CEPH

2014-02-28 Thread Karan Singh
https://ask.openstack.org/en/question/9570/glance-image-create-returns-httpinternalservererror-http-500/ check this also try to upload a new image , i know its crazy but just a try. —karan On 28 Feb 2014, at 16:24, Srinivasa Rao Ragolu wrote: > Failed to upload image

Re: [ceph-users] Issue with Openstack Glance integration with CEPH

2014-02-28 Thread Karan Singh
Hi Srinivasa Few things for troubleshooting 1) check in glance-api.conf , it should have rbd_store_ceph_conf = /etc/ceph/ceph.conf 2) if not already done cp /etc/ceph/ceph.client.images.keyring /etc/glance 3) i am not sure if there is any difference between glance image-create and glan

Re: [ceph-users] newbie / Error connecting to cluster: PermissionError

2014-02-19 Thread Karan Singh
. —Karan Singh On 19 Feb 2014, at 12:23, João Pagaime wrote: > hello Alfredo > > here's some additional information and log output attached > > had some trouble with yum ("Resolving dl.fedoraproject.org... failed: Name or > service not known"), but only with &qu

Re: [ceph-users] Unable to add monitor nodes

2014-02-19 Thread Karan Singh
Hi Kumar Follow this http://karan-mj.blogspot.fi/2013/12/ceph-openstack-part-2.html ( part 3 , 4 and 5 as well ) http://ceph.com/docs/master/rbd/libvirt/ —karan singh On 19 Feb 2014, at 08:28, yalla.gnan.ku...@accenture.com wrote: > Hi, > > I want to implement two

Re: [ceph-users] Paris Ceph meetup

2014-02-18 Thread Karan Singh
Sounds great Loic Is it possible for you to share these presentations online ? , if they are in English ;-) Regards karan On 18 Feb 2014, at 12:08, Loic Dachary wrote: > Hi Ceph, > > Yesterday evening was the Paris Ceph meetup and it was great to see everyone. > > http://www.meetup.c

Re: [ceph-users] osd down

2014-02-16 Thread Karan Singh
Hi Pavel Try to add at least 1 more OSD ( bare minimum ) and set pool replication to 2 after that. For osd.0 try , # ceph osd in osd.0 , once the osd is IN , try to bring up osd.0 services up Finally your both the OSD should be IN and UP , so that your cluster can store data. Regard

[ceph-users] PG not getting clean

2014-02-14 Thread Karan Singh
Hello Cephers I am struggling with my ceph cluster health , PGS are not getting clean , i waited for recovery process to get end was hoping after recovery PG will become clean , but it didn’t. Can you please share your suggestions. cluster 0ff473d9-0670-42a3-89ff-81bbfb2e676a health

[ceph-users] Problems after up gradation from 0.65 to 0.76

2014-02-14 Thread Karan Singh
ng 6 active+degraded 12 stale+peering 2 stale+down+peering 106 remapped+peering 37 down+remapped+peering [root@ceph-node2 ceph]# Karan Singh CSC - IT Center for Science Ltd. P.O. Box 405, FI-02101 Espoo, FI

Re: [ceph-users] Is it possible to have One Ceph-OSD-Daemon managing more than one OSD

2014-02-13 Thread Karan Singh
Hi vikrant Yes , its possible to have this , but if you follow best practices its not recommended. Under this scenario , if you have let suppose 5 disks tied to one OSD daemon and by any reason if the OSD daemon stops working , you would loose all 5 drives in a row. Good to know the reason f

Re: [ceph-users] Ceph MON can no longer join quorum

2014-02-05 Thread Karan Singh
Hi Greg I have seen this problem before in my cluster. What ceph version you are running Did you made any change recently in the cluster , that resulted in this problem You identified correct , the only problem is ceph-mon-2003 is listening to incorrect port , it should listen on port 6789 (

Re: [ceph-users] Meetup in Frankfurt, before the Ceph day

2014-02-05 Thread Karan Singh
+1 It would be nice to meet you guys @ Ceph Day Frankfurt. Anyone else from ceph community , willing to join. Loic — Same here , first time visiting to Frankfurt. Regards Karan On 05 Feb 2014, at 10:44, Loic Dachary wrote: > Hi Ceph, > > I'll be in Frankfurt for the Ceph day Februa

Re: [ceph-users] Ceph MON can no longer join quorum

2014-02-05 Thread Karan Singh
Hi Greg I have seen this problem before in my cluster. * What ceph version you are running * Did you made any change recently in the cluster , that resulted in this problem You identified correct , the only problem is ceph-mon-2003 is listening to incorrect port , it sh

Re: [ceph-users] Meetup in Frankfurt, before the Ceph day

2014-02-05 Thread Karan Singh
+1 It would be nice to meet you guys @ Ceph Day Frankfurt. Anyone else from ceph community , willing to join. Loic — Same here , first time visiting to Frankfurt. Regards Karan Many Thanks Karan Singh - Original Message - From: "Loic Dachary" To: "ce

Re: [ceph-users] How can I set the warning level?

2014-01-10 Thread Karan Singh
Hello Greg Where can we find this config option , any command for this. Many Thanks Karan Singh - Original Message - From: "Gregory Farnum" To: vernon1...@126.com Cc: "ceph-users" Sent: Monday, 6 January, 2014 9:49:22 PM Subject: [ceph-users] How can I set the wa

Re: [ceph-users] The Kraken has been released!

2014-01-09 Thread Karan Singh
Excellent Stuff Donald . Thanks :-) Many Thanks Karan Singh - Original Message - From: "Don Talton (dotalton)" To: ceph-us...@ceph.com Sent: Thursday, 9 January, 2014 7:31:16 AM Subject: [ceph-users] The Kraken has been released! The first phase of Kraken (free)

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Karan Singh
Thanks Joao for information. Many Thanks Karan Singh - Original Message - From: "Joao Eduardo Luis" To: ceph-users@lists.ceph.com Sent: Tuesday, 17 December, 2013 2:56:23 PM Subject: Re: [ceph-users] After reboot nothing worked On 12/17/2013 09:54 AM, Karan Singh wro

Re: [ceph-users] After reboot nothing worked

2013-12-17 Thread Karan Singh
ealth warning . 2 OSD is a very less numbers for OSD Many Thanks Karan Singh - Original Message - From: "Umar Draz" To: ceph-us...@ceph.com Sent: Tuesday, 17 December, 2013 8:51:27 AM Subject: [ceph-users] After reboot nothing worked Hello, I have 2 node ceph

Re: [ceph-users] Ceph not responding after trying to add a new MON

2013-12-13 Thread Karan Singh
can you come to #ceh irc channel , we will troubleshoot real time ?? Many Thanks Karan Singh - Original Message - From: "German Anders" To: "Karan Singh" Cc: ceph-users@lists.ceph.com Sent: Friday, 13 December, 2013 8:05:00 PM Subject: Re: [ceph-users]

Re: [ceph-users] Ceph not responding after trying to add a new MON

2013-12-13 Thread Karan Singh
Hello German Can you check the following and let us know. 1. After you execute service ceph start , are the service getting started ?? what is the output of service ceph status 2. what does cehp status says 3. check on ceph-node02 what are things mounted. Many Thanks Karan Singh

Re: [ceph-users] Openstack glance ceph rbd_store_user authentification problem

2013-12-11 Thread Karan Singh
Hi Vikrant I managed to boot openstack from ceph volume , You can see my work , hope this will help you. http://karan-mj.blogspot.fi/ * Change efault_store to rbd in glance-api.conf * Make sure user with name " glance" exists in ceph auth list output. Many Thanks K

Re: [ceph-users] Openstack glance ceph rbd_store_user authentification problem

2013-12-10 Thread Karan Singh
Hi Vikrant Can you share ceph auth list and your glance-api.conf file output. What are your plans with respect to configuration , what you want to achieve. Many Thanks Karan Singh - Original Message - From: "Vikrant Verma" To: thorh...@iti.cs.uni-magdeburg.de Cc:

[ceph-users] My experience with ceph now documentted

2013-12-06 Thread Karan Singh
content about ceph. Karan Singh CSC - IT Center for Science Ltd. P.O. Box 405, FI-02101 Espoo, FINLAND http://www.csc.fi/ | +358 (0) 503 812758 ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Openstack--instance-boot-from-ceph-volume:: error could not open disk image rbd

2013-12-05 Thread Karan Singh
ume-dd315dda-b22a-4cf8-8b77-7c2b2f163155:id=volumes:key=AQC804xS8HzFJxAAD/zzQ8LMzq9wDLq/5a472g==:auth_supported=cephx\;none:mon_host=192.168.1.31\:6789\;192.168.1.33\:6789\;192.168.1.38\:6789: No such file or directory 2013-12-05 12:42:29.544+: shutting down Any idea why its throwin

Re: [ceph-users] IO error: lock /var/lib/ceph/mon/ceph-ceph-node1/store.db/LOCK: Resource temporarily unavailable

2013-12-05 Thread Karan Singh
what ceph status and ceph mon_status output says , did you checked logs after this anything interesting there ? Many Thanks Karan Singh - Original Message - From: "Jan Kalcic" To: "Karan Singh" Cc: ceph-users@lists.ceph.com Sent: Thursday, 5 December, 2013 12:

Re: [ceph-users] IO error: lock /var/lib/ceph/mon/ceph-ceph-node1/store.db/LOCK: Resource temporarily unavailable

2013-12-05 Thread Karan Singh
Thanks Karan Singh - Original Message - From: "Jan Kalcic" To: ceph-users@lists.ceph.com Sent: Thursday, 5 December, 2013 11:16:32 AM Subject: [ceph-users] IO error: lock /var/lib/ceph/mon/ceph-ceph-node1/store.db/LOCK: Resource temporarily unavailable Hi all, approaching

Re: [ceph-users] Openstack+ceph volume mounting to vm

2013-12-03 Thread Karan Singh
Hello Every Still waiting .. Any help in this would be highly appreciated. Many Thanks Karan Singh - Original Message - From: "Karan Singh" To: ceph-users@lists.ceph.com Sent: Tuesday, 3 December, 2013 6:27:29 PM Subject: [ceph-users] Openstack+ceph volume moun

  1   2   >