Re: [ceph-users] Is it possible to have One Ceph-OSD-Daemon managing more than one OSD

2014-02-12 Thread Ashish Chandra
Hi, With Ceph, an OSD is generally one Ceph ceph-osd daemon for one storage drive within a host machine. If your host has multiple storage drives, you may map one ceph-osd daemon for each drive. But , in your condition what I would suggest that make a volume group out of all physical hard drives

[ceph-users] Removing OSD, double data migration

2014-02-12 Thread Michael
Hi Ceph users, Have always wondered this, why does data get shuffled twice when you delete an OSD? You out an OSD and the data gets moved to other nodes - understandable but then when you remove that OSD from crush it moves data again, aren't outed OSD's and an OSD's not in crush the same fro

Re: [ceph-users] unable to start OSD

2014-02-12 Thread Dietmar Maurer
> > It would be great to get two logs from two different crashing OSDs for > > comparison purposes. > > ftp://download.proxmox.com/tmp/ceph-osd.4.log > ftp://download.proxmox.com/tmp/ceph-osd.10.log I guess I should also mention that there was a miss-configuration in the network MTU setting of on

Re: [ceph-users] installation of radosgw is throwing unmet dependency issue

2014-02-12 Thread Ashish Chandra
I am using Ubuntu 12.04, i tried upgrading the package, since upgrading didnt solve the issue I downloaded the package and installed it manually. On Wed, Feb 12, 2014 at 8:15 PM, Wido den Hollander wrote: > On 02/12/2014 01:20 PM, Ashish Chandra wrote: > >> Hi, >> >> While installing rados gate

Re: [ceph-users] Is it possible to have One Ceph-OSD-Daemon managing more than one OSD

2014-02-12 Thread Vikrant Verma
yes, I want to use multiple hard drives with a single OSD. Is it possible to have it? Regards, Vikrant On Wed, Feb 12, 2014 at 10:14 PM, Loic Dachary wrote: > > > On 12/02/2014 12:28, Vikrant Verma wrote: > > Hi All, > > > > I have one quick question - > > > > Is it possible to have One Ceph-O

Re: [ceph-users] unable to start OSD

2014-02-12 Thread Dietmar Maurer
> It would be great to get two logs from two different crashing OSDs for > comparison purposes. ftp://download.proxmox.com/tmp/ceph-osd.4.log ftp://download.proxmox.com/tmp/ceph-osd.10.log > > > > and post the log somewhere? (You can use 'ceph-post ' to > > > send it to us > > > > # ceph-post-f

Re: [ceph-users] Radosgw / Chunked transfer / RHEL / Swift

2014-02-12 Thread alistair.whittle
Thanks Greg. I seem to have missed that distinction when doing the original gateway install using that very web page. Hopefully this fixes the problem. -Original Message- From: Gregory Farnum [mailto:g...@inktank.com] Sent: Wednesday, February 12, 2014 5:14 PM To: Whittle, Alistair:

Re: [ceph-users] unable to start OSD

2014-02-12 Thread Sage Weil
On Wed, 12 Feb 2014, Dietmar Maurer wrote: > > This sounds like a bug introduced an entry into the pg log that is not > > ordered > > properly. I don't think I've seen this before... Sam, have you? > > > > How many OSDs you do you have? > > 12 OSDs, 3 nodes > > > Can you set 'debug osd = 20' i

Re: [ceph-users] unable to start OSD

2014-02-12 Thread Dietmar Maurer
OK, I upload the log to our server: ftp://download.proxmox.com/tmp/ceph-osd.4.log > -Original Message- > From: ceph-users-boun...@lists.ceph.com [mailto:ceph-users- > boun...@lists.ceph.com] On Behalf Of Dietmar Maurer > Sent: Mittwoch, 12. Februar 2014 18:41 > To: Sage Weil > Cc: ceph-u

Re: [ceph-users] unable to start OSD

2014-02-12 Thread Dietmar Maurer
> This sounds like a bug introduced an entry into the pg log that is not ordered > properly. I don't think I've seen this before... Sam, have you? > > How many OSDs you do you have? 12 OSDs, 3 nodes > Can you set 'debug osd = 20' in your ceph.conf, restart and reproduce the > crash, The log I

Re: [ceph-users] Radosgw / Chunked transfer / RHEL / Swift

2014-02-12 Thread Gregory Farnum
If you look at http://ceph.com/docs/master/install/install-ceph-gateway, the fcgi package you have installed is labeled as "W/Out 100 Continue". You need to add a separate "gitbuilder" repository if you want it with 100-continue (supporting chunked transfers); it's all described on that page. -Greg

Re: [ceph-users] Is it possible to have One Ceph-OSD-Daemon managing more than one OSD

2014-02-12 Thread Loic Dachary
On 12/02/2014 12:28, Vikrant Verma wrote: > Hi All, > > I have one quick question - > > Is it possible to have One Ceph-OSD-Daemon managing more than one Object > Storage Device in a Ceph Cluster? Hi, Do you want to use multiple hard drives with a single OSD ? Cheers > Regards, > Vikrant

Re: [ceph-users] Unique identifier in osd debug log to track ONE process from beginning to end

2014-02-12 Thread Gregory Farnum
This is harder than it sounds, but you can get a broad picture by looking for all the instances of the client request string (I believe it's the one from the incoming message, but I'm not at a computer to check). It outputs all the key points with that tag, and you can look at what's going on in th

Re: [ceph-users] Use of daily-created/-deleted pools

2014-02-12 Thread Gregory Farnum
On Tuesday, February 11, 2014, Hyangtack Lee wrote: > I'm new to Ceph, and looking for a new storage to replace legacy system. > > My system has a lot of files accessing temporarily for 2 or 3 days. > Those files are uploaded from many clients everyday, and batch job deletes > unused files everyd

Re: [ceph-users] Planning a home ceph cluster

2014-02-12 Thread Mark Nelson
On 02/12/2014 06:23 AM, Ethan Levine wrote: On 2014-02-11 11:41 PM, Mark Nelson wrote: I've been planning building myself a server cluster as a sort of hobby project, and I've decided to use Ceph for its storage system. I have a few questions, though. My plan is to build 3 relatively dense se

Re: [ceph-users] unable to start OSD

2014-02-12 Thread Sage Weil
Hi Dietmar, This sounds like a bug introduced an entry into the pg log that is not ordered properly. I don't think I've seen this before... Sam, have you? How many OSDs you do you have? Can you set 'debug osd = 20' in your ceph.conf, restart and reproduce the crash, and post the log somewhere

[ceph-users] Unique identifier in osd debug log to track ONE process from beginning to end

2014-02-12 Thread Mihály Árva-Tóth
Hello, I have got strange OSD slowing issue (always on primary OSD): I turned on --debug-log 30/30 to all OSDs, and I would like to track one process (for example write an object) in the log from the beginning to end without annoying other log rows (which are related another processes). Can you pu

Re: [ceph-users] installation of radosgw is throwing unmet dependency issue

2014-02-12 Thread Wido den Hollander
On 02/12/2014 01:20 PM, Ashish Chandra wrote: Hi, While installing rados gateway, i get unmet dependency issue for libcurl. I installed libcurl3-gnutls-7.35 from official debian repository, still the issue remains unsolved. http://packages.debian.org/sid/libcurl3-gnutls ceph@ceph-node1$ sudo

Re: [ceph-users] Planning a home ceph cluster

2014-02-12 Thread Ethan Levine
On 2014-02-11 11:41 PM, Mark Nelson wrote: I've been planning building myself a server cluster as a sort of hobby project, and I've decided to use Ceph for its storage system. I have a few questions, though. My plan is to build 3 relatively dense servers (20 drive bays each) and fill each one

Re: [ceph-users] Is it possible to have One Ceph-OSD-Daemon managing more than one OSD

2014-02-12 Thread Ashish Chandra
AFAIK, one ceph-osd daemon is tied to single OSD, identified by osd-num and data path. On Wed, Feb 12, 2014 at 4:58 PM, Vikrant Verma wrote: > Hi All, > > I have one quick question - > > Is it possible to have One Ceph-OSD-Daemon managing more than one Object > Storage Device in a Ceph Cluster?

[ceph-users] installation of radosgw is throwing unmet dependency issue

2014-02-12 Thread Ashish Chandra
Hi, While installing rados gateway, i get unmet dependency issue for libcurl. I installed libcurl3-gnutls-7.35 from official debian repository, still the issue remains unsolved. http://packages.debian.org/sid/libcurl3-gnutls ceph@ceph-node1$ sudo apt-get install radosgw Reading package lists...

[ceph-users] Is it possible to have One Ceph-OSD-Daemon managing more than one OSD

2014-02-12 Thread Vikrant Verma
Hi All, I have one quick question - Is it possible to have One Ceph-OSD-Daemon managing more than one Object Storage Device in a Ceph Cluster? Regards, Vikrant ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ce

Re: [ceph-users] Radosgw / Chunked transfer / RHEL / Swift

2014-02-12 Thread alistair.whittle
Does anybody have any advice for me on the issue discussed below? From: ceph-users-boun...@lists.ceph.com [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Whittle, Alistair: Investment Bank (LDN) Sent: Monday, February 10, 2014 3:44 PM To: ceph-users@lists.ceph.com Subject: [ceph-users] R

Re: [ceph-users] unable to start OSD

2014-02-12 Thread Dietmar Maurer
After enabling debugging, I get: ... -4> 2014-02-12 09:43:44.739648 7f7f8b848780 20 read_log 6100'1677 (6100'1676) modify 85949a17/rbd_data.dd6592ae8944a.01bd/head//25 by clie nt.890681.0:76884 2014-01-26 16:44:08.412457 -3> 2014-02-12 09:43:44.739670 7f7f8b848780 20 read_lo

Re: [ceph-users] unable to start OSD

2014-02-12 Thread Dietmar Maurer
> I am unable to start my OSDs on one node: > > > osd/PGLog.cc: 672: FAILED assert(last_e.version.version < e.version.version) > > Does that mean there is something wrong with my journal disk? Or why can such > thing happen? After rebooting other nodes, all my OSD are offline, showing exactly th