Re: [ceph-users] Ceph as an Alternative to HDFS for Hadoop

On Wed, Dec 27, 2017 at 1:52 AM, Aristeu Gil Alves Jr wrote: > In a recent thread on the list, I received various important answers to my > questions on hadoop plugin. Maybe this thread will help you. > https://www.spinics.net/lists/ceph-users/msg40790.html > > One of the most important answers i

Re: [ceph-users] Ceph as an Alternative to HDFS for Hadoop

Hi Serkan On Fri, Dec 22, 2017 at 12:04 PM, Serkan Çoban wrote: > >Also, are there any benchmark comparisons between hdfs and ceph > specifically around performance of apps benefiting from data locality ? > There will be no data locality in ceph, because all the data is > accessed through networ

Re: [ceph-users] Running Jewel and Luminous mixed for a longer period

On Tue, Dec 5, 2017 at 1:20 PM, Wido den Hollander wrote: > Hi, > > I haven't tried this before but I expect it to work, but I wanted to check > before proceeding. > > I have a Ceph cluster which is running with manually formatted FileStore XFS > disks, Jewel, sysvinit and Ubuntu 14.04. > > I wo

Re: [ceph-users] Question about librbd with qemu-kvm

It's not possible to use multiple threads by disk in qemu currently. (It's on qemu roadmap). but you can create multiple disk/rbd image and use multiple qemu iothreads. (1 by disk). (BTW, I'm able to reach around 70k iops max with 4k read, with 3,1ghz cpu, rbd_cache=none, disabling debug and

[ceph-users] formatting bytes and object counts in ceph status ouput

Hi lists, Currently the ceph status output formats all numbers with binary unit prefixes, i.e. 1MB equals 1048576 bytes and an object count of 1M equals 1048576 objects. I received a bug report from a user that printing object counts with a base 2 multiplier is confusing (I agree) so I opened

Re: [ceph-users] formatting bytes and object counts in ceph status ouput

On 18-01-02 11:43 AM, Jan Fajerski wrote: Hi lists, Currently the ceph status output formats all numbers with binary unit prefixes, i.e. 1MB equals 1048576 bytes and an object count of 1M equals 1048576 objects. I received a bug report from a user that printing object counts with a base 2 mult

Re: [ceph-users] PG active+clean+remapped status

Hi, We added some more osds to the cluster and it was fixed. Karun Josy On Tue, Jan 2, 2018 at 6:21 AM, 한승진 wrote: > Are all odsd are same version? > I recently experienced similar situation. > > I upgraded all osds to exact same version and reset of pool configuration > like below > > ceph os

[ceph-users] Increasing PG number

Hi, Initial PG count was not properly planned while setting up the cluster, so now there are only less than 50 PGs per OSDs. What are the best practises to increase PG number of a pool ? We have replicated pools as well as EC pools. Or is it better to create a new pool with higher PG numbers?

Re: [ceph-users] Increasing PG number

Increased number of PGs in multiple pools in a production cluster on 12.2.2 recently - zero issues. CEPH claims that increasing pg_num and pgp_num are safe operations, which are essential for it's ability to scale, and this sounds pretty reasonable to me. [1] [1] https://www.sebastien-han.fr/blog

Re: [ceph-users] Increasing PG number

Please refer to standard documentation as much as possible, http://docs.ceph.com/docs/jewel/rados/operations/placement-groups/#set-the-number-of-placement-groups Han’s is also incomplet

Re: [ceph-users] Increasing PG number

https://access.redhat.com/solutions/2457321 It says it is a very intensive process and can affect cluster performance. Our Version is Luminous 12.2.2 And we are using erasure coding profile for a pool 'ecpool' with k=5 and m=3 Current PG number is 256 and it has about 20 TB of data. Should I inc

Re: [ceph-users] in the same ceph cluster, why the object in the same osd some are 8M and some are 4M?

On 02/01/18 02:36, linghucongsong wrote: > Hi, all! > > I just use ceph rbd for openstack. > > my ceph version is 10.2.7. > > I find a surprise thing that the object save in the osd , in some pgs the > objects are 8M, and in some pgs the objects are 4M, can someone tell me why?  > thanks! > >

Re: [ceph-users] formatting bytes and object counts in ceph status ouput

On Tue, Jan 2, 2018 at 10:43 AM, Jan Fajerski wrote: > Hi lists, > Currently the ceph status output formats all numbers with binary unit > prefixes, i.e. 1MB equals 1048576 bytes and an object count of 1M equals > 1048576 objects. I received a bug report from a user that printing object > counts

Re: [ceph-users] Ceph scrub logs: _scan_snaps no head for $object?

Hi Stefan, Mehmet, Are these clusters that were upgraded from prior versions, or fresh luminous installs? This message indicates that there is a stray clone object with no associated head or snapdir object. That normally should never happen--it's presumably the result of a (hopefully old) bug

Re: [ceph-users] Questions about pg num setting

Have you had a look at http://ceph.com/pgcalc/? Generally if you have too many PGs per OSD you can get yourself into trouble during recovery and backfilling operations consuming a lot more RAM than you have and eventually making your cluster unusable (some more info can be found here for example:

Re: [ceph-users] slow 4k writes, Luminous with bluestore backend

The main difference is that rados bench uses 4MB objects while your dd test uses 4k block size rados bench shows an average of 283 IOPS which at 4k blocksize would be around 1.1MB so it's somewhat consistent with the dd result Monitor your CPU usage, network latency with something like atop on the

Re: [ceph-users] formatting bytes and object counts in ceph status ouput

On 01/02/2018 08:54 AM, John Spray wrote: > On Tue, Jan 2, 2018 at 10:43 AM, Jan Fajerski wrote: >> Hi lists, >> Currently the ceph status output formats all numbers with binary unit >> prefixes, i.e. 1MB equals 1048576 bytes and an object count of 1M equals >> 1048576 objects. I received a bug r

Re: [ceph-users] formatting bytes and object counts in ceph status ouput

I'd implement byte counters in base 2 (KB, MB, etc). MiB is annoying to us old grumpy folk, but I'd live with it. But, I absolutely hate that object count is in base 2. 1kg is not 1024 kilograms. We have a reason for bytes to be in base 2. Very few other things are expected to be in base 2. A norm

Re: [ceph-users] How to evict a client in rbd

I tried to reproduce this for over an hour today using the specified versions w/o any success. Is this something that you can repeat on-demand or was this a one-time occurance? On Sat, Dec 23, 2017 at 3:48 PM, Karun Josy wrote: > Hello, > > The image is not mapped. > > # ceph --version > ceph ver

[ceph-users] Ceph Developer Monthly - January 2018

Hey Cephers, This is just a friendly reminder that the next Ceph Developer Montly meeting is coming up: http://wiki.ceph.com/Planning If you have work that you're doing that it a feature work, significant backports, or anything you would like to discuss with the core team, please add it to the

[ceph-users] object lifecycle and updating from jewel

I would like to use the new object lifecycle feature of kraken / luminous. I have jewel, with buckets that have lots and lots of objects. It won't be practical to move them, then move them back after upgrading. In order to use the object lifecycle feature of radosgw in kraken/luminous, do I nee