Hello,
log [INF] : 3.136 repair ok, 0 fixed
Thank you Greg, I did like that, it worked well.
Laurent
Le 25/11/2013 19:10, Gregory Farnum a écrit :
On Mon, Nov 25, 2013 at 8:10 AM, Laurent Barbe wrote:
Hello,
Since yesterday, scrub has detected an inconsistent pg :( :
# ceph health detai
Hi all
I have 3 OSDs, named sdb, sdc, sdd.
Suppose, one OSD with device */dev/sdc* die => My server have only sdb,
sdc at the moment.
Because device /dev/sdc replaced by /dev/sdd
I have the following configuration:
[osd.0]
host = data-01
devs = /dev/sdb1
[osd.1]
host = data-01
dev
Hello,
Is there any idea? I don't know this is s3api limitation or missing feature?
Thank you,
Mihaly
2013/11/25 Mihály Árva-Tóth
> Hello,
>
> I can retrieve a container reservation (sum of objects's size inside) via
> Swift API:
>
> $ swift -V 1.0 -A http://localhost/auth -U test:swift -K xx
On 2013-11-25 21:55, Kyle Bader wrote:
Several people have reported issues with combining OS and OSD
journals
on the same SSD drives/RAID due to contention.
I wonder whether this has been due to the ATA write cache flush command
bug that was found yesterday. It would seem to explain why a
c
> Hi all
>
> I have 3 OSDs, named sdb, sdc, sdd.
> Suppose, one OSD with device /dev/sdc die => My server have only sdb, sdc
> at the moment.
> Because device /dev/sdc replaced by /dev/sdd
Can you just use one of the /dev/disk/by-/ symlinks?
Eg
/dev/disk/by-uuid/153cf32b-e46b-4d31-95ef-749db3a88
Hi James,
Proplem is why the Ceph not recommend using Device'UUID in Ceph.conf,
when, above error can be occur?
--
TuanTaBa
On 11/26/2013 04:04 PM, James Harper wrote:
Hi all
I have 3 OSDs, named sdb, sdc, sdd.
Suppose, one OSD with device /dev/sdc die => My server have only sdb, sdc
at the
Thanks, I'm going to try this out. I mentioned on another thread, I
wonder if this is the root cause of the contention issues reported when
recovering with OS and journals on the same SSD.
On 2013-11-25 10:11, Stefan Priebe - Profihost AG wrote:
Hi James,
after having some discussion with th
I seems that client admin socket has a life cycle, if any operation issued to
rbd, rbd admin socket appears in /var/run/ceph directory, however, when you
use this admin socket to dump perf counter, rbd cache perf counter is not in
the results:
The output of ' ceph --admin-daemon /var/run/ceph
Hi,
I found in doc: http://ceph.com/docs/master/start/os-recommendations/
"Putting multiple ceph-osd daemons using XFS or ext4 on the same host
will not perform as well as they could."
For now recommended filesystem is XFS.
This means that for the best performance setup should be 1 OSD per host?
Hi,
"Putting multiple ceph-osd daemons using XFS or ext4 on the same host
will not perform as well as they could."
This means that for the best performance setup should be 1 OSD per host?
The note only applies to the setups marked with "3". I.e. if you're
running the latest Ceph version, t
Ok, Thanks :-)
--
Regards
Dominik
2013/11/26 Jens Kristian Søgaard :
> Hi,
>
>
>> "Putting multiple ceph-osd daemons using XFS or ext4 on the same host
>> will not perform as well as they could."
>
>
>> This means that for the best performance setup should be 1 OSD per host?
>
>
> The note only a
Hi, I created an EXT4 partition on an RBD volume (0.72.1) on Ubuntu
(3.8.0-33) and noticed TRIM seems to be unsupported:
$ sudo fstrim /mnt/ceph
fstrim: /mnt/ceph: FITRIM ioctl failed: Operation not supported
It seems this is an open issue: http://tracker.ceph.com/issues/190
Is there some work
Hi Ceph,
31 January 2014, the day before FOSDEM ( http://fosdem.org/ ) a meetup is
organized in the center of Brussels, at a walking distance from bars and
restaurants. The location is an office with internet and the participants will
be invited to explain their use case or their projects. Ther
Hi,
Organizing a meetup is easy. Much much easier than organizing a Ceph day ;-) I
just published the announcement for the one in advance of FOSDEM.
http://ceph.com/community/event/brussels-ceph-meetup-in-advance-of-fosdem/
We can discuss the details on IRC if you'd like.
Cheers
On 26/11/201
Hi every one,
The official doc for rbd mentions the "--stripe_count" and
"--stripe_unit" options. If I understand correctly, these allow "fancy
striping" — i.e. having multiple stripes in a single object. However, I
tried and got an error:
"unsupported stripe unit (got [my stripe unit] want 4
On Tue, Nov 26, 2013 at 9:21 PM, nicolasc wrote:
> Hi every one,
>
> The official doc for rbd mentions the "--stripe_count" and "--stripe_unit"
> options. If I understand correctly, these allow "fancy striping" — i.e.
> having multiple stripes in a single object. However, I tried and got an
> erro
Adding ceph-user.
Best Regards,
Patrick McGarry
Director, Community || Inktank
http://ceph.com || http://inktank.com
@scuttlemonkey || @ceph || @inktank
On Tue, Nov 26, 2013 at 1:49 AM, wrote:
> Hi ,
>
> I'm from China , recently we are testing ceph block storage
> performance, bu
On Tue, Nov 26, 2013 at 11:43:07AM +0100, Dominik Mostowiec wrote:
> Hi,
> I found in doc: http://ceph.com/docs/master/start/os-recommendations/
> "Putting multiple ceph-osd daemons using XFS or ext4 on the same host
> will not perform as well as they could."
>
> For now recommended filesystem is
Hi Yan,
Thank you for that quick answer. I will try the fuse client. Maybe it
would not hurt to make this a little more explicit in the docs?
Best regards,
Nicolas Canceill
Scalable Storage Systems
SURFsara (Amsterdam, NL)
On 11/26/2013 02:34 PM, Yan, Zheng wrote:
On Tue, Nov 26, 2013 at 9
Good morning (or afternoon),
The first stream for the Ceph Developer Summit Day 2 is now live.
Feel free to get settled in for a 7a PST start (roughly 25mins from
now). You can see the stream, and all related information, at the
following locations:
G+ Event Page:
https://plus.google.com/b/100
On Tue, 26 Nov 2013, Christoph Hellwig wrote:
> On Tue, Nov 26, 2013 at 11:43:07AM +0100, Dominik Mostowiec wrote:
> > Hi,
> > I found in doc: http://ceph.com/docs/master/start/os-recommendations/
> > "Putting multiple ceph-osd daemons using XFS or ext4 on the same host
> > will not perform as well
Does rbd-fuse support cephx? I can't see any reference in the docs:
http://ceph.com/docs/master/man/8/rbd-fuse/
On 2013-11-26 14:40, nicolasc wrote:
Thank you for that quick answer. I will try the fuse client.
___
ceph-users mailing list
ceph-use
Dear TeamAfter executing : ceph-deploy -v osd prepare ceph-node2:/home/ceph/osd1i'm getting some error :[ceph-node2][DEBUG ] connected to host: ceph-node2 [ceph-node2][DEBUG ] detect platform information from remote host[ceph-node2][DEBUG ] detect machine type[ceph_deploy.osd][INFO ] Distro info:
Hi all
we have a ceph 0.67.4 cluster with 24 OSDs
I have noticed that the two servers that have 9 OSD each, have around 10'000
threads running - a number that went up significantly 2 weeks ago.
Looking at the threads:
root@h2:/var/log/ceph# ps -efL | grep ceph-osd | awk '{ print $2 }' | uniq
On 11/26/2013 08:14 AM, Patrick McGarry wrote:
Adding ceph-user.
Best Regards,
Patrick McGarry
Director, Community || Inktank
http://ceph.com || http://inktank.com
@scuttlemonkey || @ceph || @inktank
On Tue, Nov 26, 2013 at 1:49 AM, wrote:
Hi ,
I'm from China , recently we a
On 11/26/13, 4:04 AM, Mihály Árva-Tóth wrote:
> Hello,
>
> Is there any idea? I don't know this is s3api limitation or missing feature?
>
> Thank you,
> Mihaly
Hi Mihaly,
If all you are looking for is the current size of the bucket this can be
found from the adminops api[1] or when you get do t
Yes.. all the userspace and kernel stuff supports it.
s
On Tue, 26 Nov 2013, James Pearce wrote:
>
> Does rbd-fuse support cephx? I can't see any reference in the docs:
>
> http://ceph.com/docs/master/man/8/rbd-fuse/
>
>
> On 2013-11-26 14:40, nicolasc wrote:
> >
> > Thank you for that qui
On Tue, Nov 26, 2013 at 9:19 AM, upendrayadav.u wrote:
> Dear Team
> After executing : *ceph-deploy -v osd prepare ceph-node2:/home/ceph/osd1*
>
> i'm getting some error :
>
> [ceph-node2][DEBUG ] connected to host: ceph-node2
> [ceph-node2][DEBUG ] detect platform information from remote host
>
The largest group of threads is those from the network messenger — in
the current implementation it creates two threads per process the
daemon is communicating with. That's two threads for each OSD it
shares PGs with, and two threads for each client which is accessing
any data on that OSD.
-Greg
So
The second (of three) sessions for CDS day 2 is about to start.
YouTube: http://youtu.be/7SRHYyHNBCc
IRC: #ceph-summit
Best Regards,
Patrick McGarry
Director, Community || Inktank
http://ceph.com || http://inktank.com
@scuttlemonkey || @ceph || @inktank
_
YouTube: http://youtu.be/Rvli9pFLnMk
IRC: #ceph-summit (oftc)
Best Regards,
Patrick McGarry
Director, Community || Inktank
http://ceph.com || http://inktank.com
@scuttlemonkey || @ceph || @inktank
___
ceph-users mailing list
ceph-users@lists.ceph.co
Micha,
Did you ever figure out a work around for this issue?
I also had plans of using s3cmd to put, and recursively set acl's on a nightly
basis...however we are getting the 403 errors as well during our testing.
I was just wondering if you were able to find another solution.
Thanks in advanc
I have not gotten so far as to get things working with xenserver but I
have followed the installtion instructions from the technology perview
and installed using that repo.
I have a ceph pool defined.
I can create and destroy volumes
but I cannot read or write them.
I get the following error
Hi All,
There is a new release of ceph-deploy, the easy deployment tool for Ceph.
The most important (non-bug) change for this release is the ability to
specify repository mirrors when installing ceph. This can be done with
environment variables or flags in the `install` subcommand.
Full documen
ceph-deploy 1.3.3 just got released and you should not see this with the
new version.
On Tue, Nov 26, 2013 at 9:56 AM, Alfredo Deza wrote:
>
>
>
> On Tue, Nov 26, 2013 at 9:19 AM, upendrayadav.u <
> upendrayada...@zohocorp.com> wrote:
>
>> Dear Team
>> After executing : *ceph-deploy -v osd pre
Thanks a lot, Jens. Do I have to have cephx authentication enabled? Did you
enable it? Which user from the node that contains cinder-api or glance-api are
you using to create volumes and images? The documentation at
http://ceph.com/docs/master/rbd/rbd-openstack/ mentions creating new users
cli
On 11/26/2013 09:45 PM, Alvin Starr wrote:
I have not gotten so far as to get things working with xenserver but I
have followed the installtion instructions from the technology perview
and installed using that repo.
I have a ceph pool defined.
I can create and destroy volumes
but I cannot read
Hi,
We have 2 clusters with copy of objects.
On one of them we splited all large buckets (largest 17mln objects) to
256 buckets each (shards) and we have added 3 extra servers (6->9).
Old bucket was created in ceph argonaut.
Now we have dumpling.
After this operation get avg time increased almost t
Thanks.
--
Regards
Dominik
2013/11/26 Sage Weil :
> On Tue, 26 Nov 2013, Christoph Hellwig wrote:
>> On Tue, Nov 26, 2013 at 11:43:07AM +0100, Dominik Mostowiec wrote:
>> > Hi,
>> > I found in doc: http://ceph.com/docs/master/start/os-recommendations/
>> > "Putting multiple ceph-osd daemons using
On Tue, Nov 26, 2013 at 1:27 PM, Dominik Mostowiec
wrote:
> Hi,
> We have 2 clusters with copy of objects.
> On one of them we splited all large buckets (largest 17mln objects) to
> 256 buckets each (shards) and we have added 3 extra servers (6->9).
> Old bucket was created in ceph argonaut.
> Now
Hello all,
bad news the problem shown again today !
I had mounted a bindfs and nfs server running on the same "proxy" server
when I ran a massive chmod on a directory with large amount of data I
got part of the directories that disapeared!
The problem wasn t showing as fast as it was with kern
>From ceph-users archive 08/27/2013:
On 08/27/2013 01:39 PM, Timofey Koolin wrote:
> Is way to know real size of rbd image and rbd snapshots?
> rbd ls -l write declared size of image, but I want to know real size.
You can sum the sizes of the extents reported by:
rbd diff pool/image[@snap]
Hi Alfredo-
Have you looked at adding the ability to specify a proxy on the ceph-deploy
command line? Something like:
ceph-deploy install --proxy {http_proxy}
That would then need to run all the remote commands (rpm, curl, wget, etc) with
the proxy. Not sure how complex that would be
On Tue, Nov 26, 2013 at 4:33 PM, Gruher, Joseph R
wrote:
> Hi Alfredo-
>
> Have you looked at adding the ability to specify a proxy on the ceph-deploy
> command line? Something like:
>
> ceph-deploy install --proxy {http_proxy}
>
> That would then need to run all the remote commands (rpm
Hello Cephers
I was following http://ceph.com/docs/master/rbd/rbd-openstack/ for ceph and
openstack Integration , using this document ih ave done all the changes
required for this integration.
I am not sure how should i test my configuration , how should i make sure
integration is successful
Hi Sage,
If I recall correctly during the summit you mentioned that it was possible to
disable the journal.
Is it still part of the plan?
Sébastien Han
Cloud Engineer
"Always give 100%. Unless you're giving blood.”
Phone: +33 (0)1 49 70 99 72
Mail: sebastien@enovance.com
Address
Hi,
Well after restarting the services run:
$ cinder create 1
Then you can check both status in Cinder and Ceph:
For Cinder run:
$ cinder list
For Ceph run:
$ rbd -p ls
If the image is there, you’re good.
Cheers.
Sébastien Han
Cloud Engineer
"Always give 100%. Unless you're giving
I'm curious about this too. With a leveldb backend, how would we invoke
leveldb to get around our current journaling requirements?
On 11/26/2013 05:06 PM, Sebastien Han wrote:
Hi Sage,
If I recall correctly during the summit you mentioned that it was possible to
disable the journal.
Is it sti
Hi Karan,
You should monitor the OSDs to see if the objects get created in the pool etc.
as Sebastian suggested.
I followed the links below:
http://ceph.com/docs/master/rados/operations/monitoring-osd-pg/
http://ceph.com/docs/master/rados/operations/control/
Another thing you could do is to r
On Wed, 27 Nov 2013, Sebastien Han wrote:
> Hi Sage,
> If I recall correctly during the summit you mentioned that it was possible to
> disable the journal.
> Is it still part of the plan?
For the kv backend, yeah, since the key/value store will handle making
things transactional.
Haomai, I stil
On Wed, Nov 27, 2013 at 5:56 AM, Alphe Salas wrote:
> Hello all,
> bad news the problem shown again today !
> I had mounted a bindfs and nfs server running on the same "proxy" server
> when I ran a massive chmod on a directory with large amount of data I got
> part of the directories that disapear
I am working with a small test cluster, but the problems described
here will remain in production. I have an external fiber channel storage
array and have exported 2 3TB disks (just as JBODs). I can use
ceph-deploy to create an OSD for each of these disks on a node named
Vashti. So far ever
Ahh. Now that is a fish of a different colour.
I was trying vol-upload and vol-download and your explanation makes it
clear why they would not work.
I wonder if sticking an rdb-fuse mount under libvirt to allow copy in
and out functions to work would make sense.
I will back up and try to see
> Is there any way to manually configure which OSDs are started on which
> machines? The osd configuration block includes the osd name and host, so is
> there a way to say that, say, osd.0 should only be started on host vashti
> and osd.1 should only be started on host zadok? I tried using thi
Hi Mark
Thanks your reply!
Yes, 33T OSD we are use 1 disk per OSD.
- Do you use SSDs for journals? Ask: don't use SSDs for journals , how
much performance can be improved if use SSDs to storage journals?
- What CPU do you have in each node? Ask: CPU : Intel(R) Xeon
On Wed, Nov 27, 2013 at 7:39 AM, Sage Weil wrote:
> On Wed, 27 Nov 2013, Sebastien Han wrote:
> > Hi Sage,
> > If I recall correctly during the summit you mentioned that it was
> possible to disable the journal.
> > Is it still part of the plan?
>
> For the kv backend, yeah, since the key/value s
Hello Sebastien / Community
I tried the commands mentioned in below email.
[root@rdo ~]#
[root@rdo ~]# cinder create 1
+-+--+
| Property |Value |
+-+---
57 matches
Mail list logo
