Re: [ceph-users] Same rbd mount from multiple servers

2014-10-20 Thread Mihály Árva-Tóth
server at the same time, You would need to look to use a clustered file > system. > > > > Thanks > > > > *From:* ceph-users [mailto:ceph-users-boun...@lists.ceph.com] *On Behalf > Of *Mihály Árva-Tóth > *Sent:* 20 October 2014 09:34 > *To:* ceph-users@lists.ceph.com

[ceph-users] Same rbd mount from multiple servers

2014-10-20 Thread Mihály Árva-Tóth
Hello, I made a 2GB RBD on Ceph and mounted on three separated servers.I followed this: http://ceph.com/docs/master/start/quick-rbd/ Set up, mkfs (extt4) and mount were finished success, but every node seems like three different rbd volume. :-o If I copy one 100 MB file on test1 node I don't see

Re: [ceph-users] Unique identifier in osd debug log to track ONE process from beginning to end

2014-02-18 Thread Mihály Árva-Tóth
ent request string (I believe it's the one > from the incoming message, but I'm not at a computer to check). It outputs > all the key points with that tag, and you can look at what's going on in > the vicinity of those points for more. > -Greg > > > On Wednesday, Febr

[ceph-users] Unique identifier in osd debug log to track ONE process from beginning to end

2014-02-12 Thread Mihály Árva-Tóth
put an unique ID which joins a single process to one trackable feed? Thank you! -- Best regards, Mihály Árva-Tóth System Engineer Virtual Call Center GmbH Address: 23-33 Csalogány Street, Budapest 1027, Hungary Tel: +36 1 999 7400 Mobile: +36 30 473 9256 Fax: +36 1 999 7401 E-mail

Re: [ceph-users] RadosGW (?) slow parallel upload

2014-01-26 Thread Mihály Árva-Tóth
Hello, Have you got any idea? HDDs are fast, filesystem is XFS, mounted with nobarrier,noatime... I think everything is right for the great performance. Thank you, Mihaly 2014-01-14 Mihály Árva-Tóth > Hello, > > I have got 3 servers, with 3 HDD-OSD / server (4 TB WD RE). I'm u

[ceph-users] RadosGW (?) slow parallel upload

2014-01-14 Thread Mihály Árva-Tóth
Hello, I have got 3 servers, with 3 HDD-OSD / server (4 TB WD RE). I'm using radosgw primary. Every .rgw.* pool has 3 replica. Every server is rados gateway with apache2+fastcgi (ceph patched version). Servers type: SuperMicro SSG-6047R-E1R36L. I've got 10 client machines which uploads objects pa

Re: [ceph-users] Container size via s3api

2013-11-27 Thread Mihály Árva-Tóth
2013/11/27 Yehuda Sadeh > On Wed, Nov 27, 2013 at 12:24 AM, Mihály Árva-Tóth > wrote: > > 2013/11/26 Derek Yarnell > >> > >> On 11/26/13, 4:04 AM, Mihály Árva-Tóth wrote: > >> > Hello, > >> > > >> > Is there any ide

Re: [ceph-users] Container size via s3api

2013-11-27 Thread Mihály Árva-Tóth
2013/11/26 Derek Yarnell > On 11/26/13, 4:04 AM, Mihály Árva-Tóth wrote: > > Hello, > > > > Is there any idea? I don't know this is s3api limitation or missing > feature? > > > > Thank you, > > Mihaly > > Hi Mihaly, > > If all you ar

Re: [ceph-users] Container size via s3api

2013-11-26 Thread Mihály Árva-Tóth
Hello, Is there any idea? I don't know this is s3api limitation or missing feature? Thank you, Mihaly 2013/11/25 Mihály Árva-Tóth > Hello, > > I can retrieve a container reservation (sum of objects's size inside) via > Swift API: > > $ swift -V 1.0 -A http://loc

[ceph-users] Container size via s3api

2013-11-25 Thread Mihály Árva-Tóth
Hello, I can retrieve a container reservation (sum of objects's size inside) via Swift API: $ swift -V 1.0 -A http://localhost/auth -U test:swift -K xxx stat test_container Account: v1 Container: test_container Objects: 549 *Bytes: 31665126* How can I get this information via s3api? Th

Re: [ceph-users] HDD bad sector, pg inconsistent, no object remapping

2013-11-19 Thread Mihály Árva-Tóth
//ceph.com/docs/master/rados/troubleshooting/troubleshooting-osd/ > >>>> > >>>> David Zafman > >>>> Senior Developer > >>>> http://www.inktank.com > >>> > >>> > >>> Are you saying, if a disk suffers from a b

Re: [ceph-users] HDD bad sector, pg inconsistent, no object remapping

2013-11-15 Thread Mihály Árva-Tóth
gt; http://www.inktank.com > > On Nov 12, 2013, at 3:16 AM, Mihály Árva-Tóth < > mihaly.arva-t...@virtual-call-center.eu> wrote: > > > Hello, > > > > I have 3 node, with 3 OSD in each node. I'm using .rgw.buckets pool with > 3 replica. One of my HDD

[ceph-users] HDD bad sector, pg inconsistent, no object remapping

2013-11-12 Thread Mihály Árva-Tóth
Hello, I have 3 node, with 3 OSD in each node. I'm using .rgw.buckets pool with 3 replica. One of my HDD (osd.0) has just bad sectors, when I try to read an object from OSD direct, I get Input/output errror. dmesg: [1214525.670065] mpt2sas0: log_info(0x3108): originator(PL), code(0x08), sub_c

Re: [ceph-users] Objects get via s3api FastCGI "incomplete headers" and hanging up

2013-09-19 Thread Mihály Árva-Tóth
handle more concurrent download? (File sizes between 16K and 1024K). Thank you, Mihaly 2013/9/17 Mihály Árva-Tóth > Hello, > > I'm trying to download objects from one container (which contains 3 > million objects, file sizes between 16K and 1024K) parallel 10 threads. I'

Re: [ceph-users] Decrease radosgw logging level

2013-09-19 Thread Mihály Árva-Tóth
2013/9/17 Joao Eduardo Luis > On 09/13/2013 01:02 PM, Mihály Árva-Tóth wrote: > >> Hello, >> >> How can I decrease logging level of radosgw? I uploaded 400k pieces of >> objects and my radosgw log raises to 2 GiB. Current settings: >> >> rgw_enable_usage

Re: [ceph-users] Rugged data distribution on OSDs

2013-09-18 Thread Mihály Árva-Tóth
Hello Greg, 2013/9/17 Gregory Farnum > Well, that all looks good to me. I'd just keep writing and see if the > distribution evens out some. > You could also double or triple the number of PGs you're using in that > pool; it's not atrocious but it's a little low for 9 OSDs. > Okay I see, thank y

[ceph-users] Objects get via s3api FastCGI "incomplete headers" and hanging up

2013-09-17 Thread Mihály Árva-Tóth
Hello, I'm trying to download objects from one container (which contains 3 million objects, file sizes between 16K and 1024K) parallel 10 threads. I'm using "s3" binary comes from libs3. I'm monitoring download time, response time of 80% lower than 50-80 ms. But sometimes download hanging up, up t

Re: [ceph-users] Rugged data distribution on OSDs

2013-09-17 Thread Mihály Árva-Tóth
ff distribution since there > still isn't much data in the cluster (probabilistic placement and all > that), but let's cover the basics first. > -Greg > Software Engineer #42 @ http://inktank.com | http://ceph.com > > > On Mon, Sep 16, 2013 at 2:08 AM, Mihály Árva-Tó

[ceph-users] Rugged data distribution on OSDs

2013-09-16 Thread Mihály Árva-Tóth
Hello, I made some tests on 3 node Ceph cluster: upload 3 million 50 KiB object to single container. Speed and performance were okay. But data does not distributed correctly. Every node has got 2 pcs. 4 TB and 1 pc. 2 TB HDD. osd.0 41 GB (4 TB) osd.1 47 GB (4 TB) osd.3 16 GB (2 TB) osd.4 40 GB (4

[ceph-users] Decrease radosgw logging level

2013-09-13 Thread Mihály Árva-Tóth
Hello, How can I decrease logging level of radosgw? I uploaded 400k pieces of objects and my radosgw log raises to 2 GiB. Current settings: rgw_enable_usage_log = true rgw_usage_log_tick_interval = 30 rgw_usage_log_flush_threshold = 1024 rgw_usage_max_shards = 32 rgw_usage_max_user_shards = 1 rgw

[ceph-users] Remove HDD under OSD + rados request = not found

2013-09-06 Thread Mihály Árva-Tóth
Hello, I have a server with hot swappable SATA disks. When I remove HDD from a working server, OSD does not noice missing of HDD. ceph healt status write HEALTH_OK and all of OSD "in" and "up". When I run a swift client on another server to get an object which one of chunk is available on removed

[ceph-users] radosgw subusers permission problem

2013-08-23 Thread Mihály Árva-Tóth
Hello, I have an user with 3 subuser: { "user_id": "johndoe", "display_name": "John Doe", "email": "", "suspended": 0, "max_buckets": 1000, "auid": 0, "subusers": [ { "id": "johndoe:readonly", "permissions": "read"}, { "id": "johndoe:swift", "permis

Re: [ceph-users] One rados account, more S3 API keyes

2013-08-23 Thread Mihály Árva-Tóth
2013/8/22 Sage Weil > On Thu, 22 Aug 2013, Mih?ly ?rva-T?th wrote: > > Hello, > > > > Is there any method to one radosgw user has more than one > access/secret_key? > > Yes, you can have multiple keys for each user: > > radosgw-admin key create ... > Hello Sage, Thank you. Here is an example f

[ceph-users] One rados account, more S3 API keyes

2013-08-21 Thread Mihály Árva-Tóth
Hello, Is there any method to one radosgw user has more than one access/secret_key? Thank you, Mihaly ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Non-used HDD under OSD standby

2013-07-16 Thread Mihály Árva-Tóth
Hello, Is there any way to OSD which does not use self HDD, send hard disk to standby mode (low consumption and noise)? I think no way, but I have to ask. Thank you, Mihaly ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/list

Re: [ceph-users] Tuning options for 10GE ethernet and ceph

2013-07-12 Thread Mihály Árva-Tóth
2013/7/11 Mark Nelson > On 07/11/2013 10:27 AM, Mihály Árva-Tóth wrote: > >> 2013/7/11 Mark Nelson > <mailto:mark.nelson@inktank.**com >> >> >> >> On 07/11/2013 10:04 AM, Mihály Árva-Tóth wrote: >> >> Hello, >> >>

Re: [ceph-users] Tuning options for 10GE ethernet and ceph

2013-07-11 Thread Mihály Árva-Tóth
2013/7/11 Mark Nelson > On 07/11/2013 10:04 AM, Mihály Árva-Tóth wrote: > >> Hello, >> >> We are planning to use Intel 10 GE ethernet between nodes of OSDs. Host >> operation system will be Ubuntu 12.04 x86_64. Are there any >> recommendations available to

[ceph-users] Tuning options for 10GE ethernet and ceph

2013-07-11 Thread Mihály Árva-Tóth
Hello, We are planning to use Intel 10 GE ethernet between nodes of OSDs. Host operation system will be Ubuntu 12.04 x86_64. Are there any recommendations available to tuning options (ex. sysctl and ceph)? Thank you, Mihaly ___ ceph-users mailing list c

Re: [ceph-users] Limit number of object in signle container

2013-07-09 Thread Mihály Árva-Tóth
2013/7/9 Gregory Farnum > On Mon, Jul 8, 2013 at 11:45 PM, Mihály Árva-Tóth > wrote: > > Hello, > > > > Is there any limit or recommendation to store objects in one container? > > (rados) When I store one thousand or 100 million objects, performance > will &

[ceph-users] Limit number of object in signle container

2013-07-08 Thread Mihály Árva-Tóth
Hello, Is there any limit or recommendation to store objects in one container? (rados) When I store one thousand or 100 million objects, performance will not affect? Thank you, Mihaly ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ce

[ceph-users] [rados] user handling via api

2013-07-05 Thread Mihály Árva-Tóth
Hello, Is there any method to manage rados users instead of radosgw-admin? We would like to create an own management system separated from storage and it would be great if should not call exec() on external binary. Thank you, Mihaly ___ ceph-users maili

[ceph-users] Rename container (bucket) on rados

2013-07-05 Thread Mihály Árva-Tóth
Hello, Is there any method to rename a container? (via swift or S3 API tools) Thank you, Mihaly ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Empty swift_key after key create

2013-06-21 Thread Mihály Árva-Tóth
Hello, When I create a user, then sub-user and generate a swift key, the key is missing from json output. root@ceph4:~# radosgw-admin user create --uid=testuser --display-name="Test User" --email=t...@foobar.com { "user_id": "testuser", "display_name": "Test User", "email": "t.

[ceph-users] Raw disks under OSDs or HW-RAID6 is better?

2013-03-08 Thread Mihály Árva-Tóth
Hello, We're planning 3 hosts, 12 HDDs in each host. Which is the better? If we set up 1 OSD - 1 HDD structure or create hardware RAID-6 all of 12 HDDs and only one OSD uses the whole disk space in one host? Thank you, Mike ___ ceph-users mailing list c

[ceph-users] radosgw and pools with diff repl

2013-02-28 Thread Mihály Árva-Tóth
Hello, Can I create different pools under radosgw where objects are stored with different replication numbers based on authenticated users? Example: swift -V 1.0 -A http://radosgw/auth -U foo:swift -K upload sample testfile_1.txt swift -V 1.0 -A http://radosgw/auth -U bar:swift -K uplo

Re: [ceph-users] radosgw-admin subuser access level

2013-02-28 Thread Mihály Árva-Tóth
2013/2/28 Yehuda Sadeh > > Thank you. Where can I find more detailed information about these > > permissions? Read and write are okay, but what is the different readwrite > > and full? If you give me RTFM that is great. > > > > full also provides read-acp + write-acp, that is -- reading and > wri

Re: [ceph-users] radosgw-admin subuser access level

2013-02-28 Thread Mihály Árva-Tóth
2013/2/27 Yehuda Sadeh > On Wed, Feb 27, 2013 at 3:44 AM, Mihály Árva-Tóth > wrote: > > Hello, > > > > When I create a subuser to access objects via swift, I have to specify > > access level.I found 'full' in every documentations. What types can I add &g

[ceph-users] radosgw-admin subuser access level

2013-02-27 Thread Mihály Árva-Tóth
Hello, When I create a subuser to access objects via swift, I have to specify access level.I found 'full' in every documentations. What types can I add else? radosgw-admin subuser create --uid=johndoe --subuser=johndoe:swift --access=full Thank you, Mike _