Hello,
I want to use CephFS instead of vanilla HDFS.
I have a question in regards to data locality.
When I configure the object size (ceph.object.size) as 64MB what will happen
with data striping (http://ceph.com/docs/master/architecture/#data-striping),
is it still will be striped by unit-size o
Hello,
I want to use CephFS instead of vanilla HDFS.
I have a question in regards to data locality.
When I configure the object size (ceph.object.size) as 64MB what will happen
with data striping (http://ceph.com/docs/master/architecture/#data-striping),
is it still will be striped by unit-size o
Hi,
I need a help to configure clients to write data to the primary osd on the
local server.
I have a cluster with 20 nodes and on each server I have a client which
writes/reads data to/from Ceph cluster (typical OpenStack installation with
Ceph on each compute node).
I see a lot of networking w
obert [mailto:rovanleeu...@ebay.com]
Sent: Tuesday, July 07, 2015 12:59 PM
To: Dmitry Meytin
Subject: Re: [ceph-users] Ceph data locality
> I need a help to configure clients to write data to the primary osd on the
> local server.
> I see a lot of networking when VM is trying to read data which was wri
ph-us...@ceph.com
Cc: Dmitry Meytin
Subject: Re: [ceph-users] FW: Ceph data locality
Hello,
On Tue, 7 Jul 2015 11:45:11 + Dmitry Meytin wrote:
> I think it's essential for huge data clusters to deal with data locality.
> Even very expensive network stack (100Gb/s) will not mitigat
rse performance.
Any ideas how to improve it?
Thank you very much,
Dmitry
-Original Message-
From: Lionel Bouton [mailto:lionel+c...@bouton.name]
Sent: Tuesday, July 07, 2015 6:07 PM
To: Dmitry Meytin
Cc: ceph-users@lists.ceph.com
Subject: Re: [ceph-users] FW: Ceph data locality
Hi Dmitr
: Lionel Bouton [mailto:lionel+c...@bouton.name]
Sent: Tuesday, July 07, 2015 7:11 PM
To: Dmitry Meytin
Cc: ceph-users@lists.ceph.com
Subject: Re: [ceph-users] FW: Ceph data locality
On 07/07/15 17:41, Dmitry Meytin wrote:
> Hi Lionel,
> Thanks for the answer.
> The missing info:
> 1) Cep
PM
To: Dmitry Meytin
Cc: ceph-users@lists.ceph.com
Subject: Re: [ceph-users] FW: Ceph data locality
On 07/07/15 18:20, Dmitry Meytin wrote:
> Exactly because of that issue I've reduced the number of Ceph replications to
> 2 and the number of HDFS copies is also 2 (so we're talking abou
