Re: [ceph-users] Migrating a cephfs data pool

2019-07-02 Thread Patrick Donnelly
On Fri, Jun 28, 2019 at 8:27 AM Jorge Garcia wrote: > > This seems to be an issue that gets brought up repeatedly, but I haven't > seen a definitive answer yet. So, at the risk of repeating a question > that has already been asked: > > How do you migrate a cephfs data pool to a new data pool? The

Re: [ceph-users] Migrating a cephfs data pool

2019-07-01 Thread Gregory Farnum
On Fri, Jun 28, 2019 at 5:41 PM Jorge Garcia wrote: > > Ok, actually, the problem was somebody writing to the filesystem. So I moved > their files and got to 0 objects. But then I tried to remove the original > data pool and got an error: > > # ceph fs rm_data_pool cephfs cephfs-data > Error

Re: [ceph-users] Migrating a cephfs data pool

2019-06-28 Thread Jorge Garcia
Ok, actually, the problem was somebody writing to the filesystem. So I moved their files and got to 0 objects. But then I tried to remove the original data pool and got an error:   # ceph fs rm_data_pool cephfs cephfs-data   Error EINVAL: cannot remove default data pool So it seems I will neve

Re: [ceph-users] Migrating a cephfs data pool

2019-06-28 Thread Jorge Garcia
This was after a while (I did notice that the number of objects went higher before it went lower). It is actually reporting more objects now. I'm not sure if some co-worker or program is writing to the filesystem... It got to these numbers and hasn't changed for the past couple hours. # ceph

Re: [ceph-users] Migrating a cephfs data pool

2019-06-28 Thread Patrick Hein
Afaik MDS doesn't delete the objects immediately but defer it for later. If you check that again now, how many objects does it report? Jorge Garcia schrieb am Fr., 28. Juni 2019, 23:16: > > On 6/28/19 9:02 AM, Marc Roos wrote: > > 3. When everything is copied-removed, you should end up with an e

Re: [ceph-users] Migrating a cephfs data pool

2019-06-28 Thread Jorge Garcia
On 6/28/19 9:02 AM, Marc Roos wrote: 3. When everything is copied-removed, you should end up with an empty datapool with zero objects. I copied the data to a new directory and then removed the data from the old directory, but df still reports some objects in the old pool (not zero). Is there

Re: [ceph-users] Migrating a cephfs data pool

2019-06-28 Thread Robert LeBlanc
etween data > pools, it does not really move data. > > > > -Original Message- > From: Robert LeBlanc [mailto:rob...@leblancnet.us] > Sent: vrijdag 28 juni 2019 18:30 > To: Marc Roos > Cc: ceph-users; jgarcia > Subject: Re: [ceph-users] Migrating a cephfs data poo

Re: [ceph-users] Migrating a cephfs data pool

2019-06-28 Thread Marc Roos
...@leblancnet.us] Sent: vrijdag 28 juni 2019 18:30 To: Marc Roos Cc: ceph-users; jgarcia Subject: Re: [ceph-users] Migrating a cephfs data pool Given that the MDS knows everything, it seems trivial to add a ceph 'mv' command to do this. I looked at using tiering to try and do the move, but I

Re: [ceph-users] Migrating a cephfs data pool

2019-06-28 Thread Robert LeBlanc
use the > basic cephfs functionality that supposed to work. I prefer that the ceph > guys implement a mv that does what you expect from it. Now it acts more > or less like a linking. > > > > > -Original Message- > From: Jorge Garcia [mailto:jgar...@soe.ucsc.edu] &

Re: [ceph-users] Migrating a cephfs data pool

2019-06-28 Thread Marc Roos
the ceph guys implement a mv that does what you expect from it. Now it acts more or less like a linking. -Original Message- From: Jorge Garcia [mailto:jgar...@soe.ucsc.edu] Sent: vrijdag 28 juni 2019 17:52 To: Marc Roos; ceph-users Subject: Re: [ceph-users] Migrating a cephfs data

Re: [ceph-users] Migrating a cephfs data pool

2019-06-28 Thread Jorge Garcia
Are you talking about adding the new data pool to the current filesystem? Like:   $ ceph fs add_data_pool my_ceph_fs new_ec_pool I have done that, and now the filesystem shows up as having two data pools:   $ ceph fs ls   name: my_ceph_fs, metadata pool: cephfs_meta, data pools: [cephfs_data

Re: [ceph-users] Migrating a cephfs data pool

2019-06-28 Thread Marc Roos
What about adding the new data pool, mounting it and then moving the files? (read copy because move between data pools does not what you expect it do) -Original Message- From: Jorge Garcia [mailto:jgar...@soe.ucsc.edu] Sent: vrijdag 28 juni 2019 17:26 To: ceph-users Subject: *SPA