Hi Marc, you could unmount that OST and mount it again with "-t ldiskfs", so you can have a look inside. I think the data objects are in /mountpoint/O/0/d*, and a listing shows you the ownership of the remaining files. That might give you a clue as to which directory in you Lustre you should rescan with "lfs find". This helped me a number of times. However, in some cases there were Gigabytes left that didn't show up with "lfs find". I guess these were lost objects from some crashes that had occurred in the past. Nobody missed those files, so no problem.
Yours, Thomas On 03/23/2012 10:15 AM, Marc Boisis-Delavaud wrote: > Hello, > I want to remove an ost from my lustre filsystem. My version is 1.8.4. > > I've deactivated home-OST0004 on my mds > lctl > dl > 0 UP mgc MGC10.149.0.2@o2ib d00cdda9-5757-d58d-c5a5-073225015995 5 > 1 UP mdt MDS MDS_uuid 3 > 2 UP lov home-mdtlov home-mdtlov_UUID 4 > 3 UP mds home-MDT0000 home-MDT0000_UUID 89 > 4 IN osc home-OST0004-osc home-mdtlov_UUID 5 > 5 UP osc home-OST0003-osc home-mdtlov_UUID 5 > 6 UP osc home-OST0002-osc home-mdtlov_UUID 5 > 7 UP osc home-OST0001-osc home-mdtlov_UUID 5 > 8 UP osc home-OST0000-osc home-mdtlov_UUID 5 > 9 UP lov scratch-mdtlov scratch-mdtlov_UUID 4 > 10 UP mds scratch-MDT0000 scratch-MDT0000_UUID 85 > 11 UP mgs MGS MGS 91 > 12 UP osc scratch-OST0000-osc scratch-mdtlov_UUID 5 > > >>From a client I've made : lfs find --obd home-OST0004_UUID /Recherche | >>lfs_migrate -y > > Most of the files have been moved to the others OST but now the "lfs find > --obd home-OST0004_UUID /Recherche" find nothing but the home-OST0004 is > not empty ! > > # lfs df -i > UUID Inodes IUsed IFree IUse% Mounted on > home-MDT0000_UUID 24275160 5268561 19006599 21% > /Recherche[MDT:0] > home-OST0000_UUID 335544320 2627858 332916462 0% > /Recherche[OST:0] > home-OST0001_UUID 335544320 673756 334870564 0% > /Recherche[OST:1] > home-OST0002_UUID 335544320 917063 334627257 0% > /Recherche[OST:2] > home-OST0003_UUID 335544320 927120 334617200 0% > /Recherche[OST:3] > home-OST0004_UUID 335544320 560 335543760 0% > /Recherche[OST:4] > filesystem summary: 24275160 5268561 19006599 21% /Recherche > > # lfs df -h > UUID bytes Used Available Use% Mounted on > home-MDT0000_UUID 81.0G 1.1G 75.3G 1% > /Recherche[MDT:0] > home-OST0000_UUID 4.9T 2.0T 2.7T 39% > /Recherche[OST:0] > home-OST0001_UUID 4.9T 1.0T 3.7T 20% > /Recherche[OST:1] > home-OST0002_UUID 4.9T 1.4T 3.3T 28% > /Recherche[OST:2] > home-OST0003_UUID 4.9T 1.3T 3.3T 27% > /Recherche[OST:3] > home-OST0004_UUID 4.9T 480.0M 4.7T 0% > /Recherche[OST:4] > > filesystem summary: 24.6T 5.7T 17.7T 23% /Recherche > > > > How can I see what stay on home-OST0004 ? > > > > > > _______________________________________________ > Lustre-discuss mailing list > [email protected] > http://lists.lustre.org/mailman/listinfo/lustre-discuss -- -------------------------------------------------------------------- Thomas Roth Department: Informationstechnologie Location: SB3 1.262 Phone: +49-6159-71 1453 Fax: +49-6159-71 2986 GSI Helmholtzzentrum für Schwerionenforschung GmbH Planckstraße 1 64291 Darmstadt www.gsi.de Gesellschaft mit beschränkter Haftung Sitz der Gesellschaft: Darmstadt Handelsregister: Amtsgericht Darmstadt, HRB 1528 Geschäftsführung: Professor Dr. Dr. h.c. Horst Stöcker, Dr. Hartmut Eickhoff Vorsitzende des Aufsichtsrates: Dr. Beatrix Vierkorn-Rudolph Stellvertreter: Ministerialdirigent Dr. Rolf Bernhardt _______________________________________________ Lustre-discuss mailing list [email protected] http://lists.lustre.org/mailman/listinfo/lustre-discuss
