I am experimenting with different external journal partitions as raw partitions (no file system).
using ceph-deploy osd prepare foo:/mount-point-for-data-partition:journal-partition followed by ceph-deploy osd activate (same arguments) When the specified journal-partition is on an ssd drive I notice that osd prepare reports [WARNIN] DEBUG:ceph-disk:Journal /dev/sdb2 is a partition [WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data WARNIN] INFO:ceph-disk:Running command: /usr/sbin/blkid -p -o udev /dev/sdb2 WARNIN] WARNING:ceph-disk:Journal /dev/sdb2 was not prepared with ceph-disk. Symlinking directly. [WARNIN] DEBUG:ceph-disk:Preparing osd data dir /var/local//dev/sdc1 [WARNIN] DEBUG:ceph-disk:Creating symlink /var/local//dev/sdc1/journal -> /dev/sdb2 and the later ceph-deploy osd activate works fine But when the journal-partition is a small partition on the beginning of the data drive osd prepare reports [WARNIN] DEBUG:ceph-disk:Journal is file /dev/sdc2 <<========================= [WARNIN] WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data [WARNIN] DEBUG:ceph-disk:Preparing osd data dir /var/local//dev/sdc1 [WARNIN] DEBUG:ceph-disk:Creating symlink /var/local//dev/sdc1/journal -> /dev/sdc2 and then the later ceph-deploy osd activate fails with [WARNIN] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster ceph --mkfs --mkkey -i 0 --monmap /var/local//dev/sd\ c1/activate.monmap --osd-data /var/local//dev/sdc1 --osd-journal /var/local//dev/sdc1/journal --osd-uuid 05b3933e-9ac4-453a-9072-c7ebf242ba7\ 0 --keyring /var/local//dev/sdc1/keyring [WARNIN] 2015-04-30 13:09:30.869745 3ff9df5cec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway [WARNIN] 2015-04-30 13:09:30.869810 3ff9df5cec0 -1 journal check: ondisk fsid 00000000-0000-0000-0000-000000000000 doesn't match expected 05b3933e-9ac4-453a-9072-c7ebf242ba70, invalid (someone else's?) journal [WARNIN] 2015-04-30 13:09:30.869863 3ff9df5cec0 -1 filestore(/var/local//dev/sdc1) mkjournal error creating journal on /var/local//dev/sdc1/journal: (22) Invalid argument [WARNIN] 2015-04-30 13:09:30.869883 3ff9df5cec0 -1 OSD::mkfs: ObjectStore::mkfs failed with error -22 [WARNIN] 2015-04-30 13:09:30.869934 3ff9df5cec0 -1 ** ERROR: error creating empty object store in /var/local//dev/sdc1: (22) Invalid argument I'm assuming the problem started with osd prepare thinking that /dev/sdc2 was a file rather than a partition. Is there some partition table thing I am missing here? parted /dev/sdc print gives Disk /dev/sdc: 2000GB Sector size (logical/physical): 512B/512B Partition Table: gpt Disk Flags: Number Start End Size File system Name Flags 2 1049kB 5000MB 4999MB primary 1 5000MB 2000GB 1995GB xfs primary Not sure if it is related but I do know that in the past I had created a single partition on /dev/sdc and used that as an xfs data partition. -- Tom Deneau, AMD _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
