We can't (or perhaps shan't) use --nodeps. Our lustre is installed as part of a normal configuration management system and not manually on systems and hacking in an exec with --nodeps isn't something we want to do to our lustre server class. The RPMs just need to be correct.
Building the RPMs and having kmod-zfs works if you need the dependencies to line up. It's not too much trouble, so that's our preferred route. Best, Jesse ________________________________________ From: lustre-discuss <lustre-discuss-boun...@lists.lustre.org> on behalf of Thomas Roth via lustre-discuss <lustre-discuss@lists.lustre.org> Sent: Friday, July 15, 2022 1:28 PM To: lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] lustre 2.15 installation on Centos 8.5.2111 In addition, you might need to use the "--nodeps" to install your self-compiled packages, cf. https://jira.whamcloud.com/browse/LU-15976 Cheers Thomas On 7/12/22 19:02, Jesse Stroik via lustre-discuss wrote: > Hi Fran, > > I suspect the issue is a missing kmod-zfs RPM which provides those symbols. > It might be the case that it was inadvertently excluded from the whamcloud > repo. > > You could build your own RPMs on a centos system with the group 'Development > Tools' installed. I'd recommend doing it as an unprivileged user and however > you setup your normal build environment. > > Start by installing the kernel RPMs they provide, boot into that new kernel, > verify that is the newest kernel you have installed, then build zfs & lustre > from source. > > Here is an example I tested on a rocky 8.5 system, but it'll probably work > similarly on a centos 8.5 system. > > $ git clone https://github.com/zfsonlinux/zfs.git > $ cd zfs > $ git checkout zfs-2.0.7 > $ sh autogen.sh > $ ./configure --with-spec=redhat > $ make rpms > > At that point, you should have a set of ZFS RPMs built. Install them: > > $ dnf localinstall kmod-zfs-2.0.7-1.el8.x86_64.rpm > kmod-zfs-devel-2.0.7-1.el8.x86_64.rpm libnvpair3-2.0.7-1.el8.x86_64.rpm > libuutil3-2.0.7-1.el8.x86_64.rpm libzfs4-2.0.7-1.el8.x86_64.rpm > libzfs4-devel-2.0.7-1.el8.x86_64.rpm libzpool4-2.0.7-1.el8.x86_64.rpm > zfs-2.0.7-1.el8.x86_64.rpm > > At this point if you've built for the correct kernel, the zfs module should > be loadable. Then fetch and build lustre 2.15.0. This worked for me: > > $ git clone git://git.whamcloud.com/fs/lustre-release.git > $ cd lustre-release > $ git checkout v2_15_0 > $ sh autogen.sh > $ ## in this example it will build with zfs support only > $ ./configure --enable-server --disable-ldiskfs > $ make rpms > > If everything succeeds, install the RPMs. I believe this would be the minimum > set you might need: > > $ dnf localinstall kmod-lustre-2.15.0-1.el8.x86_64.rpm > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64.rpm lustre-2.15.0-1.el8.x86_64.rpm > lustre-osd-zfs-mount-2.15.0-1.el8.x86_64.rpm > > Adjust as needed. I hope you find this useful. > > Best, > Jesse > > > > > ________________________________________ > From: lustre-discuss <lustre-discuss-boun...@lists.lustre.org> on behalf of > Bedosti Francesco <bedo...@ira.inaf.it> > Sent: Monday, July 11, 2022 11:17 AM > To: lustre-discuss@lists.lustre.org > Subject: [lustre-discuss] lustre 2.15 installation on Centos 8.5.2111 > > Hi > i'm installing lustre 2.15 with ZFS backend from repository > https://downloads.whamcloud.com/public/lustre/lustre-2.15.0/el8.5/server/ on > a Centos 8.5 > > I added zfs from lustre repository without problems, but when i try to > install lustre it gives me this error: > > yum install lustre > Last metadata expiration check: 0:07:45 ago on Mon Jul 11 18:05:51 2022. > Error: > Problem: package lustre-2.15.0-1.el8.x86_64 requires lustre-osd-mount, but > none of the providers can be installed > - package lustre-osd-zfs-mount-2.15.0-1.el8.x86_64 requires > kmod-lustre-osd-zfs, but none of the providers can be installed > - conflicting requests > - nothing provides ksym(__cv_broadcast) = 0x03cebd8a needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(arc_add_prune_callback) = 0x1363912f needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(arc_buf_size) = 0x115a75cf needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(arc_remove_prune_callback) = 0x1ab2d851 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dbuf_create_bonus) = 0x7beafc97 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dbuf_read) = 0xa12ed106 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_assign_arcbuf_by_dbuf) = 0x26d78f55 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_bonus_hold) = 0x8d7deb8a needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_buf_hold_array_by_bonus) = 0x878059c5 needed > by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_buf_rele) = 0x9205359f needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_buf_rele_array) = 0x33363fa0 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_free_long_range) = 0x329676ab needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_free_range) = 0x356042ae needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_object_alloc_dnsize) = 0x72ae6b8e needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_object_free) = 0x01514575 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_object_next) = 0x989708be needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_object_set_blocksize) = 0xdbdf5ea0 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_objset_disown) = 0xac0fbfc0 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_objset_dnodesize) = 0x880db256 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_objset_ds) = 0x5e094e28 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_objset_own) = 0xd1bc953d needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_objset_pool) = 0x316efb55 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_objset_projectquota_enabled) = 0x7cf4ae3c > needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_objset_spa) = 0x74df2efe needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_objset_space) = 0xd74d78f4 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_objset_userobjspace_present) = 0x138579aa > needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_objset_userused_enabled) = 0xcd8a237b needed > by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_prefetch) = 0xc222e936 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_read) = 0xeeafabff needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_read_by_dnode) = 0xc4f6da68 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_request_arcbuf) = 0xca969ecf needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_return_arcbuf) = 0x32f9dfac needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_abort) = 0xa9691ccd needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_assign) = 0x6bc84ffe needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_callback_register) = 0xab06fb1e needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_commit) = 0xcbba81b1 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_create) = 0x86931c7a needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_get_txg) = 0xc8357211 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_hold_bonus) = 0x97c61436 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_hold_free) = 0x360baac3 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_hold_sa) = 0xb106205d needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_hold_sa_create) = 0x99a9a6e2 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_hold_spill) = 0x14545569 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_hold_write) = 0x752aa2d4 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_hold_write_by_dnode) = 0x24c9e18f needed > by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_hold_zap) = 0xdea9d23c needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_hold_zap_by_dnode) = 0x64adadf4 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_tx_mark_netfree) = 0xdff68d46 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_write) = 0x062ec89b needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dmu_write_by_dnode) = 0x36a2ea0a needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dsl_pool_config_enter) = 0x14d29692 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dsl_pool_config_exit) = 0x5c919184 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dsl_prop_register) = 0x00e13baf needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(dsl_prop_unregister) = 0x2daa653d needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(nvlist_add_byte_array) = 0x4e7a9a72 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(nvlist_alloc) = 0x8b696b3c needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(nvlist_free) = 0x1eb6b2e6 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(nvlist_lookup_byte_array) = 0xb23a79b9 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(nvlist_next_nvpair) = 0x12b7c9d9 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(nvlist_pack) = 0x2765fde3 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(nvlist_remove) = 0x0fe970b7 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(nvlist_size) = 0xb7a0e36b needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(nvlist_unpack) = 0xc625bb30 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(nvpair_name) = 0x73de28f8 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_bulk_lookup) = 0x33aaf400 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_bulk_update) = 0x403de1c2 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_handle_destroy) = 0x179e9758 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_handle_get) = 0xaf939683 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_handle_get_from_db) = 0xd75b5123 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_lookup) = 0xad56a10b needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_object_size) = 0x16d92b02 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_replace_all_by_template) = 0x379eacb8 needed > by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_setup) = 0xa19ff31f needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_size) = 0xd8ad4cd7 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_spill_rele) = 0x64815b44 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(sa_update) = 0x64a15ec5 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(spa_freeze) = 0x125115d5 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(spa_get_dsl) = 0xef44809d needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(spa_maxblocksize) = 0xda598cd2 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(spa_writeable) = 0x6a075800 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(spl_panic) = 0xbc32eee7 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(txg_wait_callbacks) = 0x61743d6b needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(txg_wait_synced) = 0xcc76bc4d needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_add) = 0x64b73098 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_add_by_dnode) = 0xed480b96 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_add_uint64) = 0x9919a21a needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_count) = 0x659ff127 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_create_flags_dnsize) = 0x9b7f3b23 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_cursor_advance) = 0x110ee212 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_cursor_fini) = 0x2c0791ff needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_cursor_init) = 0xccc464cd needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_cursor_init_serialized) = 0x91e513c3 needed > by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_cursor_retrieve) = 0x8576d59c needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_cursor_serialize) = 0x44866197 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_lookup) = 0x67af93f3 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_lookup_by_dnode) = 0xaf832009 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_lookup_uint64) = 0x5b2d1778 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_remove) = 0xc8e9807e needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_remove_by_dnode) = 0xc59ada49 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_remove_uint64) = 0x797c2660 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zap_update) = 0xd43444d9 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zfs_attr_table) = 0xfbf319ac needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zfs_prop_to_name) = 0x5adabedf needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zio_buf_alloc) = 0x0c211976 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zio_buf_free) = 0x6e7a7166 needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zrl_add_impl) = 0x71517bab needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ksym(zrl_remove) = 0x6a251b8b needed by > kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64 > - nothing provides ldiskfsprogs >= 1.45.6.wc1 needed by > lustre-osd-ldiskfs-mount-2.15.0-1.el8.x86_64 > (try to add '--skip-broken' to skip uninstallable packages or '--nobest' to > use not only best candidate packages) > > Is Centos still supported? I remember it doing well with lustre 2.14. am I > doing something wrong? > > many thanks > Fran > _______________________________________________ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > _______________________________________________ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org _______________________________________________ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org _______________________________________________ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
