[lustre-discuss] lustre 2.15 installation on Centos 8.5.2111

Jesse Stroik jesse.stroik at ssec.wisc.edu
Tue Jul 12 10:02:13 PDT 2022 

Hi Fran,

I suspect the issue is a missing kmod-zfs RPM which provides those symbols. It might be the case that it was inadvertently excluded from the whamcloud repo.

You could build your own RPMs on a centos system with the group 'Development Tools' installed. I'd recommend doing it as an unprivileged user and however you setup your normal build environment.

Start by installing the kernel RPMs they provide, boot into that new kernel, verify that is the newest kernel you have installed, then build zfs & lustre from source.

Here is an example I tested on a rocky 8.5 system, but it'll probably work similarly on a centos 8.5 system.

$ git clone https://github.com/zfsonlinux/zfs.git
$ cd zfs
$ git checkout zfs-2.0.7
$ sh autogen.sh
$ ./configure --with-spec=redhat
$ make rpms

At that point, you should have a set of ZFS RPMs built. Install them:

$ dnf localinstall kmod-zfs-2.0.7-1.el8.x86_64.rpm kmod-zfs-devel-2.0.7-1.el8.x86_64.rpm libnvpair3-2.0.7-1.el8.x86_64.rpm libuutil3-2.0.7-1.el8.x86_64.rpm libzfs4-2.0.7-1.el8.x86_64.rpm libzfs4-devel-2.0.7-1.el8.x86_64.rpm libzpool4-2.0.7-1.el8.x86_64.rpm zfs-2.0.7-1.el8.x86_64.rpm

At this point if you've built for the correct kernel, the zfs module should be loadable. Then fetch and build lustre 2.15.0. This worked for me:

$ git clone git://git.whamcloud.com/fs/lustre-release.git
$ cd lustre-release
$ git checkout v2_15_0
$ sh autogen.sh
$  ## in this example it will build with zfs support only
$ ./configure --enable-server --disable-ldiskfs
$ make rpms

If everything succeeds, install the RPMs. I believe this would be the minimum set you might need:

$ dnf localinstall kmod-lustre-2.15.0-1.el8.x86_64.rpm kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64.rpm lustre-2.15.0-1.el8.x86_64.rpm lustre-osd-zfs-mount-2.15.0-1.el8.x86_64.rpm

Adjust as needed. I hope you find this useful.

Best,
Jesse




________________________________________
From: lustre-discuss <lustre-discuss-bounces at lists.lustre.org> on behalf of Bedosti Francesco <bedosti at ira.inaf.it>
Sent: Monday, July 11, 2022 11:17 AM
To: lustre-discuss at lists.lustre.org
Subject: [lustre-discuss] lustre 2.15 installation on Centos 8.5.2111

Hi
i'm installing lustre 2.15 with ZFS backend from repository https://downloads.whamcloud.com/public/lustre/lustre-2.15.0/el8.5/server/ on a Centos 8.5

I added zfs from lustre repository without problems, but when i try to install lustre it gives me this error:

yum install lustre
Last metadata expiration check: 0:07:45 ago on Mon Jul 11 18:05:51 2022.
Error:
  Problem: package lustre-2.15.0-1.el8.x86_64 requires lustre-osd-mount, but none of the providers can be installed
   - package lustre-osd-zfs-mount-2.15.0-1.el8.x86_64 requires kmod-lustre-osd-zfs, but none of the providers can be installed
   - conflicting requests
   - nothing provides ksym(__cv_broadcast) = 0x03cebd8a needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(arc_add_prune_callback) = 0x1363912f needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(arc_buf_size) = 0x115a75cf needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(arc_remove_prune_callback) = 0x1ab2d851 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dbuf_create_bonus) = 0x7beafc97 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dbuf_read) = 0xa12ed106 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_assign_arcbuf_by_dbuf) = 0x26d78f55 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_bonus_hold) = 0x8d7deb8a needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_buf_hold_array_by_bonus) = 0x878059c5 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_buf_rele) = 0x9205359f needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_buf_rele_array) = 0x33363fa0 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_free_long_range) = 0x329676ab needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_free_range) = 0x356042ae needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_object_alloc_dnsize) = 0x72ae6b8e needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_object_free) = 0x01514575 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_object_next) = 0x989708be needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_object_set_blocksize) = 0xdbdf5ea0 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_objset_disown) = 0xac0fbfc0 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_objset_dnodesize) = 0x880db256 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_objset_ds) = 0x5e094e28 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_objset_own) = 0xd1bc953d needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_objset_pool) = 0x316efb55 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_objset_projectquota_enabled) = 0x7cf4ae3c needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_objset_spa) = 0x74df2efe needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_objset_space) = 0xd74d78f4 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_objset_userobjspace_present) = 0x138579aa needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_objset_userused_enabled) = 0xcd8a237b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_prefetch) = 0xc222e936 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_read) = 0xeeafabff needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_read_by_dnode) = 0xc4f6da68 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_request_arcbuf) = 0xca969ecf needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_return_arcbuf) = 0x32f9dfac needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_abort) = 0xa9691ccd needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_assign) = 0x6bc84ffe needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_callback_register) = 0xab06fb1e needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_commit) = 0xcbba81b1 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_create) = 0x86931c7a needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_get_txg) = 0xc8357211 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_hold_bonus) = 0x97c61436 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_hold_free) = 0x360baac3 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_hold_sa) = 0xb106205d needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_hold_sa_create) = 0x99a9a6e2 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_hold_spill) = 0x14545569 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_hold_write) = 0x752aa2d4 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_hold_write_by_dnode) = 0x24c9e18f needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_hold_zap) = 0xdea9d23c needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_hold_zap_by_dnode) = 0x64adadf4 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_tx_mark_netfree) = 0xdff68d46 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_write) = 0x062ec89b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dmu_write_by_dnode) = 0x36a2ea0a needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dsl_pool_config_enter) = 0x14d29692 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dsl_pool_config_exit) = 0x5c919184 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dsl_prop_register) = 0x00e13baf needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(dsl_prop_unregister) = 0x2daa653d needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(nvlist_add_byte_array) = 0x4e7a9a72 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(nvlist_alloc) = 0x8b696b3c needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(nvlist_free) = 0x1eb6b2e6 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(nvlist_lookup_byte_array) = 0xb23a79b9 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(nvlist_next_nvpair) = 0x12b7c9d9 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(nvlist_pack) = 0x2765fde3 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(nvlist_remove) = 0x0fe970b7 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(nvlist_size) = 0xb7a0e36b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(nvlist_unpack) = 0xc625bb30 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(nvpair_name) = 0x73de28f8 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_bulk_lookup) = 0x33aaf400 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_bulk_update) = 0x403de1c2 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_handle_destroy) = 0x179e9758 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_handle_get) = 0xaf939683 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_handle_get_from_db) = 0xd75b5123 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_lookup) = 0xad56a10b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_object_size) = 0x16d92b02 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_replace_all_by_template) = 0x379eacb8 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_setup) = 0xa19ff31f needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_size) = 0xd8ad4cd7 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_spill_rele) = 0x64815b44 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(sa_update) = 0x64a15ec5 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(spa_freeze) = 0x125115d5 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(spa_get_dsl) = 0xef44809d needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(spa_maxblocksize) = 0xda598cd2 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(spa_writeable) = 0x6a075800 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(spl_panic) = 0xbc32eee7 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(txg_wait_callbacks) = 0x61743d6b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(txg_wait_synced) = 0xcc76bc4d needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_add) = 0x64b73098 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_add_by_dnode) = 0xed480b96 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_add_uint64) = 0x9919a21a needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_count) = 0x659ff127 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_create_flags_dnsize) = 0x9b7f3b23 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_cursor_advance) = 0x110ee212 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_cursor_fini) = 0x2c0791ff needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_cursor_init) = 0xccc464cd needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_cursor_init_serialized) = 0x91e513c3 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_cursor_retrieve) = 0x8576d59c needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_cursor_serialize) = 0x44866197 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_lookup) = 0x67af93f3 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_lookup_by_dnode) = 0xaf832009 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_lookup_uint64) = 0x5b2d1778 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_remove) = 0xc8e9807e needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_remove_by_dnode) = 0xc59ada49 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_remove_uint64) = 0x797c2660 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zap_update) = 0xd43444d9 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zfs_attr_table) = 0xfbf319ac needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zfs_prop_to_name) = 0x5adabedf needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zio_buf_alloc) = 0x0c211976 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zio_buf_free) = 0x6e7a7166 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zrl_add_impl) = 0x71517bab needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ksym(zrl_remove) = 0x6a251b8b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
   - nothing provides ldiskfsprogs >= 1.45.6.wc1 needed by lustre-osd-ldiskfs-mount-2.15.0-1.el8.x86_64
(try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)

Is Centos still supported? I remember it doing well with lustre 2.14. am I doing something wrong?

many thanks
Fran
_______________________________________________
lustre-discuss mailing list
lustre-discuss at lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

More information about the lustre-discuss mailing list