[lustre-discuss] lustre 2.15 installation on Centos 8.5.2111

Thomas Roth t.roth at gsi.de
Fri Jul 15 11:28:14 PDT 2022


In addition, you might need to use the "--nodeps" to install your self-compiled packages, cf.
https://jira.whamcloud.com/browse/LU-15976

Cheers
Thomas

On 7/12/22 19:02, Jesse Stroik via lustre-discuss wrote:
> Hi Fran,
> 
> I suspect the issue is a missing kmod-zfs RPM which provides those symbols. It might be the case that it was inadvertently excluded from the whamcloud repo.
> 
> You could build your own RPMs on a centos system with the group 'Development Tools' installed. I'd recommend doing it as an unprivileged user and however you setup your normal build environment.
> 
> Start by installing the kernel RPMs they provide, boot into that new kernel, verify that is the newest kernel you have installed, then build zfs & lustre from source.
> 
> Here is an example I tested on a rocky 8.5 system, but it'll probably work similarly on a centos 8.5 system.
> 
> $ git clone https://github.com/zfsonlinux/zfs.git
> $ cd zfs
> $ git checkout zfs-2.0.7
> $ sh autogen.sh
> $ ./configure --with-spec=redhat
> $ make rpms
> 
> At that point, you should have a set of ZFS RPMs built. Install them:
> 
> $ dnf localinstall kmod-zfs-2.0.7-1.el8.x86_64.rpm kmod-zfs-devel-2.0.7-1.el8.x86_64.rpm libnvpair3-2.0.7-1.el8.x86_64.rpm libuutil3-2.0.7-1.el8.x86_64.rpm libzfs4-2.0.7-1.el8.x86_64.rpm libzfs4-devel-2.0.7-1.el8.x86_64.rpm libzpool4-2.0.7-1.el8.x86_64.rpm zfs-2.0.7-1.el8.x86_64.rpm
> 
> At this point if you've built for the correct kernel, the zfs module should be loadable. Then fetch and build lustre 2.15.0. This worked for me:
> 
> $ git clone git://git.whamcloud.com/fs/lustre-release.git
> $ cd lustre-release
> $ git checkout v2_15_0
> $ sh autogen.sh
> $  ## in this example it will build with zfs support only
> $ ./configure --enable-server --disable-ldiskfs
> $ make rpms
> 
> If everything succeeds, install the RPMs. I believe this would be the minimum set you might need:
> 
> $ dnf localinstall kmod-lustre-2.15.0-1.el8.x86_64.rpm kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64.rpm lustre-2.15.0-1.el8.x86_64.rpm lustre-osd-zfs-mount-2.15.0-1.el8.x86_64.rpm
> 
> Adjust as needed. I hope you find this useful.
> 
> Best,
> Jesse
> 
> 
> 
> 
> ________________________________________
> From: lustre-discuss <lustre-discuss-bounces at lists.lustre.org> on behalf of Bedosti Francesco <bedosti at ira.inaf.it>
> Sent: Monday, July 11, 2022 11:17 AM
> To: lustre-discuss at lists.lustre.org
> Subject: [lustre-discuss] lustre 2.15 installation on Centos 8.5.2111
> 
> Hi
> i'm installing lustre 2.15 with ZFS backend from repository https://downloads.whamcloud.com/public/lustre/lustre-2.15.0/el8.5/server/ on a Centos 8.5
> 
> I added zfs from lustre repository without problems, but when i try to install lustre it gives me this error:
> 
> yum install lustre
> Last metadata expiration check: 0:07:45 ago on Mon Jul 11 18:05:51 2022.
> Error:
>    Problem: package lustre-2.15.0-1.el8.x86_64 requires lustre-osd-mount, but none of the providers can be installed
>     - package lustre-osd-zfs-mount-2.15.0-1.el8.x86_64 requires kmod-lustre-osd-zfs, but none of the providers can be installed
>     - conflicting requests
>     - nothing provides ksym(__cv_broadcast) = 0x03cebd8a needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(arc_add_prune_callback) = 0x1363912f needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(arc_buf_size) = 0x115a75cf needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(arc_remove_prune_callback) = 0x1ab2d851 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dbuf_create_bonus) = 0x7beafc97 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dbuf_read) = 0xa12ed106 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_assign_arcbuf_by_dbuf) = 0x26d78f55 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_bonus_hold) = 0x8d7deb8a needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_buf_hold_array_by_bonus) = 0x878059c5 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_buf_rele) = 0x9205359f needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_buf_rele_array) = 0x33363fa0 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_free_long_range) = 0x329676ab needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_free_range) = 0x356042ae needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_object_alloc_dnsize) = 0x72ae6b8e needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_object_free) = 0x01514575 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_object_next) = 0x989708be needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_object_set_blocksize) = 0xdbdf5ea0 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_objset_disown) = 0xac0fbfc0 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_objset_dnodesize) = 0x880db256 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_objset_ds) = 0x5e094e28 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_objset_own) = 0xd1bc953d needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_objset_pool) = 0x316efb55 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_objset_projectquota_enabled) = 0x7cf4ae3c needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_objset_spa) = 0x74df2efe needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_objset_space) = 0xd74d78f4 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_objset_userobjspace_present) = 0x138579aa needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_objset_userused_enabled) = 0xcd8a237b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_prefetch) = 0xc222e936 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_read) = 0xeeafabff needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_read_by_dnode) = 0xc4f6da68 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_request_arcbuf) = 0xca969ecf needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_return_arcbuf) = 0x32f9dfac needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_abort) = 0xa9691ccd needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_assign) = 0x6bc84ffe needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_callback_register) = 0xab06fb1e needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_commit) = 0xcbba81b1 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_create) = 0x86931c7a needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_get_txg) = 0xc8357211 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_hold_bonus) = 0x97c61436 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_hold_free) = 0x360baac3 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_hold_sa) = 0xb106205d needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_hold_sa_create) = 0x99a9a6e2 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_hold_spill) = 0x14545569 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_hold_write) = 0x752aa2d4 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_hold_write_by_dnode) = 0x24c9e18f needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_hold_zap) = 0xdea9d23c needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_hold_zap_by_dnode) = 0x64adadf4 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_tx_mark_netfree) = 0xdff68d46 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_write) = 0x062ec89b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dmu_write_by_dnode) = 0x36a2ea0a needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dsl_pool_config_enter) = 0x14d29692 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dsl_pool_config_exit) = 0x5c919184 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dsl_prop_register) = 0x00e13baf needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(dsl_prop_unregister) = 0x2daa653d needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(nvlist_add_byte_array) = 0x4e7a9a72 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(nvlist_alloc) = 0x8b696b3c needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(nvlist_free) = 0x1eb6b2e6 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(nvlist_lookup_byte_array) = 0xb23a79b9 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(nvlist_next_nvpair) = 0x12b7c9d9 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(nvlist_pack) = 0x2765fde3 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(nvlist_remove) = 0x0fe970b7 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(nvlist_size) = 0xb7a0e36b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(nvlist_unpack) = 0xc625bb30 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(nvpair_name) = 0x73de28f8 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_bulk_lookup) = 0x33aaf400 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_bulk_update) = 0x403de1c2 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_handle_destroy) = 0x179e9758 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_handle_get) = 0xaf939683 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_handle_get_from_db) = 0xd75b5123 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_lookup) = 0xad56a10b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_object_size) = 0x16d92b02 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_replace_all_by_template) = 0x379eacb8 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_setup) = 0xa19ff31f needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_size) = 0xd8ad4cd7 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_spill_rele) = 0x64815b44 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(sa_update) = 0x64a15ec5 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(spa_freeze) = 0x125115d5 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(spa_get_dsl) = 0xef44809d needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(spa_maxblocksize) = 0xda598cd2 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(spa_writeable) = 0x6a075800 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(spl_panic) = 0xbc32eee7 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(txg_wait_callbacks) = 0x61743d6b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(txg_wait_synced) = 0xcc76bc4d needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_add) = 0x64b73098 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_add_by_dnode) = 0xed480b96 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_add_uint64) = 0x9919a21a needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_count) = 0x659ff127 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_create_flags_dnsize) = 0x9b7f3b23 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_cursor_advance) = 0x110ee212 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_cursor_fini) = 0x2c0791ff needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_cursor_init) = 0xccc464cd needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_cursor_init_serialized) = 0x91e513c3 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_cursor_retrieve) = 0x8576d59c needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_cursor_serialize) = 0x44866197 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_lookup) = 0x67af93f3 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_lookup_by_dnode) = 0xaf832009 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_lookup_uint64) = 0x5b2d1778 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_remove) = 0xc8e9807e needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_remove_by_dnode) = 0xc59ada49 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_remove_uint64) = 0x797c2660 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zap_update) = 0xd43444d9 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zfs_attr_table) = 0xfbf319ac needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zfs_prop_to_name) = 0x5adabedf needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zio_buf_alloc) = 0x0c211976 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zio_buf_free) = 0x6e7a7166 needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zrl_add_impl) = 0x71517bab needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ksym(zrl_remove) = 0x6a251b8b needed by kmod-lustre-osd-zfs-2.15.0-1.el8.x86_64
>     - nothing provides ldiskfsprogs >= 1.45.6.wc1 needed by lustre-osd-ldiskfs-mount-2.15.0-1.el8.x86_64
> (try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)
> 
> Is Centos still supported? I remember it doing well with lustre 2.14. am I doing something wrong?
> 
> many thanks
> Fran
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


More information about the lustre-discuss mailing list