[lustre-discuss] Regarding Lustre with RDMA

[Laura Hild]

Good morning, Nick-

One does not mount the OST block device on multiple hosts simultaneously:  the OST is mounted on a single OSS, and the clients connect to the OSS to request I/O (i.e. Lustre is a distributed filesystem, not a shared-disk filesystem).

To make those requests using RDMA instead of TCP, you need to assign an IP address to your RDMA interfaces (e.g. IPoIB ib0) and configure LNet nids x.x.x.x at o2ib.  Use o2ib nids in your mount specification, and Lustre will use RDMA (the IP address is just for setup, as I understand it).

-Laura


________________________________________
Od: lustre-discuss <lustre-discuss-bounces at lists.lustre.org> v imenu Nick dan via lustre-discuss <lustre-discuss at lists.lustre.org>
Poslano: četrtek, 05. januar 2023 06:12
Za: lustre-discuss at lists.lustre.org; lustre-discuss-request at lists.lustre.org; lustre-discuss-owner at lists.lustre.org
Zadeva: [lustre-discuss] Regarding Lustre with RDMA

Hi

We have configured the Lustre filesystem and mounted the same on the client. This is being done using IP as highlighted below
[image.png]
Part 2:
Now for the next part, we don't want to use this command: (mount -t lustre 11.11.1.211 at tcp:/lustre /mnt/lustre) as the connection is through IP.
We want to mount a particular block device as a lustre file system. For example, in the image below we have created 2 partitions on the server of 10G each and we are sharing ost partition to the client as a block device.
[image.png]
when we are sharing the block device. This is our client and we have got 10G of /mnt/ost.
[image.png]
After mounting  using mount /dev/nvme0n1 /mnt/lustre/
The filesystem type is ext4 and not lustre as mentioned below.
[image.png]
We want to mount using the lustre filesystem and not ext4.
Is there a need to change the lnet configuration? What else is need to be done?