[lustre-discuss] Lustre Configuration

James Lam unison2004 at hotmail.com
Sun Jan 1 23:14:55 PST 2023 

In the meantime please see if your firewall blocks internal connection (even for lo)
 By default, socklnd uses TCP port 988 to create connections, and this must not be blocked by any firewalls


Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows

From: James Lam<mailto:unison2004 at hotmail.com>
Sent: Monday, January 2, 2023 3:11 PM
To: Nick dan<mailto:nickdan2999 at gmail.com>; lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>; lustre-discuss-request at lists.lustre.org<mailto:lustre-discuss-request at lists.lustre.org>; lustre-discuss-owner at lists.lustre.org<mailto:lustre-discuss-owner at lists.lustre.org>; Degremont, Aurelien<mailto:degremoa at amazon.fr>; info at whamcloud.com<mailto:info at whamcloud.com>; firatyilmazz at gmail.com<mailto:firatyilmazz at gmail.com>; Taner KARAGÖL<mailto:karagol at aselsan.com.tr>
Subject: RE: [lustre-discuss] Lustre Configuration

Could you dump2fs the partition to see what’s inside?

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows

From: Nick dan via lustre-discuss<mailto:lustre-discuss at lists.lustre.org>
Sent: Monday, January 2, 2023 12:28 PM
To: lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>; lustre-discuss-request at lists.lustre.org<mailto:lustre-discuss-request at lists.lustre.org>; lustre-discuss-owner at lists.lustre.org<mailto:lustre-discuss-owner at lists.lustre.org>; Degremont, Aurelien<mailto:degremoa at amazon.fr>; info at whamcloud.com<mailto:info at whamcloud.com>; firatyilmazz at gmail.com<mailto:firatyilmazz at gmail.com>; Taner KARAGÖL<mailto:karagol at aselsan.com.tr>
Subject: [lustre-discuss] Lustre Configuration

I am using Redhat 8.6 (  Linux 4.18.0-372.9.1.el8_lustre.x86_64)

[root at st01 user]# uname -a
Linux st01 4.18.0-372.9.1.el8_lustre.x86_64 #1 SMP Wed Aug 10 18:19:05 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Lustre packages:
[root at st01 user]# rpm -qa | lustre grep
bash: lustre: command not found...
[root at st01 user]# rpm -qa | grep lustre
kernel-modules-4.18.0-372.9.1.el8_lustre.x86_64
kmod-lustre-osd-ldiskfs-2.15.1-1.el8.x86_64
pcp-pmda-lustrecomm-5.3.5-8.el8.x86_64
python3-perf-4.18.0-372.9.1.el8_lustre.x86_64
kernel-devel-4.18.0-372.9.1.el8_lustre.x86_64
lustre-osd-ldiskfs-mount-2.15.1-1.el8.x86_64
lustre-iokit-2.15.1-1.el8.x86_64
kernel-core-4.18.0-372.9.1.el8_lustre.x86_64
kmod-lustre-osd-ldiskfs-debuginfo-2.15.1-1.el8.x86_64
lustre-debugsource-2.15.1-1.el8.x86_64
lustre-2.15.1-1.el8.x86_64
lustre-tests-2.15.1-1.el8.x86_64
kernel-debuginfo-common-x86_64-4.18.0-372.9.1.el8_lustre.x86_64
kmod-lustre-debuginfo-2.15.1-1.el8.x86_64
python3-perf-debuginfo-4.18.0-372.9.1.el8_lustre.x86_64
lustre-devel-2.15.1-1.el8.x86_64
kmod-lustre-tests-debuginfo-2.15.1-1.el8.x86_64
kernel-debuginfo-4.18.0-372.9.1.el8_lustre.x86_64
perf-4.18.0-372.9.1.el8_lustre.x86_64
perf-debuginfo-4.18.0-372.9.1.el8_lustre.x86_64
kmod-lustre-2.15.1-1.el8.x86_64
lustre-ldiskfs-dkms-2.15.1-1.el8.noarch
kmod-lustre-tests-2.15.1-1.el8.x86_64
kernel-4.18.0-372.9.1.el8_lustre.x86_64
lustre-debuginfo-2.15.1-1.el8.x86_64
pcp-pmda-lustre-5.3.5-8.el8.x86_64

e2fsprog packages
[root at st01 user]# rpm -qa | grep e2fsprog
e2fsprogs-libs-1.46.2.wc5-0.el8.x86_64
e2fsprogs-debuginfo-1.46.2.wc5-0.el8.x86_64
e2fsprogs-debugsource-1.46.2.wc5-0.el8.x86_64
e2fsprogs-libs-debuginfo-1.46.2.wc5-0.el8.x86_64
e2fsprogs-devel-1.46.2.wc5-0.el8.x86_64
e2fsprogs-1.46.2.wc5-0.el8.x86_64
e2fsprogs-static-1.46.2.wc5-0.el8.x86_64

[root at st01 user]# lsblk
NAME               MAJ:MIN RM   SIZE RO TYPE MOUNTPOINT
sda                  8:0    0 223.6G  0 disk
├─sda1               8:1    0   600M  0 part /boot/efi
├─sda2               8:2    0     1G  0 part /boot
└─sda3               8:3    0   222G  0 part
  ├─rhel_st01-root 253:0    0    70G  0 lvm  /
  ├─rhel_st01-swap 253:1    0  22.4G  0 lvm  [SWAP]
  └─rhel_st01-home 253:3    0 129.6G  0 lvm  /home
sdb                  8:16   0 232.9G  0 disk
├─sdb1               8:17   0   600M  0 part
├─sdb2               8:18   0     1G  0 part
└─sdb3               8:19   0 231.3G  0 part
  ├─rhel-swap      253:2    0    23G  0 lvm
  ├─rhel-home      253:4    0 138.3G  0 lvm
  └─rhel-root      253:5    0    70G  0 lvm
nvme0n1            259:0    0 931.5G  0 disk
└─nvme0n1p1        259:2    0    10G  0 part

mkfs lustre
[cid:image011.png at 01D91EBD.0B7AF500]

mounting lustre file system on directory /mnt/mds
[cid:image012.png at 01D91EBD.0B7AF500]

Configured lnet
[cid:image013.png at 01D91EBD.0B7AF500]


Installed the same packages on the second server. I am trying to configure OSS and OST on my second server

[root at st02 user]# lsblk
NAME          MAJ:MIN RM   SIZE RO TYPE MOUNTPOINT
sda             8:0    0 223.6G  0 disk
├─sda1          8:1    0   600M  0 part /boot/efi
├─sda2          8:2    0     1G  0 part /boot
└─sda3          8:3    0   222G  0 part
  ├─rhel-root 253:0    0    70G  0 lvm  /
  ├─rhel-swap 253:1    0   7.8G  0 lvm  [SWAP]
  └─rhel-home 253:2    0 144.2G  0 lvm  /home
sdb             8:16   0 223.6G  0 disk
nvme0n1       259:0    0   1.8T  0 disk
└─nvme0n1p1   259:2    0    10G  0 part
nvme1n1       259:1    0 931.5G  0 disk
mkfs
[cid:image014.png at 01D91EBD.0B7AF500]
And after mounting, I am getting Connection timed out error
[cid:image015.png at 01D91EBD.0B7AF500]
Can you tell where am I getting wrong?


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20230102/1624d78a/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: D226F675CA7C47C4B79132FA5E79EEF1.png
Type: image/png
Size: 114224 bytes
Desc: D226F675CA7C47C4B79132FA5E79EEF1.png
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20230102/1624d78a/attachment-0005.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 97A136E01B9D4C7B98B61A3929189888.png
Type: image/png
Size: 74333 bytes
Desc: 97A136E01B9D4C7B98B61A3929189888.png
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20230102/1624d78a/attachment-0006.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 106A2904ABA242C2B700993D4CBB4BFD.png
Type: image/png
Size: 55173 bytes
Desc: 106A2904ABA242C2B700993D4CBB4BFD.png
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20230102/1624d78a/attachment-0007.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: DF0BE64DB6484F77ACAC19CCD3DCC92C.png
Type: image/png
Size: 107165 bytes
Desc: DF0BE64DB6484F77ACAC19CCD3DCC92C.png
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20230102/1624d78a/attachment-0008.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: BF5E6171930446ED806D3917A034BB71.png
Type: image/png
Size: 30160 bytes
Desc: BF5E6171930446ED806D3917A034BB71.png
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20230102/1624d78a/attachment-0009.png>

More information about the lustre-discuss mailing list