<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body dir="auto">
<div dir="ltr">This looks like <a href="https://jira.whamcloud.com/browse/LU-16655">https://jira.whamcloud.com/browse/LU-16655</a> causing problems after the upgrade from 2.12.x to 2.15.[012] breaking the Object Index files.
<div><br>
</div>
<div>A patch for this has already been landed to b2_15 and will be included in 2.15.3. If you've hit this issue, then you need to backup/delete the OI files (off of Lustre) and run OI Scrub to rebuild them.</div>
<div><br>
</div>
<div>I believe the OI Scrub/rebuild is described in the Lustre Manual. <br>
<br>
<div dir="ltr">Cheers, Andreas</div>
<div dir="ltr"><br>
<blockquote type="cite">On May 3, 2023, at 09:30, Colin Faber via lustre-discuss <lustre-discuss@lists.lustre.org> wrote:<br>
<br>
</blockquote>
</div>
<blockquote type="cite">
<div dir="ltr">
<div dir="auto">Hi,
<div dir="auto"><br>
</div>
<div dir="auto">What does your client log indicate? (dmesg / syslog)</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, May 3, 2023, 7:32 AM Jane Liu via lustre-discuss <<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hello,<br>
<br>
I'm writing to ask for your help on one issue we observed after a major <br>
upgrade of a large Lustre system from RHEL7 + 2.12.9 to RHEL8 + 2.15.2. <br>
Basically we preserved MDT disk (VDisk on a VM) and also all OST disk <br>
(JBOD) in RHEL7 and then reinstalled RHEL8 OS and then attached those <br>
preserved disks to RHEL8 OS. However, I met an issue after the OS <br>
upgrade and lustre installation.<br>
<br>
I believe the issue is related to metadata.<br>
<br>
The old MDS was a virtual machine, and the MDT vdisk was preserved <br>
during the upgrade. When a new VM was created with the same hostname and <br>
IP, the preserved MDT vdisk was attached to it. Everything seemed fine <br>
initially. However, after the client mount was completed, the file <br>
listing displayed question marks, as shown below:<br>
<br>
[root@experimds01 ~]# mount -t lustre 11.22.33.44@tcp:/experi01 <br>
/mntlustre/<br>
[root@experimds01 ~]# cd /mntlustre/<br>
[root@experimds01 mntlustre]# ls -l<br>
ls: cannot access 'experipro': No such file or directory<br>
ls: cannot access 'admin': No such file or directory<br>
ls: cannot access 'test4': No such file or directory<br>
ls: cannot access 'test3': No such file or directory<br>
total 0<br>
d????????? ? ? ? ? ? admin<br>
d????????? ? ? ? ? ? experipro<br>
-????????? ? ? ? ? ? test3<br>
-????????? ? ? ? ? ? test4<br>
<br>
I shut down the MDT and ran "e2fsck -p <br>
/dev/mapper/experimds01-experimds01". It reported "primary superblock <br>
features different from<br>
backup, check forced."<br>
<br>
[root@experimds01 ~]# e2fsck -p /dev/mapper/experimds01-experimds01<br>
experi01-MDT0000 primary superblock features different from backup, <br>
check forced.<br>
experi01-MDT0000: 9493348/429444224 files (0.5% non-contiguous), <br>
109369520/268428864 blocks<br>
<br>
Running e2fsck again showed that the filesystem was clean.<br>
[root@experimds01 /]# e2fsck -p /dev/mapper/experimds01-experimds01<br>
experi01-MDT0000: clean, 9493378/429444224 files, 109369610/268428864 <br>
blocks<br>
<br>
However, the issue persisted. The file listing continued to display <br>
question marks.<br>
<br>
Do you have any idea what could be causing this problem and how to fix <br>
it? By the way, I have an e2image backup of the MDT from the<br>
RHEL7 system just in case we need fix it using the backup. Also, after <br>
the upgrade, the command "lfs df" shows that all OSTs and MDT<br>
are fine.<br>
<br>
Thank you in advance for your assistance.<br>
<br>
Best regards,<br>
Jane<br>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank" rel="noreferrer">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</blockquote>
</div>
<span>_______________________________________________</span><br>
<span>lustre-discuss mailing list</span><br>
<span>lustre-discuss@lists.lustre.org</span><br>
<span>http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</span><br>
</div>
</blockquote>
</div>
</div>
</body>
</html>