<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Good Morning,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Yesterday one of our lustre file servers rebooted several times. the crash dump showed:</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<div style="box-sizing: border-box; font-family: "Segoe UI", system-ui, "Apple Color Emoji", "Segoe UI Emoji", sans-serif; font-size: 14px; orphans: 2; widows: 2">
[14333982.153989] Pid: 381367, comm: ll_ost_io01_076 3.10.0-957.10.1.el7_lustre.x86_64 #1 SMP Tue Apr 30 22:18:15 UTC 2019<br>
[14333982.153989] Kernel panic - not syncing: LBUG<br>
[14333982.153990] Call Trace:<br>
[14333982.153993] CPU: 4 PID: 380760 Comm: ll_ost_io01_072 Kdump: loaded Tainted: P OE ------------ 3.10.0-957.10.1.el7_lustre.x86_64 #1<br>
[14333982.153994] Hardware name: Supermicro Super Server/X11DPL-i, BIOS 3.1 05/21/2019<br>
[14333982.153995] Call Trace:<br>
[14333982.154002] [<ffffffffbaf62e41>] dump_stack+0x19/0x1b<br>
[14333982.154006] [<ffffffffbaf5c550>] panic+0xe8/0x21f<br>
[14333982.154018] [<ffffffffc0ab87cc>] libcfs_call_trace+0x8c/0xc0 [libcfs]<br>
[14333982.154026] [<ffffffffc0ab88cb>] lbug_with_loc+0x9b/0xa0 [libcfs]<br>
[14333982.154036] [<ffffffffc0ab887c>] lbug_with_loc+0x4c/0xa0 [libcfs]<br>
[14333982.154096] [<ffffffffc12dfae0>] tgt_grant_incoming.isra.6+0x570/0x570 [ptlrpc]<br>
[14333982.154174] [<ffffffffc12dfae0>] tgt_grant_prepare_read+0x0/0x3b0 [ptlrpc]<br>
[14333982.154232] [<ffffffffc12dfbeb>] tgt_grant_prepare_read+0x10b/0x3b0 [ptlrpc]<br>
[14333982.154297] [<ffffffffc12dfbeb>] tgt_grant_prepare_read+0x10b/0x3b0 [ptlrpc]<br>
[14333982.154306] [<ffffffffc15e1ad0>] ofd_preprw+0x450/0x1160 [ofd]</div>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
lustre versions:<span><br>
</span>
<div>lustre-resource-agents-2.12.1-1.el7.x86_64<br>
</div>
<div>lustre-2.12.1-1.el7.x86_64<br>
</div>
<div>kernel-devel-3.10.0-957.10.1.el7_lustre.x86_64<br>
</div>
<div>lustre-osd-zfs-mount-2.12.1-1.el7.x86_64<br>
</div>
<div>kernel-headers-3.10.0-957.10.1.el7_lustre.x86_64<br>
</div>
<div>kernel-3.10.0-957.10.1.el7_lustre.x86_64<br>
</div>
<span>lustre-zfs-dkms-2.12.1-1.el7.noarch</span><br>
</div>
<div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Could this be: <a href="https://jira.whamcloud.com/browse/LU-12120" id="LPlnk282199">
https://jira.whamcloud.com/browse/LU-12120</a><br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
w/r,<br>
</div>
<div id="Signature">
<div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size: 12pt; color: rgb(0, 0, 0); font-family: Calibri, Helvetica, sans-serif;">
<p style="margin-top: 0px; margin-bottom: 0px;margin-top:0; margin-bottom:0"><span id="ms-rterangepaste-start"></span><span style="color: rgb(51, 51, 51); font-family: monospace; font-size: 14.16px;">Kurt J. Strosahl</span><br style="color: rgb(51, 51, 51); font-family: monospace; font-size: 14.16px;">
<span style="color: rgb(51, 51, 51); font-family: monospace; font-size: 14.16px;">System Administrator: Lustre, HPC</span><br style="color: rgb(51, 51, 51); font-family: monospace; font-size: 14.16px;">
<span style="color: rgb(51, 51, 51); font-family: monospace; font-size: 14.16px;">Scientific Computing Group, Thomas Jefferson National Accelerator Facility</span><span id="ms-rterangepaste-end"></span><br>
</p>
</div>
</div>
</div>
</div>
</body>
</html>