<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Exchange Server">
<!-- converted from rtf -->
<style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left: #800000 2px solid; } --></style>
</head>
<body>
<font face="Calibri, sans-serif" size="2">
<div>Hi,</div>
<div> </div>
<div>I’m having difficulty getting one of my clients to work with a multirail IB configuration. Here’s what I’ve got:</div>
<div> </div>
<div> <b>Host </b><b>OS Version Lustre Version </b><b>Function </b><b>Storage </b><b>Interface</b><b> ib0 </b><b>Interface</b><b> ib1</b></div>
<ol style="margin-top: 0pt; margin-bottom: 0pt; margin-left: 36pt; ">
<li>bmr1-s7 CentOS 5.7 2.1.1 MGS,MDS,OSS1 mdt,mdt2,ost1->6,ost13->18 192.168.1.25/24 192.168.1.35/24</li><li>bmr1-s8 CentOS 5.7 2.1.1 OSS2 ost7->12,ost19->24 192.168.1.26/24 192.168.1.36/24</li><li>bmr1-s5 CentOS 5.7 2.1.1 OSS3 ost25->30 192.168.1.20/24 192.168.1.30/24</li><li>bmr1-s6 CentOS 5.7 2.1.1 OSS4 ost31->36 192.168.1.21/24 192.168.1.31/24</li><li>bmr2-s9 CentOS 5.7 2.1.1 Client n/a 192.168.1.209/24</li></ol>
<div> </div>
<div>The “/lustre” filesystem consists of mdt and ost1->12 (using bmr1-s7 and bmr1-s8).</div>
<div>The “/lustre2” filesystem consists of mdt2 and ost13->36 (using bmr1-s7, bmr1-s8, bmr1-s5, and bmr1-s6).</div>
<div>On each OSS, half the OSTs are available only on ib0 and the other half only on ib1.</div>
<div> </div>
<div>From bmr1-s5 and bmr1-s6 (using as clients), I can successfully mount and access “/lustre”. I can also successfully mount “/lustre2”.</div>
<div> </div>
<div>From bmr2-s9, I can neither mount “/lustre” nor “/lustre2”. Originally, the issue with bmr2-s9 was that it was running 1.8.6-wc1 (server on CentOS 5.6). Since this config (i.e., multirail) wasn’t supported on that version, I upgraded to 2.1.1. Originally,
I tried installing and testing the 2.1.1 client without success. Then, since it had worked with the 2.1.1 server on both bmr1-s5 and bmr1-s6, I thought I’d try that next. Unfortunately, it still didn’t work.</div>
<div> </div>
<div>1a) Here’s what I see on the client when I try to mount “/lustre”:</div>
<div> </div>
<div><font face="Courier New, monospace">[root@bmr2-s9 ~]# mount -t lustre <a href="mailto:192.168.1.25@o2ib:/lustre"><font color="#0000FF"><u>192.168.1.25@o2ib:/lustre</u></font></a> /mnt/lustre</font></div>
<div><font face="Courier New, monospace">mount.lustre: mount <a href="mailto:192.168.1.25@o2ib:/lustre"><font color="#0000FF"><u>192.168.1.25@o2ib:/lustre</u></font></a> at /mnt/lustre failed: No such file or directory</font></div>
<div><font face="Courier New, monospace">Is the MGS specification correct?</font></div>
<div><font face="Courier New, monospace">Is the filesystem name correct?</font></div>
<div><font face="Courier New, monospace">If upgrading, is the copied client log valid? (see upgrade docs)</font></div>
<div><font face="Courier New, monospace">[root@bmr2-s9 ~]#</font></div>
<div> </div>
<div>1b) Here’s an excerpt from “/var/log/messages” on the client (after executing the above command):</div>
<div> </div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: Lustre: 5512:0:(sec.c:1474:sptlrpc_import_sec_adapt()) import <a href="mailto:MGC192.168.1.25@o2ib->MGC192.168.1.25@o2ib_0"><font color="#0000FF"><u>MGC192.168.1.25@o2ib->MGC192.168.1.25@o2ib_0</u></font></a>
netid 50000: select flavor null</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: Lustre: <a href="mailto:MGC192.168.1.25@o2ib"><font color="#0000FF"><u>MGC192.168.1.25@o2ib</u></font></a>: Reactivating import</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: LustreError: 5523:0:(ldlm_lib.c:357:client_obd_setup()) can't add initial connection</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: LustreError: 5523:0:(obd_config.c:522:class_setup()) setup lustre-OST0001-osc-ffff81045d783c00 failed (-2)</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: LustreError: 5523:0:(obd_config.c:1361:class_config_llog_handler()) Err -2 on cfg command:</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: Lustre: cmd=cf003 0:lustre-OST0001-osc 1:lustre-OST0001_UUID 2:192.168.1.35@o2ib1 </font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: LustreError: 15c-8: <a href="mailto:MGC192.168.1.25@o2ib"><font color="#0000FF"><u>MGC192.168.1.25@o2ib</u></font></a>: The configuration from log 'lustre-client' failed (-2). This may
be the result of communication errors between this node and the MGS, a bad configuration, or other errors. See the syslog for more information.</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: LustreError: 5512:0:(llite_lib.c:950:ll_fill_super()) Unable to process log: -2</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: LustreError: 4923:0:(lov_obd.c:927:lov_cleanup()) lov tgt 0 not cleaned! deathrow=0, lovrc=1</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: LustreError: 5512:0:(obd_config.c:567:class_cleanup()) Device 5 not setup</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: LustreError: 5512:0:(ldlm_request.c:1172:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: LustreError: 5512:0:(ldlm_request.c:1799:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: Lustre: client ffff81045d783c00 umount complete</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr2-s9 kernel: LustreError: 5512:0:(obd_mount.c:2164:lustre_fill_super()) Unable to mount (-2)</font></div>
<div> </div>
<div>1c) Here’s an excerpt from “/var/log/messages” on the server (after executing the above command):</div>
<div> </div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr1-s7 kernel: Lustre: 25911:0:(ldlm_lib.c:877:target_handle_connect()) MGS: connection from <a href="mailto:2e13dea0-ec9c-0fbd-0f95-7b16246f2626@192.168.1.209@o2ib"><font color="#0000FF"><u>2e13dea0-ec9c-0fbd-0f95-7b16246f2626@192.168.1.209@o2ib</u></font></a>
t0 exp 0000000000000000 cur 1360699254 last 0</font></div>
<div><font face="Courier New, monospace">Feb 12 15:00:54 bmr1-s7 kernel: Lustre: 25911:0:(sec.c:1474:sptlrpc_import_sec_adapt()) import MGS->NET_0x50000c0a801d1_UUID netid 50000: select flavor null</font></div>
<div> </div>
<div>2a) Here’s what I see on the client when I try to mount “/lustre” (using the other interface):</div>
<div> </div>
<div><font face="Courier New, monospace">[root@bmr2-s9 ~]# mount -t lustre <a href="mailto:192.168.1.25@o2ib:/lustre"><font color="#0000FF"><u>192.168.1.25@o2ib:/lustre</u></font></a> /mnt/lustre</font></div>
<div><font face="Courier New, monospace">mount.lustre: mount <a href="mailto:192.168.1.25@o2ib:/lustre"><font color="#0000FF"><u>192.168.1.25@o2ib:/lustre</u></font></a> at /mnt/lustre failed: No such file or directory</font></div>
<div><font face="Courier New, monospace">Is the MGS specification correct?</font></div>
<div><font face="Courier New, monospace">Is the filesystem name correct?</font></div>
<div><font face="Courier New, monospace">If upgrading, is the copied client log valid? (see upgrade docs)</font></div>
<div><font face="Courier New, monospace">[root@bmr2-s9 ~]# mount -t lustre <a href="mailto:192.168.1.35@o2ib:/lustre"><font color="#0000FF"><u>192.168.1.35@o2ib:/lustre</u></font></a> /mnt/lustre</font></div>
<div><font face="Courier New, monospace">mount.lustre: mount <a href="mailto:192.168.1.35@o2ib:/lustre"><font color="#0000FF"><u>192.168.1.35@o2ib:/lustre</u></font></a> at /mnt/lustre failed: Invalid argument</font></div>
<div><font face="Courier New, monospace">This may have multiple causes.</font></div>
<div><font face="Courier New, monospace">Is 'lustre' the correct filesystem name?</font></div>
<div><font face="Courier New, monospace">Are the mount options correct?</font></div>
<div><font face="Courier New, monospace">Check the syslog for more info.</font></div>
<div><font face="Courier New, monospace">[root@bmr2-s9 ~]#</font></div>
<div> </div>
<div>2b) Here’s an excerpt from “/var/log/messages” on the client (after executing the above command):</div>
<div> </div>
<div><font face="Courier New, monospace">Feb 12 15:06:57 bmr2-s9 kernel: Lustre: 5580:0:(sec.c:1474:sptlrpc_import_sec_adapt()) import <a href="mailto:MGC192.168.1.35@o2ib->MGC192.168.1.35@o2ib_0"><font color="#0000FF"><u>MGC192.168.1.35@o2ib->MGC192.168.1.35@o2ib_0</u></font></a>
netid 50000: select flavor null</font></div>
<div><font face="Courier New, monospace">Feb 12 15:06:57 bmr2-s9 kernel: Lustre: 4948:0:(client.c:1778:ptlrpc_expire_one_request()) @@@ Request x1426793186721863 sent from <a href="mailto:MGC192.168.1.35@o2ib"><font color="#0000FF"><u>MGC192.168.1.35@o2ib</u></font></a>
to NID <a href="mailto:192.168.1.35@o2ib"><font color="#0000FF"><u>192.168.1.35@o2ib</u></font></a> has failed due to network error: [sent 1360699617] [real_sent 1360699617] [current 1360699617] [deadline 5s] [delay -5s] req@ffff81043b76e400 x1426793186721863/t0(0)
o-1-><a href="mailto:MGS@MGC192.168.1.35@o2ib_0:26/25"><font color="#0000FF"><u>MGS@MGC192.168.1.35@o2ib_0:26/25</u></font></a> lens 368/512 e 0 to 1 dl 1360699622 ref 1 fl Rpc:XN/ffffffff/ffffffff rc 0/-1</font></div>
<div><font face="Courier New, monospace">Feb 12 15:06:57 bmr2-s9 kernel: Lustre: 4948:0:(client.c:1778:ptlrpc_expire_one_request()) Skipped 1 previous similar message</font></div>
<div><font face="Courier New, monospace">Feb 12 15:06:57 bmr2-s9 kernel: LustreError: 3074:0:(o2iblnd_cb.c:2615:kiblnd_rejected()) <a href="mailto:192.168.1.35@o2ib"><font color="#0000FF"><u>192.168.1.35@o2ib</u></font></a> rejected: o2iblnd fatal error</font></div>
<div><font face="Courier New, monospace">Feb 12 15:06:57 bmr2-s9 kernel: LustreError: 3074:0:(o2iblnd_cb.c:2615:kiblnd_rejected()) Skipped 1 previous similar message</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:03 bmr2-s9 kernel: LustreError: 5580:0:(client.c:1049:ptlrpc_import_delay_req()) @@@ send limit expired req@ffff81043b76e000 x1426793186721864/t0(0) o-1-><a href="mailto:MGS@MGC192.168.1.35@o2ib_0:26/25"><font color="#0000FF"><u>MGS@MGC192.168.1.35@o2ib_0:26/25</u></font></a>
lens 296/352 e 0 to 0 dl 0 ref 2 fl Rpc:W/ffffffff/ffffffff rc 0/-1</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:03 bmr2-s9 kernel: LustreError: 5580:0:(client.c:1049:ptlrpc_import_delay_req()) Skipped 6 previous similar messages</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:22 bmr2-s9 kernel: Lustre: 4949:0:(import.c:526:import_select_connection()) <a href="mailto:MGC192.168.1.35@o2ib"><font color="#0000FF"><u>MGC192.168.1.35@o2ib</u></font></a>: tried all connections, increasing
latency to 5s</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:22 bmr2-s9 kernel: Lustre: 4948:0:(client.c:1778:ptlrpc_expire_one_request()) @@@ Request x1426793186721868 sent from <a href="mailto:MGC192.168.1.35@o2ib"><font color="#0000FF"><u>MGC192.168.1.35@o2ib</u></font></a>
to NID <a href="mailto:192.168.1.35@o2ib"><font color="#0000FF"><u>192.168.1.35@o2ib</u></font></a> has failed due to network error: [sent 1360699642] [real_sent 1360699642] [current 1360699642] [deadline 10s] [delay -10s] req@ffff810430e30800 x1426793186721868/t0(0)
o-1-><a href="mailto:MGS@MGC192.168.1.35@o2ib_0:26/25"><font color="#0000FF"><u>MGS@MGC192.168.1.35@o2ib_0:26/25</u></font></a> lens 368/512 e 0 to 1 dl 1360699652 ref 1 fl Rpc:XN/ffffffff/ffffffff rc 0/-1</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:22 bmr2-s9 kernel: LustreError: 3074:0:(o2iblnd_cb.c:2615:kiblnd_rejected()) <a href="mailto:192.168.1.35@o2ib"><font color="#0000FF"><u>192.168.1.35@o2ib</u></font></a> rejected: o2iblnd fatal error</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:24 bmr2-s9 kernel: LustreError: 5591:0:(client.c:1049:ptlrpc_import_delay_req()) @@@ send limit expired req@ffff81045d7ce800 x1426793186721867/t0(0) o-1-><a href="mailto:MGS@MGC192.168.1.35@o2ib_0:26/25"><font color="#0000FF"><u>MGS@MGC192.168.1.35@o2ib_0:26/25</u></font></a>
lens 296/352 e 0 to 0 dl 0 ref 2 fl Rpc:W/ffffffff/ffffffff rc 0/-1</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:24 bmr2-s9 kernel: LustreError: 5591:0:(client.c:1049:ptlrpc_import_delay_req()) Skipped 1 previous similar message</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:47 bmr2-s9 kernel: Lustre: 4949:0:(import.c:526:import_select_connection()) <a href="mailto:MGC192.168.1.35@o2ib"><font color="#0000FF"><u>MGC192.168.1.35@o2ib</u></font></a>: tried all connections, increasing
latency to 10s</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:47 bmr2-s9 kernel: Lustre: 4948:0:(client.c:1778:ptlrpc_expire_one_request()) @@@ Request x1426793186721872 sent from <a href="mailto:MGC192.168.1.35@o2ib"><font color="#0000FF"><u>MGC192.168.1.35@o2ib</u></font></a>
to NID <a href="mailto:192.168.1.35@o2ib"><font color="#0000FF"><u>192.168.1.35@o2ib</u></font></a> has failed due to network error: [sent 1360699667] [real_sent 1360699667] [current 1360699667] [deadline 15s] [delay -15s] req@ffff810444576c00 x1426793186721872/t0(0)
o-1-><a href="mailto:MGS@MGC192.168.1.35@o2ib_0:26/25"><font color="#0000FF"><u>MGS@MGC192.168.1.35@o2ib_0:26/25</u></font></a> lens 368/512 e 0 to 1 dl 1360699682 ref 1 fl Rpc:XN/ffffffff/ffffffff rc 0/-1</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:47 bmr2-s9 kernel: LustreError: 3074:0:(o2iblnd_cb.c:2615:kiblnd_rejected()) <a href="mailto:192.168.1.35@o2ib"><font color="#0000FF"><u>192.168.1.35@o2ib</u></font></a> rejected: o2iblnd fatal error</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:54 bmr2-s9 kernel: LustreError: 156-2: The client profile 'lustre-client' could not be read from the MGS. Does that filesystem exist?</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:54 bmr2-s9 kernel: Lustre: client ffff81045f465800 umount complete</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:54 bmr2-s9 kernel: LustreError: 5580:0:(obd_mount.c:2164:lustre_fill_super()) Unable to mount (-22)</font></div>
<div> </div>
<div>2c) Here’s an excerpt from “/var/log/messages” on the server (after executing the above command):</div>
<div> </div>
<div><font face="Courier New, monospace">Feb 12 15:06:57 bmr1-s7 kernel: LustreError: 9274:0:(o2iblnd_cb.c:2247:kiblnd_passive_connect()) Can't accept <a href="mailto:192.168.1.209@o2ib"><font color="#0000FF"><u>192.168.1.209@o2ib</u></font></a> on <a href="mailto:192.168.1.25@o2ib"><font color="#0000FF"><u>192.168.1.25@o2ib</u></font></a>
(ib1:1:192.168.1.35): bad dst nid <a href="mailto:192.168.1.35@o2ib"><font color="#0000FF"><u>192.168.1.35@o2ib</u></font></a></font></div>
<div><font face="Courier New, monospace">Feb 12 15:06:57 bmr1-s7 kernel: LustreError: 9274:0:(o2iblnd_cb.c:2247:kiblnd_passive_connect()) Skipped 2 previous similar messages</font></div>
<div><font face="Courier New, monospace">Feb 12 15:07:22 bmr1-s7 kernel: LustreError: 9274:0:(o2iblnd_cb.c:2247:kiblnd_passive_connect()) Can't accept <a href="mailto:192.168.1.209@o2ib"><font color="#0000FF"><u>192.168.1.209@o2ib</u></font></a> on <a href="mailto:192.168.1.25@o2ib"><font color="#0000FF"><u>192.168.1.25@o2ib</u></font></a>
(ib1:1:192.168.1.35): bad dst nid <a href="mailto:192.168.1.35@o2ib"><font color="#0000FF"><u>192.168.1.35@o2ib</u></font></a></font></div>
<div> </div>
<div>3) Here’s what one of the MDTs looks like (the other is similarly configured):</div>
<div> </div>
<div><font face="Courier New, monospace">[root@bmr1-s7 ~]# tunefs.lustre --dryrun --writeconf /dev/sdp</font></div>
<div><font face="Courier New, monospace">checking for existing Lustre data: found CONFIGS/mountdata</font></div>
<div><font face="Courier New, monospace">Reading CONFIGS/mountdata</font></div>
<div><font face="Courier New, monospace"> </font></div>
<div><font face="Courier New, monospace"> Read previous values:</font></div>
<div><font face="Courier New, monospace">Target: lustre-MDT0000</font></div>
<div><font face="Courier New, monospace">Index: 0</font></div>
<div><font face="Courier New, monospace">Lustre FS: lustre</font></div>
<div><font face="Courier New, monospace">Mount type: ldiskfs</font></div>
<div><font face="Courier New, monospace">Flags: 0x5</font></div>
<div><font face="Courier New, monospace"> (MDT MGS )</font></div>
<div><font face="Courier New, monospace">Persistent mount opts: iopen_nopriv,user_xattr,errors=remount-ro</font></div>
<div><font face="Courier New, monospace">Parameters: <a href="mailto:mgsnode=192.168.1.25@o2ib,192.168.1.35@o2ib1,10.244.78.88@tcp,192.168.1.25@tcp1"><font color="#0000FF"><u>mgsnode=192.168.1.25@o2ib,192.168.1.35@o2ib1,10.244.78.88@tcp,192.168.1.25@tcp1</u></font></a></font></div>
<div> </div>
<div> </div>
<div><font face="Courier New, monospace"> Permanent disk data:</font></div>
<div><font face="Courier New, monospace">Target: lustre-MDT0000</font></div>
<div><font face="Courier New, monospace">Index: 0</font></div>
<div><font face="Courier New, monospace">Lustre FS: lustre</font></div>
<div><font face="Courier New, monospace">Mount type: ldiskfs</font></div>
<div><font face="Courier New, monospace">Flags: 0x105</font></div>
<div><font face="Courier New, monospace"> (MDT MGS writeconf )</font></div>
<div><font face="Courier New, monospace">Persistent mount opts: iopen_nopriv,user_xattr,errors=remount-ro</font></div>
<div><font face="Courier New, monospace">Parameters: <a href="mailto:mgsnode=192.168.1.25@o2ib,192.168.1.35@o2ib1,10.244.78.88@tcp,192.168.1.25@tcp1"><font color="#0000FF"><u>mgsnode=192.168.1.25@o2ib,192.168.1.35@o2ib1,10.244.78.88@tcp,192.168.1.25@tcp1</u></font></a></font></div>
<div> </div>
<div><font face="Courier New, monospace">exiting before disk write.</font></div>
<div><font face="Courier New, monospace">[root@bmr1-s7 ~]#</font></div>
<div> </div>
<div>4) Here’s what one of the OSTs looks like (the others are similarly configured):</div>
<div> </div>
<div><font face="Courier New, monospace">[root@bmr1-s7 ~]# tunefs.lustre --dryrun --writeconf /dev/sdf</font></div>
<div><font face="Courier New, monospace">checking for existing Lustre data: found CONFIGS/mountdata</font></div>
<div><font face="Courier New, monospace">Reading CONFIGS/mountdata</font></div>
<div><font face="Courier New, monospace"> </font></div>
<div><font face="Courier New, monospace"> Read previous values:</font></div>
<div><font face="Courier New, monospace">Target: lustre-OST0000</font></div>
<div><font face="Courier New, monospace">Index: 0</font></div>
<div><font face="Courier New, monospace">Lustre FS: lustre</font></div>
<div><font face="Courier New, monospace">Mount type: ldiskfs</font></div>
<div><font face="Courier New, monospace">Flags: 0x2</font></div>
<div><font face="Courier New, monospace"> (OST )</font></div>
<div><font face="Courier New, monospace">Persistent mount opts: errors=remount-ro,extents,mballoc</font></div>
<div><font face="Courier New, monospace">Parameters: <a href="mailto:mgsnode=192.168.1.25@o2ib,192.168.1.35@o2ib1,10.244.78.88@tcp,192.168.1.25@tcp1"><font color="#0000FF"><u>mgsnode=192.168.1.25@o2ib,192.168.1.35@o2ib1,10.244.78.88@tcp,192.168.1.25@tcp1</u></font></a>
network=o2ib0</font></div>
<div><font face="Courier New, monospace"> </font></div>
<div><font face="Courier New, monospace"> </font></div>
<div><font face="Courier New, monospace"> Permanent disk data:</font></div>
<div><font face="Courier New, monospace">Target: lustre-OST0000</font></div>
<div><font face="Courier New, monospace">Index: 0</font></div>
<div><font face="Courier New, monospace">Lustre FS: lustre</font></div>
<div><font face="Courier New, monospace">Mount type: ldiskfs</font></div>
<div><font face="Courier New, monospace">Flags: 0x102</font></div>
<div><font face="Courier New, monospace"> (OST writeconf )</font></div>
<div><font face="Courier New, monospace">Persistent mount opts: errors=remount-ro,extents,mballoc</font></div>
<div><font face="Courier New, monospace">Parameters: <a href="mailto:mgsnode=192.168.1.25@o2ib,192.168.1.35@o2ib1,10.244.78.88@tcp,192.168.1.25@tcp1"><font color="#0000FF"><u>mgsnode=192.168.1.25@o2ib,192.168.1.35@o2ib1,10.244.78.88@tcp,192.168.1.25@tcp1</u></font></a>
network=o2ib0</font></div>
<div><font face="Courier New, monospace"> </font></div>
<div><font face="Courier New, monospace">exiting before disk write.</font></div>
<div><font face="Courier New, monospace">[root@bmr1-s7 ~]#</font></div>
<div> </div>
<div>I’d appreciate any help or direction on a potential resolution. Let me know what additional information is needed, if any. Hopefully, I’m just missing something simple.</div>
<div> </div>
<div>Thanks in advance,</div>
<div>…Brian</div>
<div> </div>
<div> </div>
</font>
</body>
</html>