<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div>You're getting multipathing errors, which means it's most likely not a filesystem-level issue.  See if you can get the logs from the storage array as well, there might be some detail there as to what is happening.</div>
<div><br>
</div>
<div>Can you check your logs and determine if it's a single connection that is always failing?  If so, can you try replacing the cable and see if that clears it up?  Next would be checking to make sure that the source and destination SAS ports are good.</div>
<div><br>
</div>
<div>-Ben Evans</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>lustre-discuss <<a href="mailto:lustre-discuss-bounces@lists.lustre.org">lustre-discuss-bounces@lists.lustre.org</a>> on behalf of Angelo Cavalcanti <<a href="mailto:acrribeiro@gmail.com">acrribeiro@gmail.com</a>><br>
<span style="font-weight:bold">Date: </span>Monday, March 28, 2016 at 10:01 AM<br>
<span style="font-weight:bold">To: </span>"<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>" <<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>><br>
<span style="font-weight:bold">Subject: </span>[lustre-discuss] Error Lustre/multipath/storage<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr">
<div style="font-size:12.8px">
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Dear all,</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">We're having trouble with a lustre 2.5.3 implementation. This is
 our setup:</span></p>
<br>
<ul style="margin-top:0pt;margin-bottom:0pt">
<li dir="ltr" style="margin-left:15px;list-style-type:disc;font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;vertical-align:baseline;background-color:transparent">One server for MGS/MDS/MDT. MDT is served from a raid-6 backed partition of 2TB (que tipo de hd?)</span></p>
</li></ul>
<br>
<ul style="margin-top:0pt;margin-bottom:0pt">
<li dir="ltr" style="margin-left:15px;list-style-type:disc;font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;vertical-align:baseline;background-color:transparent">Two OSS/OST in a active/active HA with pacemaker. Both are connected to a storage via SAS.</span></p>
</li></ul>
<br>
<ul style="margin-top:0pt;margin-bottom:0pt">
<li dir="ltr" style="margin-left:15px;list-style-type:disc;font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">
<span style="font-size:14.6667px;vertical-align:baseline;background-color:transparent">One SGI Infinite Storage IS5600 with two raid-6 backed volume groups. Each group has two volumes, each volume has 15TB capacity.</span></li></ul>
<div><font color="#000000" face="Arial"><span style="font-size:14.6667px"><br>
</span></font></div>
</div>
<div style="font-size:12.8px">
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Volumes are recognized by OSSs as multipath devices, each voulme
 has 4 paths. Volumes were created with a GPT partition table and a single partition.</span></p>
<br>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Volume partitions were then formatted as OSTs with the following
 command:</span></p>
<br>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"># mkfs.lustre --replace --reformat --ost --mkfsoptions=" -E stride=128,stripe_width=1024"
 --mountfsoptions="errors=remount-ro,extents,mballoc" --fsname=lustre1 --mgsnode=10.149.0.153@o2ib1 --index=0 --servicenode=10.149.0.151@o2ib1 --servicenode=10.149.0.152@o2ib1 /dev/mapper/360080e500029eaec0000012656951fcap1</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><br>
</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Testing with bonnie++ in a client with the below command:</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><span style="font-size:14.6667px;vertical-align:baseline;background-color:transparent">$
 ./bonnie++-1.03e/bonnie++ -m lustre1 -d /mnt/lustre -s 128G:1024k -n 0 -f -b -u vhpc</span><br>
</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><span style="font-size:14.6667px;vertical-align:baseline;background-color:transparent"><br>
</span></span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">No problem creating files inside the lustre mount point, but *rewriting*
 the same files results in the errors below:</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><span style="font-size:14.6667px;vertical-align:baseline;background-color:transparent"><br>
</span></span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 multipathd: 8:128: mark as failed</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 multipathd: 360080e500029eaec0000012656951fca:
 remaining active paths: 3</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 1:0:0:0: [sdi] Unhandled error
 code</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 1:0:0:0: [sdi] Result: hostbyte=DID_SOFT_ERROR
 driverbyte=DRIVER_OK</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 1:0:0:0: [sdi] CDB: Read(10):
 28 00 00 06 d8 22 00 20 00 00</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: __ratelimit: 109 callbacks suppressed</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: device-mapper: multipath: Failing
 path 8:128.</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 1:0:1:0: [sdm] Unhandled error
 code</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 1:0:1:0: [sdm] Result: hostbyte=DID_SOFT_ERROR
 driverbyte=DRIVER_OK</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 1:0:1:0: [sdm] CDB: Read(10):
 28 00 00 07 18 22 00 18 00 00</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: device-mapper: multipath: Failing
 path 8:192.</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 1:0:1:0: [sdm] Unhandled error
 code</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 1:0:1:0: [sdm] Result: hostbyte=DID_SOFT_ERROR
 driverbyte=DRIVER_OK</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 1:0:1:0: [sdm] CDB: Read(10):
 28 00 00 06 d8 22 00 20 00 00</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 0:0:1:0: [sde] Unhandled error
 code</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 0:0:1:0: [sde] Result: hostbyte=DID_SOFT_ERROR
 driverbyte=DRIVER_OK</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 0:0:1:0: [sde] CDB: Read(10):
 28 00 00 07 18 22 00 18 00 00</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: device-mapper: multipath: Failing
 path 8:64.</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 0:0:0:0: [sda] Unhandled error
 code</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 0:0:0:0: [sda] Result: hostbyte=DID_SOFT_ERROR
 driverbyte=DRIVER_OK</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 0:0:0:0: [sda] CDB: Read(10):
 28 00 00 07 18 22 00 18 00 00</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: device-mapper: multipath: Failing
 path 8:0.</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 0:0:0:0: [sda] Unhandled error
 code</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 0:0:0:0: [sda] Result: hostbyte=DID_SOFT_ERROR
 driverbyte=DRIVER_OK</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:13 oss01 kernel: sd 0:0:0:0: [sda] CDB: Read(10):
 28 00 00 06 d8 22 00 20 00 00</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 360080e500029eaec0000012656951fca:
 sdi - rdac checker reports path is up</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 8:128: reinstated</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 360080e500029eaec0000012656951fca:
 remaining active paths: 4</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 kernel: sd 1:0:0:0: [sdi] Unhandled error
 code  </span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 kernel: sd 1:0:0:0: [sdi] Result: hostbyte=DID_SOFT_ERROR
 driverbyte=DRIVER_OK</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 kernel: sd 1:0:0:0: [sdi] CDB: Read(10):
 28 00 00 07 18 22 00 18 00 00  </span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 kernel: device-mapper: multipath: Failing
 path 8:128.</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 kernel: sd 1:0:0:0: [sdi] Unhandled error
 code  </span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 kernel: sd 1:0:0:0: [sdi] Result: hostbyte=DID_SOFT_ERROR
 driverbyte=DRIVER_OK</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 kernel: sd 1:0:0:0: [sdi] CDB: Read(10):
 28 00 00 06 d8 22 00 20 00 00</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 8:128: mark as failed</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 360080e500029eaec0000012656951fca:
 remaining active paths: 3</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 8:192: mark as failed</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 360080e500029eaec0000012656951fca:
 remaining active paths: 2</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 8:0: mark as failed</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 360080e500029eaec0000012656951fca:
 remaining active paths: 1</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 8:64: mark as failed  </span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 360080e500029eaec0000012656951fca:
 Entering recovery mode: max_retries=30</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 360080e500029eaec0000012656951fca:
 remaining active paths: 0</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:14 oss01 multipathd: 360080e500029eaec0000012656951fca:
 Entering recovery mode: max_retries=30</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><span style="font-size:14.6667px;vertical-align:baseline;background-color:transparent"></span></span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Mar 18 17:46:19 oss01 multipathd: 360080e500029eaec0000012656951fca:
 sdi - rdac checker reports path is up</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><br>
</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Multipath configuration ( /etc/multipath.conf ) is below, and is
 correct according to the vendor (SGI).</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><br>
</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">defaults {</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">user_friendly_names
 no</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">}</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><br>
</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">blacklist {</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">wwid
 "*"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">}</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><br>
</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">blacklist_exceptions {</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">wwid
 "360080e500029eaec0000012656951fca"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">wwid
 "360080e500029eaec0000012956951fcb"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">wwid
 "360080e500029eaec0000012c56951fcb"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">wwid
 "360080e500029eaec0000012f56951fcb"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">}</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><br>
</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">devices {</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">  </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">device
 {</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">vendor
                   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"SGI"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">product
                  </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"IS.*"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">product_blacklist
        </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"Universal
 Xport"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">getuid_callout
           </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"/lib/udev/scsi_id
 --whitelisted --device=/dev/%n"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">prio
                     </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"rdac"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">features
                 </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"2
 pg_init_retries 50"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">hardware_handler
         </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"1
 rdac"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">path_grouping_policy
     </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"group_by_prio"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">failback
                 </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"immediate"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">rr_weight
                </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"uniform"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">no_path_retry
            </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">30</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">retain_attached_hw_handler
   "yes"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">detect_prio
              </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"yes"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">#rr_min_io
               </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">1000</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">path_checker
             </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"rdac"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">#selector
                </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">"round-robin
 0"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">#polling_interval
        </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">10</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">  </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">}</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">}</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><br>
<br>
</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">multipaths {</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">multipath
 {</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">           </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">wwid
 "360080e500029eaec0000012656951fca"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">}</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">multipath
 {</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">           </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">wwid
 "360080e500029eaec0000012956951fcb"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">}</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">multipath
 {</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">           </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">wwid
 "360080e500029eaec0000012c56951fcb"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">}</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">multipath
 {</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">           </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">wwid
 "360080e500029eaec0000012f56951fcb"</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">   </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">    </span><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">}</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"></span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">}</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><br>
</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Consolas;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"></span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">Many many combinations of OST formating options were tried, internal
 and external journaling … But the same errors persist.</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"><br>
</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent"></span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;font-family:Arial;color:rgb(0,0,0);vertical-align:baseline;background-color:transparent">The same bonnie++ tests were repeated on all volumes of the storage
 using only ext4, all successful.</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;color:rgb(0,0,0);font-family:Arial;line-height:1.38;background-color:transparent"><br>
</span></p>
<p style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;color:rgb(0,0,0);font-family:Arial;line-height:1.38;background-color:transparent">Regards,</span></p>
<p style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:14.6667px;color:rgb(0,0,0);font-family:Arial;line-height:1.38;background-color:transparent">Angelo</span></p>
</div>
</div>
</div>
</div>
</span>
</body>
</html>