<div dir="ltr">Did you check to see if you're experiencing any group upcall errors on the MDS? Have you tried disabling group upcall on the MDS?<div><br></div><div>Also, when looking at the problematic files with lfs getstripe, have you verified that those objects exist? Any errors about missing objects on the OSTs? Any other errors?</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Mar 13, 2017 at 2:25 PM, Vicker, Darby (JSC-EG311) <span dir="ltr"><<a href="mailto:darby.vicker-1@nasa.gov" target="_blank">darby.vicker-1@nasa.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="white" lang="EN-US" link="blue" vlink="purple">
<div class="m_-7337078374788761849WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">Yes, we use LDAP on the servers and the clients so all nodes get user info from the same source.
<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><u></u> <u></u></span></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-family:Calibri;color:black">From: </span>
</b><span style="font-family:Calibri;color:black">Colin Faber <<a href="mailto:cfaber@gmail.com" target="_blank">cfaber@gmail.com</a>><br>
<b>Date: </b>Monday, March 13, 2017 at 2:39 PM<br>
<b>To: </b>Darby Vicker <<a href="mailto:darby.vicker-1@nasa.gov" target="_blank">darby.vicker-1@nasa.gov</a>><br>
<b>Cc: </b>"Gibbins, Faye" <<a href="mailto:Faye.Gibbins@cirrus.com" target="_blank">Faye.Gibbins@cirrus.com</a>>, Murshid Azman <<a href="mailto:murshid.azman@gmail.com" target="_blank">murshid.azman@gmail.com</a>>, "<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.<wbr>org</a>" <<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.<wbr>org</a>></span></p><div><div class="h5"><br>
<b>Subject: </b>Re: [lustre-discuss] Odd file permission help please. Has lustre corrupted?<u></u><u></u></div></div><p></p>
</div><div><div class="h5">
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Is your authentication system across all of your lustre nodes in sync?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Mon, Mar 13, 2017 at 9:08 AM, Vicker, Darby (JSC-EG311) <<a href="mailto:darby.vicker-1@nasa.gov" target="_blank">darby.vicker-1@nasa.gov</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">We have the same thing happening on one of our lustre file system (2.4.3 servers, 2.9 client). All OST’s are connected so that’s
not the problem. We do use ACL’s so I was hopeful this was the cause for us too. But this doesn’t seem to be the case – any operation on the problem directory just gives “stale file handle”. How did you clear the ACL’s – just the “setfacl -b" command? I
don’t see anything in the system logs on the MDS or the OSS’s when I try to do something with the problem directory. Any other ideas?
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Courier">[root@dvicker mirrors]# ls -l</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Courier">ls: cannot access cpas: Stale file handle</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Courier">drwxr-s--- 5 root g27122 4096 Nov 14 08:31 cev-repo</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Courier">d????????? ? ? ? ? ? cpas</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Courier">drwxrwxr-x 5 root eg3 4096 Aug 21 2014 sls</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Courier">[root@dvicker mirrors]# getfacl cpas
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Courier">getfacl: cpas: Stale file handle</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Courier">[root@dvicker mirrors]# setfacl -b cpas
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Courier">setfacl: cpas: Stale file handle</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Courier">[root@dvicker mirrors]#</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Courier"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"> </span><u></u><u></u></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-family:Calibri;color:black">From:
</span></b><span style="font-family:Calibri;color:black">lustre-discuss <<a href="mailto:lustre-discuss-bounces@lists.lustre.org" target="_blank">lustre-discuss-bounces@lists.<wbr>lustre.org</a>> on behalf of "Gibbins, Faye" <<a href="mailto:Faye.Gibbins@cirrus.com" target="_blank">Faye.Gibbins@cirrus.com</a>><br>
<b>Date: </b>Friday, March 10, 2017 at 4:13 AM<br>
<b>To: </b>Murshid Azman <<a href="mailto:murshid.azman@gmail.com" target="_blank">murshid.azman@gmail.com</a>>, "<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.<wbr>org</a>" <<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.<wbr>org</a>></span><u></u><u></u></p>
<div>
<div>
<p class="MsoNormal"><br>
<b>Subject: </b>Re: [lustre-discuss] Odd file permission help please. Has lustre corrupted?<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">Hi Azman,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">When I run “lctl dl” on the client here’s what I get:</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">Snip---</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> 0 UP mgc MGC172.23.9.20@tcp 86074c24-8612-13ff-5fd2-<wbr>f3701bb50072 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> 1 UP lov results-clilov-<wbr>ffff882021fed000 051cf9bc-1069-4e7e-faea-<wbr>9957b1f9c7a4 4</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> 2 UP lov tools-clilov-ffff881023c96000 a25d30ee-5b94-94e3-a984-<wbr>2d2892793d9a 4</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> 3 UP lmv results-clilmv-<wbr>ffff882021fed000 051cf9bc-1069-4e7e-faea-<wbr>9957b1f9c7a4 4</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> 4 UP lmv tools-clilmv-ffff881023c96000 a25d30ee-5b94-94e3-a984-<wbr>2d2892793d9a 4</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> 5 UP mdc results-MDT0000-mdc-<wbr>ffff882021fed000 051cf9bc-1069-4e7e-faea-<wbr>9957b1f9c7a4 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> 6 UP mdc tools-MDT0000-mdc-<wbr>ffff881023c96000 a25d30ee-5b94-94e3-a984-<wbr>2d2892793d9a 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> 7 UP osc results-OST0000-osc-<wbr>ffff882021fed000 051cf9bc-1069-4e7e-faea-<wbr>9957b1f9c7a4 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> 8 UP osc tools-OST0000-osc-<wbr>ffff881023c96000 a25d30ee-5b94-94e3-a984-<wbr>2d2892793d9a 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> 9 UP osc results-OST0001-osc-<wbr>ffff882021fed000 051cf9bc-1069-4e7e-faea-<wbr>9957b1f9c7a4 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">10 UP osc tools-OST0001-osc-<wbr>ffff881023c96000 a25d30ee-5b94-94e3-a984-<wbr>2d2892793d9a 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">11 UP osc results-OST0002-osc-<wbr>ffff882021fed000 051cf9bc-1069-4e7e-faea-<wbr>9957b1f9c7a4 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">12 UP osc tools-OST0002-osc-<wbr>ffff881023c96000 a25d30ee-5b94-94e3-a984-<wbr>2d2892793d9a 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">13 UP lov audiodb-clilov-<wbr>ffff882023ba3000 b3c8c4c9-4001-3a7c-e857-<wbr>b52850abde1c 4</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">14 UP lmv audiodb-clilmv-<wbr>ffff882023ba3000 b3c8c4c9-4001-3a7c-e857-<wbr>b52850abde1c 4</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">15 UP mdc audiodb-MDT0000-mdc-<wbr>ffff882023ba3000 b3c8c4c9-4001-3a7c-e857-<wbr>b52850abde1c 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">16 UP osc audiodb-OST0000-osc-<wbr>ffff882023ba3000 b3c8c4c9-4001-3a7c-e857-<wbr>b52850abde1c 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">17 UP osc audiodb-OST0001-osc-<wbr>ffff882023ba3000 b3c8c4c9-4001-3a7c-e857-<wbr>b52850abde1c 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">18 UP osc audiodb-OST0002-osc-<wbr>ffff882023ba3000 b3c8c4c9-4001-3a7c-e857-<wbr>b52850abde1c 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">19 UP osc audiodb-OST0003-osc-<wbr>ffff882023ba3000 b3c8c4c9-4001-3a7c-e857-<wbr>b52850abde1c 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">20 UP lov scratch-clilov-<wbr>ffff8810200e7000 02a0eda5-bd4b-c2f6-953f-<wbr>54f0930149e3 4</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">21 UP lmv scratch-clilmv-<wbr>ffff8810200e7000 02a0eda5-bd4b-c2f6-953f-<wbr>54f0930149e3 4</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">22 UP osc scratch-OST0000-osc-<wbr>ffff8810200e7000 02a0eda5-bd4b-c2f6-953f-<wbr>54f0930149e3 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">23 UP mdc scratch-MDT0000-mdc-<wbr>ffff8810200e7000 02a0eda5-bd4b-c2f6-953f-<wbr>54f0930149e3 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">24 UP osc scratch-OST0001-osc-<wbr>ffff8810200e7000 02a0eda5-bd4b-c2f6-953f-<wbr>54f0930149e3 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">25 UP osc scratch-OST0002-osc-<wbr>ffff8810200e7000 02a0eda5-bd4b-c2f6-953f-<wbr>54f0930149e3 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">26 UP osc scratch-OST0004-osc-<wbr>ffff8810200e7000 02a0eda5-bd4b-c2f6-953f-<wbr>54f0930149e3 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">27 UP osc audiodb-OST0005-osc-<wbr>ffff882023ba3000 b3c8c4c9-4001-3a7c-e857-<wbr>b52850abde1c 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">28 UP osc audiodb-OST0004-osc-<wbr>ffff882023ba3000 b3c8c4c9-4001-3a7c-e857-<wbr>b52850abde1c 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">29 UP osc scratch-OST0005-osc-<wbr>ffff8810200e7000 02a0eda5-bd4b-c2f6-953f-<wbr>54f0930149e3 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">30 UP osc scratch-OST0003-osc-<wbr>ffff8810200e7000 02a0eda5-bd4b-c2f6-953f-<wbr>54f0930149e3 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">31 UP osc scratch-OST0006-osc-<wbr>ffff8810200e7000 02a0eda5-bd4b-c2f6-953f-<wbr>54f0930149e3 5</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">Snip---</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">With someone else’s help I discovered that this was caused by an ACL setting on the parent directory and clearing
out all the ACL’s fixed it.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">Thanks for responding.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">Yours</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d">Faye</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:Calibri">From:</span></b><span style="font-size:11.0pt;font-family:Calibri"> Murshid Azman [mailto:<a href="mailto:murshid.azman@gmail.com" target="_blank">murshid.azman@gmail.<wbr>com</a>]
<br>
<b>Sent:</b> 10 March 2017 09:22<br>
<b>To:</b> Gibbins, Faye <<a href="mailto:Faye.Gibbins@cirrus.com" target="_blank">Faye.Gibbins@cirrus.com</a>>;
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.<wbr>org</a><br>
<b>Subject:</b> Re: [lustre-discuss] Odd file permission help please. Has lustre corrupted?</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal">I suspect the OST that hosts the file is not mounted. What does lctl dl gives you on a client?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Murshid.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<div>
<p class="MsoNormal">On Fri, Mar 10, 2017 at 5:19 PM Gibbins, Faye <<a href="mailto:Faye.Gibbins@cirrus.com" target="_blank">Faye.Gibbins@cirrus.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal">Hi,<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">One of the directories on my lustre file system is showing up like this when I do an ‘ls -l’ on its parent directory.
<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">d?????????? ? ? ? ? ? L004.Korean<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">This is happening on every machine the file system is mounted upon.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Can anyone offer advice on what I should do?<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal"><span class="m_-7337078374788761849m8225546563717212309gmailmsg">Yours</span><u></u><u></u></p>
<p class="MsoNormal"><span class="m_-7337078374788761849m8225546563717212309gmailmsg">Faye Gibbins</span><u></u><u></u></p>
<p class="MsoNormal"><span class="m_-7337078374788761849m8225546563717212309gmailmsg"> </span><u></u><u></u></p>
<p class="MsoNormal"><span class="m_-7337078374788761849m8225546563717212309gmailmsg"><span style="font-size:9.0pt;color:#9cc2e5">Snr SysAdmin, Unix Lead Architect</span></span><u></u><u></u></p>
<p class="MsoNormal"><span class="m_-7337078374788761849m8225546563717212309gmailmsg"><span style="font-size:9.0pt;color:#9cc2e5">Software Systems and Cloud Services</span></span><u></u><u></u></p>
<p class="MsoNormal"><span class="m_-7337078374788761849m8225546563717212309gmailmsg"><span style="font-size:9.0pt;color:#9cc2e5">Cirrus Logic</span></span><u></u><u></u></p>
<p class="MsoNormal"><span class="m_-7337078374788761849m8225546563717212309gmailmsg"><span style="font-size:9.0pt;color:#9cc2e5">0131 272 7398</span></span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<p class="MsoNormal">This message and any attachments may contain privileged and confidential information that is intended solely for the person(s) to whom it is addressed. If you are not an intended
recipient you must not: read; copy; distribute; discuss; take any action in or make any reliance upon the contents of this message; nor open or read any attachment. If you have received this message in error, please notify us as soon as possible on the following
telephone number and destroy this message including any attachments. Thank you. Cirrus Logic International (UK) Ltd and Cirrus Logic International Semiconductor Ltd are companies registered in Scotland, with registered numbers SC089839 and SC495735 respectively.
Our registered office is at 7B Nightingale Way, Quartermile, Edinburgh, EH3 9EG, UK. Tel:
<a href="tel:+44%20131%20272%207000" target="_blank">+44 (0)131 272 7000</a>. <a href="http://cirrus.com" target="_blank">
cirrus.com</a> <u></u><u></u></p>
</div>
<p class="MsoNormal">______________________________<wbr>_________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.<wbr>org</a><br>
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_listinfo.cgi_lustre-2Ddiscuss-2Dlustre.org&d=DwMFaQ&c=O3LcjD-V2Iepl5V0N1424A&r=zYKOt5zq8DxD76qBilrgQKxtITGPmVmWHHVOs6JpkMQ&m=DqIEV0rCNQ-ocxqd1iMlhz2gLmttsgnqpPm72u7HZgc&s=O29C6o1pSQeWGsv98jXzM7ZaEB_1HeHNn43-LncGoAU&e=" target="_blank">http://lists.lustre.org/<wbr>listinfo.cgi/lustre-discuss-<wbr>lustre.org</a><u></u><u></u></p>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
______________________________<wbr>_________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.<wbr>org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" target="_blank">http://lists.lustre.org/<wbr>listinfo.cgi/lustre-discuss-<wbr>lustre.org</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div></div></div>
</div>
</blockquote></div><br></div>