<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 12 (filtered medium)">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
color:black;}
span.EmailStyle18
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:"Consolas","serif";
color:black;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;
font-weight:normal;
font-style:normal;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor=white lang=EN-US link=blue vlink=purple>
<div class=WordSection1>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>Yong,<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>Thanks. I’ll
try the explicit mount option. I assume the patch will land in 2.1.<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>Steve<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'><o:p> </o:p></span></p>
<div style='border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt'>
<div>
<div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'>
<p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";
color:windowtext'>From:</span></b><span style='font-size:10.0pt;font-family:
"Tahoma","sans-serif";color:windowtext'> Fan Yong
[mailto:yong.fan@whamcloud.com] <br>
<b>Sent:</b> Tuesday, January 18, 2011 10:21 PM<br>
<b>To:</b> lustre-discuss@lists.lustre.org<br>
<b>Subject:</b> Re: [Lustre-discuss] RHEL54 / Lustre 2.0.0.1 mds_getxattr -95
errors<o:p></o:p></span></p>
</div>
</div>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal>I think you met the issues I mentioned in: <br>
<a href="http://jira.whamcloud.com/browse/ORNL-3">http://jira.whamcloud.com/browse/ORNL-3</a><br>
<br>
I have made patch for it and in testing.<br>
Before the patch landed, you can mount MDT with "-o acl" or "-o noacl"
explicitly to avoid these confused messages.<br>
<br>
--<br>
Nasf<br>
<br>
On 1/18/11 10:39 PM, CHU, STEPHEN H (ATTSI) wrote: <o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>Hi all,</span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'> </span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>I recently
loaded the following on my testbed to try out Lustre 2.0:</span><o:p></o:p></p>
<p class=MsoListParagraph style='text-indent:-.25in'><span style='font-size:
14.0pt;color:#1F497D'>One MDS – RHEL 54, Lustre 2.0</span><o:p></o:p></p>
<p class=MsoListParagraph style='margin-left:1.0in;text-indent:-.25in'><span
style='font-size:14.0pt;color:#1F497D'>mkfs.lustre --fsname=lufs --reformat
--mgs --mdt --param lov.stripesize=25M --param lov.stripecount=1 /dev/sda2</span><o:p></o:p></p>
<p class=MsoListParagraph style='margin-left:1.0in;text-indent:-.25in'><span
style='font-size:14.0pt;color:#1F497D'>/etc/fstab =
/dev/sda2
/lustre1-mgs-mds
lustre rw,noauto,_netdev 0 0</span><o:p></o:p></p>
<p class=MsoListParagraph style='text-indent:-.25in'><span style='font-size:
14.0pt;color:#1F497D'>One OSS – RHEL 54, Lustre 2.0</span><o:p></o:p></p>
<p class=MsoListParagraph style='margin-left:1.0in;text-indent:-.25in'><span
style='font-size:14.0pt;color:#1F497D'>mkfs.lustre --fsname=lufs --reformat
--ost --mgsnode=10.103.34.42@o2ib0 /dev/sdb</span><o:p></o:p></p>
<p class=MsoListParagraph style='margin-left:1.0in;text-indent:-.25in'><span
style='font-size:14.0pt;color:#1F497D'>mkfs.lustre --fsname=lufs --reformat
--ost --mgsnode=10.103.34.42@o2ib0 /dev/sdc</span><o:p></o:p></p>
<p class=MsoListParagraph style='margin-left:1.0in;text-indent:-.25in'><span
style='font-size:14.0pt;color:#1F497D'>/etc/fstab =
/dev/sdb
/lustre1/ost1 lustre
rw,noauto,_netdev 0 0</span><o:p></o:p></p>
<p class=MsoListParagraph style='margin-left:1.0in;text-indent:-.25in'><span
style='font-size:14.0pt;color:#1F497D'> /dev/sdc
/lustre1/ost2
lustre rw,noauto,_netdev 0 0</span><o:p></o:p></p>
<p class=MsoListParagraph style='text-indent:-.25in'><span style='font-size:
14.0pt;color:#1F497D'>One Client – RHEL 54, Lustre 2.0</span><o:p></o:p></p>
<p class=MsoListParagraph style='margin-left:1.0in;text-indent:-.25in'><span
style='font-size:14.0pt;color:#1F497D'>/etc/fstab =
10.103.34.42@o2ib0:/lufs
/lustre1_fifo lustre
rw,noauto,_netdev 0 0</span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'> </span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>/lustre-mgs-mds,
/lustre1/ost1,2 mounted OK on MDS and OSS. /lustre1_fifo mounted OK with
Client. So far so good.</span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'> </span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>On Client,
“cd /” and performed a “ls –l”. The following
messages immediately showed up:</span><o:p></o:p></p>
<p class=MsoListParagraph style='text-indent:-.25in'><span style='font-size:
14.0pt;color:#1F497D'>On Client</span><o:p></o:p></p>
<p class=MsoListParagraph style='margin-left:1.0in;text-indent:-.25in'><span
style='font-size:14.0pt;color:#1F497D'> Jan 18 14:04:19 bg8mo33sn kernel:
LustreError: 11-0: an error occurred while communicating with
10.103.34.42@o2ib. The mds_getxattr operation failed with -95</span><o:p></o:p></p>
<p class=MsoListParagraph style='text-indent:-.25in'><span style='font-size:
14.0pt;color:#1F497D'>On MDS</span><o:p></o:p></p>
<p class=MsoListParagraph style='margin-left:1.0in;text-indent:-.25in'><span
style='font-size:14.0pt;color:#1F497D'>Jan 18 14:04:19 bg8mo33lm kernel:
LustreError: 20056:0:(ldlm_lib.c:2123:target_send_reply_msg()) @@@ processing
error (-95) req@ffff81031427e050 x1357944885151537/t0(0)
o49->af4d23bf-2d42-6e4d-6afc-353425e513af@NET_0x500000a672229_UUID:0/0 lens
448/328 e 0 to 0 dl 1295359465 ref 1 fl Interpret:/ffffffff/ffffffff rc -95/-1</span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'> </span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>All IBs between
all nodes are alive and seeing each other with no problem.</span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'> </span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>The client also
NFS exports /lustre1_fifo via:</span><o:p></o:p></p>
<p class=MsoListParagraph style='text-indent:-.25in'><span style='font-size:
14.0pt;color:#1F497D'>/etc/exports = /lustre1_fifo
testhost1(rw,sync,no_root_squash)</span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'> </span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>After testhost1
mounted /lustre1_fifo and attempt to “mkdir test” under it, the
same error messages from above showed up on the MDS and the client.
“-95” as “Operation not supported on transport endpoint”
but what does it mean here in this context.</span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'> </span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>The same
MDS/OSS/Client setup/arrangements ran fine on RHEL 5.3 and Lustre 1.8.1.1 with
no errors.</span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'> </span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>Appreciate any
help/insight. Thanks.</span><o:p></o:p></p>
<p class=MsoNormal><span style='font-size:14.0pt;color:#1F497D'>
</span><o:p></o:p></p>
<p class=MsoNormal><b><i><span style='font-size:20.0pt;color:#1F497D'>Steve</span></i></b><o:p></o:p></p>
<p class=MsoNormal><span style='color:#1F497D'> </span><o:p></o:p></p>
<p class=MsoNormal><b><i><span style='font-size:16.0pt;color:#1F497D'>Stephen
Chu</span></i></b><o:p></o:p></p>
<p class=MsoNormal><b><span style='font-size:12.0pt;color:#1F497D'>AT&T
Labs CSO</span></b><o:p></o:p></p>
<p class=MsoNormal><span style='color:#1F497D'>C5-3C03</span><o:p></o:p></p>
<p class=MsoNormal><span style='color:#1F497D'>200 Laurel Ave</span><o:p></o:p></p>
<p class=MsoNormal><span style='color:#1F497D'>Middletown, NJ</span><o:p></o:p></p>
<p class=MsoNormal><span style='color:#1F497D'>(732) 420-0588</span><o:p></o:p></p>
<p class=MsoNormal><span style='color:#1F497D'><a
href="mailto:stephenchu@att.com">stephenchu@att.com</a></span><o:p></o:p></p>
<p class=MsoNormal><i><span style='font-size:10.0pt;font-family:"Arial","sans-serif"'>"This
e-mail and any files transmitted with it are AT&T property, are
confidential, and are intended solely for the use of the individual or entity
to whom this email is addressed. If you are not one of the named recipient(s)
or otherwise have reason to believe that you have received this message in
error, please notify the sender and delete this message immediately from your
computer. Any other use, retention, dissemination, forwarding, printing, or
copying of this e-mail is strictly prohibited."</span></i><o:p></o:p></p>
<p class=MsoNormal> <o:p></o:p></p>
<pre><o:p> </o:p></pre><pre><o:p> </o:p></pre><pre>_______________________________________________<o:p></o:p></pre><pre>Lustre-discuss mailing list<o:p></o:p></pre><pre><a
href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><o:p></o:p></pre><pre><a
href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><o:p></o:p></pre>
<p class=MsoNormal><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><o:p> </o:p></span></p>
</div>
</div>
</body>
</html>