<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#ffffff">
I think you met the issues I mentioned in: <br>
<a class="moz-txt-link-freetext"
href="http://jira.whamcloud.com/browse/ORNL-3">http://jira.whamcloud.com/browse/ORNL-3</a><br>
<br>
I have made patch for it and in testing.<br>
Before the patch landed, you can mount MDT with "-o acl" or "-o
noacl" explicitly to avoid these confused messages.<br>
<br>
--<br>
Nasf<br>
<br>
On 1/18/11 10:39 PM, CHU, STEPHEN H (ATTSI) wrote:
<blockquote
cite="mid:BDF7FD93034978408DE1D46DB006AFF80AEF10C0@misout7msgusr7c.ugd.att.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=ISO-8859-1">
<meta name="Generator" content="Microsoft Word 12 (filtered
medium)">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:471286585;
mso-list-type:hybrid;
mso-list-template-ids:801815500 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l1
{mso-list-id:701438095;
mso-list-type:hybrid;
mso-list-template-ids:-676322956 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l1:level1
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l1:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l2
{mso-list-id:1143038499;
mso-list-type:hybrid;
mso-list-template-ids:1627670464 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l2:level1
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l2:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l2:level3
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
-->
</style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);">Hi all,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);">I recently
loaded the following on my testbed to try out Lustre 2.0:<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: Symbol; color: rgb(31,
73, 125);"><span style="">·<span style="font: 7pt
"Times New Roman";">
</span></span></span><!--[endif]--><span style="font-size:
14pt; color: rgb(31, 73, 125);">One
MDS – RHEL 54, Lustre 2.0<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left: 1in;
text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: "Courier
New"; color: rgb(31, 73, 125);"><span style="">o<span
style="font: 7pt "Times New Roman";"> </span></span></span><!--[endif]--><span
style="font-size: 14pt; color: rgb(31, 73, 125);">mkfs.lustre
--fsname=lufs --reformat
--mgs --mdt --param lov.stripesize=25M --param
lov.stripecount=1 /dev/sda2<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left: 1in;
text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: "Courier
New"; color: rgb(31, 73, 125);"><span style="">o<span
style="font: 7pt "Times New Roman";"> </span></span></span><!--[endif]--><span
style="font-size: 14pt; color: rgb(31, 73, 125);">/etc/fstab
= /dev/sda2
/lustre1-mgs-mds
lustre rw,noauto,_netdev 0 0<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: Symbol; color: rgb(31,
73, 125);"><span style="">·<span style="font: 7pt
"Times New Roman";">
</span></span></span><!--[endif]--><span style="font-size:
14pt; color: rgb(31, 73, 125);">One
OSS – RHEL 54, Lustre 2.0<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left: 1in;
text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: "Courier
New"; color: rgb(31, 73, 125);"><span style="">o<span
style="font: 7pt "Times New Roman";"> </span></span></span><!--[endif]--><span
style="font-size: 14pt; color: rgb(31, 73, 125);">mkfs.lustre
--fsname=lufs --reformat
--ost --mgsnode=10.103.34.42@o2ib0 /dev/sdb<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left: 1in;
text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: "Courier
New"; color: rgb(31, 73, 125);"><span style="">o<span
style="font: 7pt "Times New Roman";"> </span></span></span><!--[endif]--><span
style="font-size: 14pt; color: rgb(31, 73, 125);">mkfs.lustre
--fsname=lufs --reformat
--ost --mgsnode=10.103.34.42@o2ib0 /dev/sdc<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left: 1in;
text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: "Courier
New"; color: rgb(31, 73, 125);"><span style="">o<span
style="font: 7pt "Times New Roman";"> </span></span></span><!--[endif]--><span
style="font-size: 14pt; color: rgb(31, 73, 125);">/etc/fstab
= /dev/sdb
/lustre1/ost1 lustre
rw,noauto,_netdev 0 0<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left: 1in;
text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: "Courier
New"; color: rgb(31, 73, 125);"><span style="">o<span
style="font: 7pt "Times New Roman";"> </span></span></span><!--[endif]--><span
style="font-size: 14pt; color: rgb(31, 73, 125);"> /dev/sdc
/lustre1/ost2
lustre
rw,noauto,_netdev 0 0<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: Symbol; color: rgb(31,
73, 125);"><span style="">·<span style="font: 7pt
"Times New Roman";">
</span></span></span><!--[endif]--><span style="font-size:
14pt; color: rgb(31, 73, 125);">One
Client – RHEL 54, Lustre 2.0<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left: 1in;
text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: "Courier
New"; color: rgb(31, 73, 125);"><span style="">o<span
style="font: 7pt "Times New Roman";"> </span></span></span><!--[endif]--><span
style="font-size: 14pt; color: rgb(31, 73, 125);">/etc/fstab
= 10.103.34.42@o2ib0:/lufs
/lustre1_fifo lustre
rw,noauto,_netdev 0 0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);">/lustre-mgs-mds,
/lustre1/ost1,2 mounted OK on MDS and OSS. /lustre1_fifo
mounted OK with
Client. So far so good.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);">On Client, “cd
/” and performed a “ls –l”. The following messages
immediately
showed up:<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: Symbol; color: rgb(31,
73, 125);"><span style="">·<span style="font: 7pt
"Times New Roman";">
</span></span></span><!--[endif]--><span style="font-size:
14pt; color: rgb(31, 73, 125);">On Client<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left: 1in;
text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: "Courier
New"; color: rgb(31, 73, 125);"><span style="">o<span
style="font: 7pt "Times New Roman";"> </span></span></span><!--[endif]--><span
style="font-size: 14pt; color: rgb(31, 73, 125);"> Jan 18
14:04:19 bg8mo33sn kernel:
LustreError: 11-0: an error occurred while communicating
with
10.103.34.42@o2ib. The mds_getxattr operation failed with
-95<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: Symbol; color: rgb(31,
73, 125);"><span style="">·<span style="font: 7pt
"Times New Roman";">
</span></span></span><!--[endif]--><span style="font-size:
14pt; color: rgb(31, 73, 125);">On
MDS<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left: 1in;
text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: "Courier
New"; color: rgb(31, 73, 125);"><span style="">o<span
style="font: 7pt "Times New Roman";"> </span></span></span><!--[endif]--><span
style="font-size: 14pt; color: rgb(31, 73, 125);">Jan 18
14:04:19 bg8mo33lm kernel:
LustreError:
20056:0:(ldlm_lib.c:2123:target_send_reply_msg()) @@@
processing
error (-95) req@ffff81031427e050 x1357944885151537/t0(0)
o49->af4d23bf-2d42-6e4d-6afc-353425e513af@NET_0x500000a672229_UUID:0/0
lens
448/328 e 0 to 0 dl 1295359465 ref 1 fl
Interpret:/ffffffff/ffffffff rc -95/-1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);">All IBs between
all nodes are alive and seeing each other with no problem.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);">The client also
NFS exports /lustre1_fifo via:<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent: -0.25in;"><!--[if !supportLists]--><span
style="font-size: 14pt; font-family: Symbol; color: rgb(31,
73, 125);"><span style="">·<span style="font: 7pt
"Times New Roman";">
</span></span></span><!--[endif]--><span style="font-size:
14pt; color: rgb(31, 73, 125);">/etc/exports
= /lustre1_fifo testhost1(rw,sync,no_root_squash)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);">After testhost1
mounted /lustre1_fifo and attempt to “mkdir test” under it,
the
same error messages from above showed up on the MDS and the
client. “-95”
as “Operation not supported on transport endpoint” but what
does it
mean here in this context.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);">The same
MDS/OSS/Client setup/arrangements ran fine on RHEL 5.3 and
Lustre 1.8.1.1 with
no errors.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);">Appreciate any
help/insight. Thanks.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size: 14pt; color:
rgb(31, 73, 125);"> <o:p></o:p></span></p>
<p class="MsoNormal"><b><i><span style="font-size: 20pt; color:
rgb(31, 73, 125);">Steve<o:p></o:p></span></i></b></p>
<p class="MsoNormal"><span style="color: rgb(31, 73, 125);"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><i><span style="font-size: 16pt; color:
rgb(31, 73, 125);">Stephen
Chu<o:p></o:p></span></i></b></p>
<p class="MsoNormal"><b><span style="font-size: 12pt; color:
rgb(31, 73, 125);">AT&T
Labs CSO<o:p></o:p></span></b></p>
<p class="MsoNormal"><span style="color: rgb(31, 73, 125);">C5-3C03<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color: rgb(31, 73, 125);">200
Laurel Ave<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color: rgb(31, 73, 125);">Middletown,
NJ<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color: rgb(31, 73, 125);">(732)
420-0588<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color: rgb(31, 73, 125);"><a class="moz-txt-link-abbreviated" href="mailto:stephenchu@att.com">stephenchu@att.com</a><o:p></o:p></span></p>
<p class="MsoNormal" style=""><i><span style="font-size: 10pt;
font-family: "Arial","sans-serif";
color: black;">"This
e-mail and any files transmitted with it are AT&T
property, are
confidential, and are intended solely for the use of the
individual or entity
to whom this email is addressed. If you are not one of the
named recipient(s)
or otherwise have reason to believe that you have received
this message in
error, please notify the sender and delete this message
immediately from your
computer. Any other use, retention, dissemination,
forwarding, printing, or
copying of this e-mail is strictly prohibited."<o:p></o:p></span></i></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<pre wrap="">
<fieldset class="mimeAttachmentHeader"></fieldset>
_______________________________________________
Lustre-discuss mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a>
<a class="moz-txt-link-freetext" href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a>
</pre>
</blockquote>
<br>
</body>
</html>