<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<META content="MSHTML 6.00.2900.3243" name=GENERATOR></HEAD>
<BODY
style="WORD-WRAP: break-word; webkit-nbsp-mode: space; webkit-line-break: after-white-space">
<DIV><SPAN class=734331617-30122007><FONT face=Arial color=#0000ff
size=2>Aaron,</FONT></SPAN></DIV>
<DIV><SPAN class=734331617-30122007><FONT face=Arial color=#0000ff
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=734331617-30122007><FONT face=Arial color=#0000ff size=2>Thanks
a lot.</FONT></SPAN></DIV>
<DIV><SPAN class=734331617-30122007><FONT face=Arial color=#0000ff size=2>It's
working like a tiger now :)</FONT></SPAN></DIV>
<DIV><SPAN class=734331617-30122007></SPAN> </DIV>
<DIV><FONT face=Arial color=#0000ff size=2></FONT> </DIV>
<DIV dir=ltr align=left><FONT face="Monotype Corsiva" size=6>
<DIV dir=ltr align=left><FONT face=Arial size=2><SPAN
class=921194414-18122006>Best Regards, </SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=921194414-18122006>Alberto.
</SPAN></FONT></DIV></FONT></DIV>
<DIV> </DIV><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Aaron Knister [mailto:aaron@iges.org]
<BR><B>Sent:</B> Sunday, December 30, 2007 4:16 PM<BR><B>To:</B> Albert
Ozilov<BR><B>Cc:</B> Lustre-discuss<BR><B>Subject:</B> Re: [Lustre-discuss] Can
someone help?<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV>
<DIV>Aha! I think I've found the problem. It looks like the filesystem name on
the OSTs is different than the MDT you are trying to use. On the MDT you have
datafs and on the OSTs it looks like you have spfs. I'm guessing you wan the
name "datafs" so you need to use tunefs.lustre to change the fs name on the
OSTs. Here's how--</DIV>
<DIV><BR class=webkit-block-placeholder></DIV>
<DIV>1. Unmount the OSTs</DIV>
<DIV>2. Run "tunefs.lustre --fsname="datafs" /device/of/ost" for each of your
OSTs</DIV>
<DIV>3. Mount everything back up and post the output of "lctl dl" on your OSSs
and MDSs.</DIV>
<DIV><BR class=webkit-block-placeholder></DIV></DIV>
<DIV>-Aaron</DIV>
<DIV><BR class=webkit-block-placeholder></DIV>
<DIV>ps "lctl dl" is a quicker way of running cat
/proc/fs/lustre/devices</DIV><BR>
<DIV>
<DIV>On Dec 30, 2007, at 4:00 AM, Albert Ozilov wrote:</DIV><BR
class=Apple-interchange-newline>
<BLOCKQUOTE type="cite">
<DIV
style="WORD-WRAP: break-word; webkit-nbsp-mode: space; webkit-line-break: after-white-space">
<DIV><FONT face=Arial size=2><SPAN class=734002608-30122007>Hi
Aaron,</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=734002608-30122007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=734002608-30122007>Thanks in advance
for your help.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=734002608-30122007></SPAN></FONT> </DIV>
<DIV><FONT size=+0><SPAN class=734002608-30122007><FONT face=Arial size=2>Here
is some Info from my setup:</FONT></SPAN></FONT></DIV><FONT size=+0>
<DIV><FONT face=Arial color=#0000ff size=2></FONT><BR><FONT face=Arial
size=2></FONT></DIV></FONT>
<DIV><SPAN class=734002608-30122007><FONT face=Arial size=2>MDT/MGS server IP
is 11.4.3.241</FONT></SPAN></DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial size=2>Client IP is
11.4.3.242.</FONT></SPAN></DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial size=2>OST's IP's
are 11.4.3.243 and 11.4.3.244.</FONT></SPAN></DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial
size=2>===========================================</FONT></SPAN></DIV>
<DIV><FONT size=2><FONT face=Arial><SPAN class=734002608-30122007></SPAN><SPAN
class=734002608-30122007></SPAN><SPAN
class=734002608-30122007></SPAN></FONT></FONT> </DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial size=2>[root@sw241 ~]#
cat /proc/fs/lustre/mds/datafs-MDT0000/recovery_status</FONT></SPAN></DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial size=2>status:
INACTIVE</FONT></SPAN></DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial
size=2>===========================================</FONT></SPAN></DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV><FONT face=Arial size=2></FONT><SPAN class=734002608-30122007><FONT
face=Arial size=2><STRONG><U>cat
/proc/fs/lustre/devices:</U></STRONG></FONT></SPAN></DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV><FONT face=Arial size=2>[root@sw241 ~]# cat
/proc/fs/lustre/devices</FONT></DIV>
<DIV><FONT face=Arial size=2>0 UP mgs MGS MGS 9</FONT></DIV>
<DIV><FONT face=Arial size=2>1 UP mgc MGC11.4.3.241@o2ib
a4bcf80c-5a47-b79d-326a-6520a237ce4a 5</FONT></DIV>
<DIV><FONT face=Arial size=2>2 UP mdt MDS MDS_uuid 3</FONT></DIV>
<DIV><FONT face=Arial size=2>3 UP lov datafs-mdtlov datafs-mdtlov_UUID
4</FONT></DIV>
<DIV><FONT face=Arial size=2>4 UP mds datafs-MDT0000 datafs-MDT0000_UUID
3</FONT></DIV>
<DIV><FONT face=Arial size=2>[root@sw241 ~]# </FONT></DIV>
<DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial
size=2>===========================================</FONT></SPAN></DIV></DIV>
<DIV><FONT face=Arial size=2>[root@sw243 ~]# cat
/proc/fs/lustre/devices</FONT></DIV>
<DIV><FONT face=Arial size=2>0 UP mgc MGC11.4.3.241@o2ib
c44415f9-2bd0-420f-99a3-8792c190d45e 5</FONT></DIV>
<DIV><FONT face=Arial size=2>1 UP ost OSS OSS_uuid 3</FONT></DIV>
<DIV><FONT face=Arial size=2>2 UP obdfilter spfs-OST0000 spfs-OST0000_UUID
3</FONT></DIV>
<DIV><FONT face=Arial size=2>[root@sw243 ~]# </FONT></DIV>
<DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial
size=2>===========================================</FONT></SPAN></DIV>
<DIV><FONT face=Arial size=2>[root@sw244 ~]# cat
/proc/fs/lustre/devices</FONT></DIV></DIV>
<DIV><FONT face=Arial size=2>0 UP mgc MGC11.4.3.241@o2ib
d4639175-68e7-9482-2edd-e5ee29e3af2a 5</FONT></DIV>
<DIV><FONT face=Arial size=2>1 UP ost OSS OSS_uuid 3</FONT></DIV>
<DIV><FONT face=Arial size=2>2 UP obdfilter spfs-OST0001 spfs-OST0001_UUID
3</FONT></DIV>
<DIV><FONT face=Arial size=2>[root@sw244 ~]# </FONT></DIV>
<DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial
size=2>===========================================</FONT></SPAN></DIV></DIV>
<DIV><FONT face=Arial color=#0000ff size=2></FONT> </DIV>
<DIV><STRONG><U><FONT face=Arial size=2>lctl ping:</FONT></U></STRONG></DIV>
<DIV><STRONG><U><FONT face=Arial size=2></FONT></U></STRONG> </DIV>
<DIV><FONT face=Arial size=2>[root@sw242 ~]# lctl ping </FONT><A
href="mailto:11.4.3.241@o2ib"><FONT face=Arial color=#000000
size=2>11.4.3.241@o2ib</FONT></A></DIV>
<DIV><A href="mailto:12345-0@lo"><FONT face=Arial color=#000000
size=2>12345-0@lo</FONT></A></DIV>
<DIV><A href="mailto:12345-11.4.3.241@o2ib"><FONT face=Arial color=#000000
size=2>12345-11.4.3.241@o2ib</FONT></A></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2>[root@sw242 ~]# lctl ping </FONT><A
href="mailto:11.4.3.243@o2ib"><FONT face=Arial color=#000000
size=2>11.4.3.243@o2ib</FONT></A></DIV>
<DIV><A href="mailto:12345-0@lo"><FONT face=Arial color=#000000
size=2>12345-0@lo</FONT></A></DIV>
<DIV><A href="mailto:12345-11.4.3.243@o2ib"><FONT face=Arial color=#000000
size=2>12345-11.4.3.243@o2ib</FONT></A></DIV>
<DIV><FONT face=Arial color=#0000ff size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2>[root@sw242 ~]# lctl ping </FONT><A
href="mailto:11.4.3.244@o2ib"><FONT face=Arial color=#000000
size=2>11.4.3.244@o2ib</FONT></A></DIV>
<DIV><A href="mailto:12345-0@lo"><FONT face=Arial color=#000000
size=2>12345-0@lo</FONT></A></DIV>
<DIV><A href="mailto:12345-11.4.3.244@o2ib"><FONT face=Arial color=#000000
size=2>12345-11.4.3.244@o2ib</FONT></A></DIV>
<DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial
size=2>===========================================</FONT></SPAN></DIV>
<DIV><FONT face=Arial size=2>[root@sw241 ~]# lctl ping </FONT><A
href="mailto:11.4.3.242@o2ib"><FONT face=Arial color=#000000
size=2>11.4.3.242@o2ib</FONT></A></DIV></DIV>
<DIV><A href="mailto:12345-0@lo"><FONT face=Arial color=#000000
size=2>12345-0@lo</FONT></A></DIV>
<DIV><A href="mailto:12345-11.4.3.242@o2ib"><FONT face=Arial color=#000000
size=2>12345-11.4.3.242@o2ib</FONT></A></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2>[root@sw241 ~]# lctl ping </FONT><A
href="mailto:11.4.3.243@o2ib"><FONT face=Arial color=#000000
size=2>11.4.3.243@o2ib</FONT></A></DIV>
<DIV><A href="mailto:12345-0@lo"><FONT face=Arial color=#000000
size=2>12345-0@lo</FONT></A></DIV>
<DIV><A href="mailto:12345-11.4.3.243@o2ib"><FONT face=Arial color=#000000
size=2>12345-11.4.3.243@o2ib</FONT></A></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2>[root@sw241 ~]# lctl ping </FONT><A
href="mailto:11.4.3.244@o2ib"><FONT face=Arial color=#000000
size=2>11.4.3.244@o2ib</FONT></A></DIV>
<DIV><A href="mailto:12345-0@lo"><FONT face=Arial color=#000000
size=2>12345-0@lo</FONT></A></DIV>
<DIV><A href="mailto:12345-11.4.3.244@o2ib"><FONT face=Arial color=#000000
size=2>12345-11.4.3.244@o2ib</FONT></A></DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial
size=2>===========================================</FONT></SPAN></DIV>
<DIV><SPAN class=734002608-30122007><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV><FONT size=2><FONT face=Arial><SPAN class=734002608-30122007>Y</SPAN>our
help<SPAN class=734002608-30122007> is appreciated.</SPAN></FONT></FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr align=left>
<DIV dir=ltr align=left><FONT face=Arial size=2><SPAN
class=921194414-18122006>Best Regards, </SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=921194414-18122006>Alberto.
</SPAN></FONT></DIV></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Aaron Knister [<A
href="mailto:aaron@iges.org">mailto:aaron@iges.org</A>] <BR><B>Sent:</B>
Sunday, December 30, 2007 4:05 AM<BR><B>To:</B> Albert Ozilov<BR><B>Cc:</B> <A
href="mailto:lustre-discuss@clusterfs.com">lustre-discuss@clusterfs.com</A><BR><B>Subject:</B>
Re: [Lustre-discuss] Can someone help?<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV>Hi!</DIV>
<DIV><BR class=webkit-block-placeholder></DIV>
<DIV>Could you post the IPs over your MDT/MGS, OSSs and Client?</DIV>
<DIV><BR class=webkit-block-placeholder></DIV>
<DIV>Also on the MDT/MGS I'm wondering if the MDT is in recovery. To check
recovery status run--</DIV>
<DIV><BR class=webkit-block-placeholder></DIV>
<DIV>cat /proc/fs/lustre/mds/datafs-MDT0000/recovery_status </DIV>
<DIV><BR class=webkit-block-placeholder></DIV>
<DIV>and post what you get back. </DIV>
<DIV><BR class=webkit-block-placeholder></DIV>
<DIV>Also you can do an lnet ping to the various points in your system. The
syntax is "lctl ping nid" so to ping 11.4.3.241@o2ib the syntax would be "lctl
ping 11.4.3.241@o2ib". Also post what you get back from that.</DIV>
<DIV><BR class=webkit-block-placeholder></DIV>
<DIV>-Aaron</DIV><BR>
<DIV>
<DIV>On Dec 29, 2007, at 7:29 PM, Albert Ozilov wrote:</DIV><BR
class=Apple-interchange-newline>
<BLOCKQUOTE type="cite">
<DIV>
<DIV><FONT face=Arial size=2><SPAN
class=234134723-29122007>Hi,</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=234134723-29122007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=234134723-29122007>I am new
user with Lustre file system, I am trying to run over Infiniband fabric
(ofed 1.2.xxx), I am using Lustre version 1.6.4.1</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=234134723-29122007>I have created
mgs/mdt on the same node and two OST's on different nodes, all looks fine
till now.</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=234134723-29122007>Now I am trying
to mount the client node but getting connection refused from the MGS
server, </SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=234134723-29122007><STRONG></STRONG></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN
class=234134723-29122007><STRONG>This is my command on the client
node:</STRONG></SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=234134723-29122007>mount -t lustre
<A
href="mailto:11.4.3.241@o2ib:/datafs">11.4.3.241@o2ib:/datafs</A>
/mnt/testfs</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=234134723-29122007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2><SPAN class=234134723-29122007><STRONG>This is
the dmesg on the MGS node:</STRONG></SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN
class=234134723-29122007></SPAN></FONT> </DIV>
<DIV><FONT face=Arial size=2>Lustre: datafs-MDT0000: temporarily refusing
client connection from <A
href="mailto:11.4.3.242@o2ib">11.4.3.242@o2ib</A><BR>Lustre: Skipped 19
previous similar messages<BR>LustreError:
6047:0:(ldlm_lib.c:1442:target_send_reply_msg()) @@@ processing error
(-11) <A href="mailto:req@ffff810219855850">req@ffff810219855850</A>
x6/t0 o38-><?>@<?>:-1 lens 240/0 ref 0 fl Interpret:/0/0 rc
-11/0<BR>LustreError: 6047:0:(ldlm_lib.c:1442:target_send_reply_msg())
Skipped 19 previous similar messages<BR></FONT></DIV><FONT face=Arial
size=2></FONT>
<DIV><FONT face=Arial size=2><SPAN class=234134723-29122007><BR>Is someone
familiar with this problem, can someone help?</SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr align=left><FONT face="Monotype Corsiva" size=6>
<DIV dir=ltr align=left><FONT face=Arial size=2><SPAN
class=921194414-18122006>Best Regards, </SPAN></FONT></DIV>
<DIV><FONT face=Arial size=2><SPAN class=921194414-18122006>Alberto.
</SPAN></FONT></DIV></FONT></DIV>
<DIV><FONT face=Arial
size=2></FONT> </DIV></DIV>_______________________________________________<BR>Lustre-discuss
mailing list<BR><A
href="mailto:Lustre-discuss@clusterfs.com">Lustre-discuss@clusterfs.com</A><BR><A
href="https://mail.clusterfs.com/mailman/listinfo/lustre-discuss">https://mail.clusterfs.com/mailman/listinfo/lustre-discuss</A><BR></BLOCKQUOTE></DIV><BR>
<DIV apple-content-edited="true"><SPAN class=Apple-style-span
style="WORD-SPACING: 0px; FONT: 12px Helvetica; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); TEXT-INDENT: 0px; WHITE-SPACE: normal; LETTER-SPACING: normal; BORDER-COLLAPSE: separate; orphans: 2; widows: 2; webkit-border-horizontal-spacing: 0px; webkit-border-vertical-spacing: 0px; webkit-text-decorations-in-effect: none; webkit-text-size-adjust: auto; webkit-text-stroke-width: 0">
<DIV
style="WORD-WRAP: break-word; webkit-nbsp-mode: space; webkit-line-break: after-white-space"><SPAN
class=Apple-style-span
style="WORD-SPACING: 0px; FONT: 12px Helvetica; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); TEXT-INDENT: 0px; WHITE-SPACE: normal; LETTER-SPACING: normal; BORDER-COLLAPSE: separate; orphans: 2; widows: 2; webkit-border-horizontal-spacing: 0px; webkit-border-vertical-spacing: 0px; webkit-text-decorations-in-effect: none; webkit-text-size-adjust: auto; webkit-text-stroke-width: 0px">
<DIV
style="WORD-WRAP: break-word; webkit-nbsp-mode: space; webkit-line-break: after-white-space"><SPAN
class=Apple-style-span
style="WORD-SPACING: 0px; FONT: 12px Helvetica; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); TEXT-INDENT: 0px; WHITE-SPACE: normal; LETTER-SPACING: normal; BORDER-COLLAPSE: separate; orphans: 2; widows: 2; webkit-border-horizontal-spacing: 0px; webkit-border-vertical-spacing: 0px; webkit-text-decorations-in-effect: none; webkit-text-size-adjust: auto; webkit-text-stroke-width: 0px">
<DIV>Aaron Knister</DIV>
<DIV>Associate Systems Analyst</DIV>
<DIV>
<DIV>
<DIV>Center for Ocean-Land-Atmosphere Studies</DIV></DIV>
<DIV></DIV></DIV>
<DIV><BR class=khtml-block-placeholder></DIV>
<DIV>(301) 595-7000</DIV>
<DIV><A href="mailto:aaron@iges.org">aaron@iges.org</A></DIV>
<DIV><BR class=khtml-block-placeholder></DIV><BR
class=Apple-interchange-newline></SPAN></DIV></SPAN></DIV></SPAN><BR
class=Apple-interchange-newline></DIV><BR></DIV></BLOCKQUOTE></DIV><BR>
<DIV apple-content-edited="true"><SPAN class=Apple-style-span
style="WORD-SPACING: 0px; FONT: 12px Helvetica; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); TEXT-INDENT: 0px; WHITE-SPACE: normal; LETTER-SPACING: normal; BORDER-COLLAPSE: separate; orphans: 2; widows: 2; webkit-border-horizontal-spacing: 0px; webkit-border-vertical-spacing: 0px; webkit-text-decorations-in-effect: none; webkit-text-size-adjust: auto; webkit-text-stroke-width: 0">
<DIV
style="WORD-WRAP: break-word; webkit-nbsp-mode: space; webkit-line-break: after-white-space"><SPAN
class=Apple-style-span
style="WORD-SPACING: 0px; FONT: 12px Helvetica; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); TEXT-INDENT: 0px; WHITE-SPACE: normal; LETTER-SPACING: normal; BORDER-COLLAPSE: separate; orphans: 2; widows: 2; webkit-border-horizontal-spacing: 0px; webkit-border-vertical-spacing: 0px; webkit-text-decorations-in-effect: none; webkit-text-size-adjust: auto; webkit-text-stroke-width: 0px">
<DIV
style="WORD-WRAP: break-word; webkit-nbsp-mode: space; webkit-line-break: after-white-space"><SPAN
class=Apple-style-span
style="WORD-SPACING: 0px; FONT: 12px Helvetica; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); TEXT-INDENT: 0px; WHITE-SPACE: normal; LETTER-SPACING: normal; BORDER-COLLAPSE: separate; orphans: 2; widows: 2; webkit-border-horizontal-spacing: 0px; webkit-border-vertical-spacing: 0px; webkit-text-decorations-in-effect: none; webkit-text-size-adjust: auto; webkit-text-stroke-width: 0px">
<DIV>Aaron Knister</DIV>
<DIV>Associate Systems Analyst</DIV>
<DIV>
<DIV>
<DIV>Center for Ocean-Land-Atmosphere Studies</DIV></DIV>
<DIV></DIV></DIV>
<DIV><BR class=khtml-block-placeholder></DIV>
<DIV>(301) 595-7000</DIV>
<DIV><A href="mailto:aaron@iges.org">aaron@iges.org</A></DIV>
<DIV><BR class=khtml-block-placeholder></DIV><BR
class=Apple-interchange-newline></SPAN></DIV></SPAN></DIV></SPAN><BR
class=Apple-interchange-newline></DIV><BR></BODY></HTML>