<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:p="urn:schemas-microsoft-com:office:powerpoint" xmlns:a="urn:schemas-microsoft-com:office:access" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:s="uuid:BDC6E3F0-6DA3-11d1-A2A3-00AA00C14882" xmlns:rs="urn:schemas-microsoft-com:rowset" xmlns:z="#RowsetSchema" xmlns:b="urn:schemas-microsoft-com:office:publisher" xmlns:ss="urn:schemas-microsoft-com:office:spreadsheet" xmlns:c="urn:schemas-microsoft-com:office:component:spreadsheet" xmlns:odc="urn:schemas-microsoft-com:office:odc" xmlns:oa="urn:schemas-microsoft-com:office:activation" xmlns:html="http://www.w3.org/TR/REC-html40" xmlns:q="http://schemas.xmlsoap.org/soap/envelope/" xmlns:rtc="http://microsoft.com/officenet/conferencing" xmlns:D="DAV:" xmlns:Repl="http://schemas.microsoft.com/repl/" xmlns:mt="http://schemas.microsoft.com/sharepoint/soap/meetings/" xmlns:x2="http://schemas.microsoft.com/office/excel/2003/xml" xmlns:ppda="http://www.passport.com/NameSpace.xsd" xmlns:ois="http://schemas.microsoft.com/sharepoint/soap/ois/" xmlns:dir="http://schemas.microsoft.com/sharepoint/soap/directory/" xmlns:ds="http://www.w3.org/2000/09/xmldsig#" xmlns:dsp="http://schemas.microsoft.com/sharepoint/dsp" xmlns:udc="http://schemas.microsoft.com/data/udc" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:sub="http://schemas.microsoft.com/sharepoint/soap/2002/1/alerts/" xmlns:ec="http://www.w3.org/2001/04/xmlenc#" xmlns:sp="http://schemas.microsoft.com/sharepoint/" xmlns:sps="http://schemas.microsoft.com/sharepoint/soap/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:udcs="http://schemas.microsoft.com/data/udc/soap" xmlns:udcxf="http://schemas.microsoft.com/data/udc/xmlfile" xmlns:udcp2p="http://schemas.microsoft.com/data/udc/parttopart" xmlns:wf="http://schemas.microsoft.com/sharepoint/soap/workflow/" xmlns:dsss="http://schemas.microsoft.com/office/2006/digsig-setup" xmlns:dssi="http://schemas.microsoft.com/office/2006/digsig" xmlns:mdssi="http://schemas.openxmlformats.org/package/2006/digital-signature" xmlns:mver="http://schemas.openxmlformats.org/markup-compatibility/2006" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns:mrels="http://schemas.openxmlformats.org/package/2006/relationships" xmlns:spwp="http://microsoft.com/sharepoint/webpartpages" xmlns:ex12t="http://schemas.microsoft.com/exchange/services/2006/types" xmlns:ex12m="http://schemas.microsoft.com/exchange/services/2006/messages" xmlns:pptsl="http://schemas.microsoft.com/sharepoint/soap/SlideLibrary/" xmlns:spsl="http://microsoft.com/webservices/SharePointPortalServer/PublishedLinksService" xmlns:Z="urn:schemas-microsoft-com:" xmlns:st="" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 12 (filtered medium)">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;}
@page Section1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.Section1
{page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=EN-US link=blue vlink=purple>
<div class=Section1>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>I think the problem you have, as Cliff alluded to, is a mismatch
between your kernel version and the Luster kernel version modules. <o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>You have kernel “<b>2.6.18-92.el5</b>” and are
installing Lustre “<b>2.6.18_92.1.17.el5</b>” Note the “<b>.1.17”
is </b>significant as the modules will end up in the wrong directory.
There is an update to CentOS to bring the kernel to the matching <b>2.6.18_92.1.17.el5
</b>version you can pull it off the CentOS mirror site in the updates directory.<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;color:#1F497D'>Ron. <o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<div style='border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt'>
<div>
<div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'>
<p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span
style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>
lustre-discuss-bounces@lists.lustre.org
[mailto:lustre-discuss-bounces@lists.lustre.org] <b>On Behalf Of </b>Carlos
Santana<br>
<b>Sent:</b> June 17, 2009 11:21 AM<br>
<b>To:</b> lustre-discuss@lists.lustre.org<br>
<b>Subject:</b> Re: [Lustre-discuss] Lustre installation and configuration
problems<o:p></o:p></span></p>
</div>
</div>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal style='margin-bottom:12.0pt'>And is there any specific
installation order for patchless client? Could someone please share it with me?
<br>
<br>
-<br>
CS. <o:p></o:p></p>
<div>
<p class=MsoNormal>On Wed, Jun 17, 2009 at 10:18 AM, Carlos Santana <<a
href="mailto:neubyr@gmail.com">neubyr@gmail.com</a>> wrote:<o:p></o:p></p>
<p class=MsoNormal>Huh... :( Sorry to bug you guys again... <br>
<br>
I am planning to make a fresh start now as nothing seems to have worked for me.
If you have any comments/feedback please share them. <br>
<br>
I would like to confirm installation order before I make a fresh start. From
Arden's experience: <a
href="http://lists.lustre.org/pipermail/lustre-discuss/2009-June/010710.html"
target="_blank">http://lists.lustre.org/pipermail/lustre-discuss/2009-June/010710.html</a>
, the lusre-module is installed last. As I was installing Lustre 1.8, I was
referring 1.8 operations manual <a
href="http://manual.lustre.org/index.php?title=Main_Page" target="_blank">http://manual.lustre.org/index.php?title=Main_Page</a>
. The installation order in the manual is different than what Arden has
suggested. <br>
<br>
Will it make a difference in configuration at later stage? Which one should I
follow now? <br>
Any comments? <br>
<br>
Thanks,<br>
<span style='color:#888888'>CS. </span><o:p></o:p></p>
<div>
<div>
<p class=MsoNormal style='margin-bottom:12.0pt'><o:p> </o:p></p>
<div>
<p class=MsoNormal>On Wed, Jun 17, 2009 at 12:35 AM, Carlos Santana <<a
href="mailto:neubyr@gmail.com" target="_blank">neubyr@gmail.com</a>> wrote:<o:p></o:p></p>
<p class=MsoNormal>Thanks Cliff.<br>
<br>
The depmod -a was successful before as well. I am using CentOS 5.2<br>
box. Following are the packages installed:<br>
[root@localhost tmp]# rpm -qa | grep -i lustre<br>
lustre-modules-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp<o:p></o:p></p>
<div>
<p class=MsoNormal style='margin-bottom:12.0pt'>lustre-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp<o:p></o:p></p>
</div>
<p class=MsoNormal>[root@localhost tmp]# uname -a<o:p></o:p></p>
<div>
<p class=MsoNormal style='margin-bottom:12.0pt'>Linux localhost.localdomain
2.6.18-92.el5 #1 SMP Tue Jun 10 18:49:47<br>
EDT 2008 i686 i686 i386 GNU/Linux<o:p></o:p></p>
</div>
<p class=MsoNormal>And here is a output from strace for mount: <a
href="http://www.heypasteit.com/clip/8WT" target="_blank">http://www.heypasteit.com/clip/8WT</a><br>
<br>
Any further debugging hints?<br>
<br>
Thanks,<br>
<span style='color:#888888'>CS.</span><o:p></o:p></p>
<div>
<div>
<p class=MsoNormal><br>
On 6/16/09, Cliff White <<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>>
wrote:<br>
> Carlos Santana wrote:<br>
>> The '$ modprobe -l lustre*' did not show any module on a patchless<br>
>> client. modprobe -v returns 'FATAL: Module lustre not found'.<br>
>><br>
>> How do I install a patchless client?<br>
>> I have tried lustre-client-modules and lustre-client-ver rpm packages
in<br>
>> both sequences. Am I missing anything?<br>
>><br>
><br>
> Make sure the lustre-client-modules package matches your running kernel.<br>
> Run depmod -a to be sure<br>
> cliffw<br>
><br>
>> Thanks,<br>
>> CS.<br>
>><br>
>><br>
>><br>
>> On Tue, Jun 16, 2009 at 2:28 PM, Cliff White <<a
href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a><br>
>> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>>>
wrote:<br>
>><br>
>> Carlos Santana wrote:<br>
>><br>
>> The lctlt ping and 'net up' failed with
the following messages:<br>
>> --- ---<br>
>> [root@localhost ~]# lctl ping 10.0.0.42<br>
>> opening /dev/lnet failed: No such device<br>
>> hint: the kernel modules may not be loaded<br>
>> failed to ping 10.0.0.42@tcp: No such
device<br>
>><br>
>> [root@localhost ~]# lctl network up<br>
>> opening /dev/lnet failed: No such device<br>
>> hint: the kernel modules may not be loaded<br>
>> LNET configure error 19: No such device<br>
>><br>
>><br>
>> Make sure modules are unloaded, then try modprobe -v.<br>
>> Looks like you have lnet mis-configured, if your module
options are<br>
>> wrong, you will see an error during the modprobe.<br>
>> cliffw<br>
>><br>
>> --- ---<br>
>><br>
>><br>
>> I tried lustre_rmmod and depmod commands
and it did not return<br>
>> any error messages. Any further clues?
Reinstall patchless<br>
>> client again?<br>
>><br>
>> -<br>
>> CS.<br>
>><br>
>><br>
>> On Tue, Jun 16, 2009 at 1:32 PM, Cliff
White<br>
>> <<a href="mailto:Cliff.White@sun.com"
target="_blank">Cliff.White@sun.com</a> <mailto:<a
href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>><br>
>> <mailto:<a
href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a> <mailto:<a
href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>>>>
wrote:<br>
>><br>
>> Carlos Santana wrote:<br>
>><br>
>> I was able to
run lustre_rmmod and depmod successfully. The<br>
>> '$lctl
list_nids' returned the server ip address and<br>
>> interface<br>
>> (tcp0).<br>
>><br>
>> I tried to
mount the file system on a remote client, but it<br>
>> failed with the
following message.<br>
>> --- ---<br>
>> [root@localhost
~]# mount -t lustre 10.0.0.42@tcp0:/lustre<br>
>> /mnt/lustre<br>
>> mount.lustre:
mount 10.0.0.42@tcp0:/lustre at /mnt/lustre<br>
>> failed: No such
device<br>
>> Are the lustre
modules loaded?<br>
>> Check
/etc/modprobe.conf and /proc/filesystems<br>
>> Note 'alias
lustre llite' should be removed from<br>
>> modprobe.conf<br>
>> --- ---<br>
>><br>
>> However, the
mounting is successful on a single node<br>
>> configuration -
with client on the same machine as MDS<br>
>> and OST.<br>
>> Any clues?
Where to look for logs and debug messages?<br>
>><br>
>><br>
>> Syslog || /var/log/messages
is the normal place.<br>
>><br>
>> You can use 'lctl ping' to
verify that the client can reach<br>
>> the server.<br>
>> Usually in these cases, it's
a network/name misconfiguration.<br>
>><br>
>> Run 'tunefs.lustre --print'
on your servers, and verify that<br>
>> mgsnode=<br>
>> is correct.<br>
>><br>
>> cliffw<br>
>><br>
>><br>
>> Thanks,<br>
>> CS.<br>
>><br>
>><br>
>><br>
>><br>
>><br>
>> On Tue, Jun 16,
2009 at 12:16 PM, Cliff White<br>
>> <<a
href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>
<mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>><br>
>> <mailto:<a
href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>
<mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>>><br>
>> <mailto:<a
href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>
<mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>><br>
>> <mailto:<a
href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>
<mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>>>>>
wrote:<br>
>><br>
>> Carlos
Santana wrote:<br>
>><br>
>>
Thanks Kevin..<br>
>><br>
>> Please
read:<br>
>><br>
>><br>
>> <a
href="http://manual.lustre.org/manual/LustreManual16_HTML/ConfiguringLustre.html#50401328_pgfId-1289529"
target="_blank">http://manual.lustre.org/manual/LustreManual16_HTML/ConfiguringLustre.html#50401328_pgfId-1289529</a><br>
>><br>
>> Those
instructions are identical for 1.6 and 1.8.<br>
>><br>
>> For
current lustre, only two commands are used for<br>
>> configuration.<br>
>>
mkfs.lustre and mount.<br>
>><br>
>><br>
>> Usually
when lustre_rmmod returns that error, you run<br>
>> it a second<br>
>> time,
and it will clear things. Unless you have live<br>
>> mounts or<br>
>> network
connections.<br>
>><br>
>> cliffw<br>
>><br>
>><br>
>>
I am referring to 1.8 manual, but I was also<br>
>> referring to<br>
>> HowTo<br>
>>
page on wiki which seems to be for 1.6. The HowTo<br>
>> page<br>
>><br>
>><br>
>> <a
href="http://wiki.lustre.org/index.php/Lustre_Howto#Using_Supplied_Configuration_Tools"
target="_blank">http://wiki.lustre.org/index.php/Lustre_Howto#Using_Supplied_Configuration_Tools</a><br>
>>
mentions abt lmc, lconf, and lctl.<br>
>><br>
>>
The modules are installed in the right place. The '$<br>
>>
lustre_rmmod' resulted in following o/p:<br>
>>
[root@localhost 2.6.18-92.1.17.el5_lustre.1.8.0smp]#<br>
>> lustre_rmmod<br>
>>
ERROR: Module obdfilter is in use<br>
>>
ERROR: Module ost is in use<br>
>>
ERROR: Module mds is in use<br>
>>
ERROR: Module fsfilt_ldiskfs is in use<br>
>>
ERROR: Module mgs is in use<br>
>>
ERROR: Module mgc is in use by mgs<br>
>>
ERROR: Module ldiskfs is in use by fsfilt_ldiskfs<br>
>>
ERROR: Module lov is in use<br>
>>
ERROR: Module lquota is in use by obdfilter,mds<br>
>>
ERROR: Module osc is in use<br>
>>
ERROR: Module ksocklnd is in use<br>
>>
ERROR: Module ptlrpc is in use by<br>
>>
obdfilter,ost,mds,mgs,mgc,lov,lquota,osc<br>
>>
ERROR: Module obdclass is in use by<br>
>><br>
>>
obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ptlrpc<br>
>>
ERROR: Module lnet is in use by<br>
>> ksocklnd,ptlrpc,obdclass<br>
>>
ERROR: Module lvfs is in use by<br>
>><br>
>><br>
>> obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ptlrpc,obdclass<br>
>>
ERROR: Module libcfs is in use by<br>
>><br>
>><br>
>>
obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ksocklnd,ptlrpc,obdclass,lnet,lvfs<br>
>><br>
>>
Do I need to shutdown these services? How can I do<br>
>> that?<br>
>><br>
>>
Thanks,<br>
>>
CS.<br>
>><br>
>><br>
>>
On Tue, Jun 16, 2009 at 11:36 AM, Kevin Van Maren<br>
>>
<<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a
href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>>
<mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a
href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>>><br>
>> <mailto:<a
href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a
href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>>
<mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a
href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>>>><br>
>>
<mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a
href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>><br>
>> <mailto:<a
href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a
href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>>>
<mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a
href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>><br>
>> <mailto:<a
href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a
href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>>>>>><br>
>><br>
>>
wrote:<br>
>><br>
>>
I think lconf and lmc went away with Lustre<br>
>> 1.6. Are you<br>
>>
sure you<br>
>>
are looking at the 1.8 manual, and not<br>
>> directions for 1.4?<br>
>><br>
>>
/usr/sbin/lctl should be in the<br>
>> lustre-<version> RPM.<br>
>> Do a:<br>
>>
# rpm -q -l<br>
>>
lustre-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp<br>
>><br>
>><br>
>>
Do make sure the modules are installed in the<br>
>> right place:<br>
>>
# cd /lib/modules/`uname -r`<br>
>>
# find . | grep lustre.ko<br>
>><br>
>>
If it shows up, then do:<br>
>>
# lustre_rmmod<br>
>>
# depmod<br>
>>
and try again.<br>
>><br>
>>
Otherwise, figure out where your modules are<br>
>> installed:<br>
>>
# uname -r<br>
>>
# cd /lib/modules<br>
>>
# find . | grep lustre.ko<br>
>><br>
>><br>
>>
You can also double-check the NID. On the MSD<br>
>> server, do<br>
>>
# lctl list_nids<br>
>><br>
>>
Should show 10.0.0.42@tcp0<br>
>><br>
>>
Kevin<br>
>><br>
>><br>
>><br>
>><br>
>><br>
>>
------------------------------------------------------------------------<br>
>><br>
>>
_______________________________________________<br>
>> Lustre-discuss
mailing list<br>
>> <a
href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a><br>
>> <mailto:<a
href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a>><br>
>> <mailto:<a
href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a><br>
>> <mailto:<a
href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a>>><br>
>><br>
>> <a
href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
>><br>
>><br>
>><br>
>><br>
>><br>
>>
------------------------------------------------------------------------<br>
>><br>
>>
_______________________________________________<br>
>> Lustre-discuss mailing list<br>
>> <a
href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a><br>
>> <mailto:<a
href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a>><br>
>> <a
href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
>><br>
>><br>
>><br>
>><br>
>>
------------------------------------------------------------------------<br>
>><br>
>> _______________________________________________<br>
>> Lustre-discuss mailing list<br>
>> <a href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a><br>
>> <a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss"
target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
><br>
><o:p></o:p></p>
</div>
</div>
</div>
<p class=MsoNormal><o:p> </o:p></p>
</div>
</div>
</div>
<p class=MsoNormal><o:p> </o:p></p>
</div>
</div>
</body>
</html>