Hi John,<br>
<br>
If ib is not working with Lustre at all, then -<br>
Hope you have recompiled Lustre to use the use the OFED modules included Lustre Kernel.<br>
Your normal ib network might be working, but it wont work with Lustre unless you recompile it too.<br>
<br>
Lustre looks at it as a normal TCP/IP interface, therefore you are able to mount using tcp, but not infiniband.<br>
<br>
Check these links out -<br>
<a href="https://blogs.oracle.com/atulvid/entry/compiling_lustre_from_sources_with">https://blogs.oracle.com/atulvid/entry/compiling_lustre_from_sources_with</a><br>
<a href="http://wiki.lustre.org/index.php/Configuring_InfiniBand_Connectivity">http://wiki.lustre.org/index.php/Configuring_InfiniBand_Connectivity</a><br>
<a href="http://pkg-ofed.alioth.debian.org/howto/infiniband-howto-9.html#ss9.4">http://pkg-ofed.alioth.debian.org/howto/infiniband-howto-9.html#ss9.4</a><br>
<br>
Hope I am on the right track :-).<br>
<br>
Regards,<br>
<br>
<br>
Indivar Nair<br><br><div class="gmail_quote">On Wed, Nov 2, 2011 at 9:35 PM, John White <span dir="ltr"><<a href="mailto:jwhite@lbl.gov">jwhite@lbl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
I did have that, with the 2nd line commented out. I just uncommented the 2nd, unloaded, depmod'd and reloaded only to see the same behavior.<br>
<div class="im">----------------<br>
John White<br>
HPC Systems Engineer<br>
(510) 486-7307<br>
One Cyclotron Rd, MS: 50C-3396<br>
University of California Berkeley<br>
Berkeley, CA 94720<br>
<br>
</div><div><div></div><div class="h5">On Nov 2, 2011, at 9:01 AM, Ben Evans wrote:<br>
<br>
> My guess is you've got two "options lnet" lines in modprobe.conf<br>
><br>
> It should look something like this:<br>
><br>
> options lnet networks=tcp0(eth0),o2ib0(ib0)<br>
> options ko2iblnd ipif_name=ib0<br>
><br>
><br>
><br>
> -----Original Message-----<br>
> From: <a href="mailto:lustre-discuss-bounces@lists.lustre.org">lustre-discuss-bounces@lists.lustre.org</a><br>
> [mailto:<a href="mailto:lustre-discuss-bounces@lists.lustre.org">lustre-discuss-bounces@lists.lustre.org</a>] On Behalf Of John White<br>
> Sent: Wednesday, November 02, 2011 11:55 AM<br>
> To: <a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
> Subject: [Lustre-discuss] problem with clients and multiple transports<br>
><br>
> Hello Folks,<br>
> I'm having a problem pinning a given FS to a given transport<br>
> type. I have 2 file systems hosted on the OSS/MDS side by an ib and tcp<br>
> nid (each) being mounted by a client specifying the appropriate<br>
> transport for each of the file systems (one over tcp and one over o2ib).<br>
> I can not mount o2ib. Period. If my client's modprobe.conf lists o2ib<br>
> before the tcp nid, any o2ib mount request fails. If the modprobe.conf<br>
> has tcp first, both mount requests will mount via tcp0, no matter how<br>
> the mount request is crafted.<br>
><br>
> So, am I just missing documentation somewhere that states you<br>
> can only use a single transport on a client at a time or is this a bug?<br>
> ----------------<br>
> John White<br>
> HPC Systems Engineer<br>
> (510) 486-7307<br>
> One Cyclotron Rd, MS: 50C-3396<br>
> University of California Berkeley<br>
> Berkeley, CA 94720<br>
><br>
> _______________________________________________<br>
> Lustre-discuss mailing list<br>
> <a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><br>
> <a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
<br>
_______________________________________________<br>
Lustre-discuss mailing list<br>
<a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
</div></div></blockquote></div><br>