[Lustre-discuss] two multi-homed cluster

Cliff White cliffw at whamcloud.com
Fri Dec 16 14:27:54 PST 2011

You can do this, simply define networks for both devices.
Assuming ib0, and eth0, you would have
options lnet networks="tcp0(eth0),o2ib0(ib0)"

The IB clients will mount using a @o2ib0 NID, and the ethernet clients will
mount using @tcp0 NIDs. Since you are explicitly specifying the network,
the hop rule doesn't apply.

On Fri, Dec 16, 2011 at 9:49 AM, Patrice Hamelin
<patrice.hamelin at ec.gc.ca>wrote:

> **
> Hi,
>   I have two Infiniband clusters, each in a separate location with a solid
> ethernet connectivity between each of them.  Say they are named cluster A
> and cluster B.  All members of each clusters have both IB and eth networks
> available to them, and the IB network is not routed between cluster A and
> B, but ethernet is.  On each clusters, I have 4 OSS's serving FC disks.
> Clients on cluster A mounts Lustre disk from their local cluster, and the
> same goes on for for cluster B, both on Infiniband NIDs.
>   What I would like to achieve is client from cluster A to mount disks
> from OSS's on cluster B on the ethernet connection.  The same goes on for
> clients in cluster B to mount disks from OSS's on cluster A.
>   From my readings in the luster 1.8.7 manual, I got:
> 7.1.1 Modprobe.conf
> Options under modprobe.conf are used to specify the networks available to
> a node.
> You have the choice of two different options – the networks option, which
> explicitly
> lists the networks available and the ip2nets option, which provides a
> list-matching
> lookup. Only one option can be used at any one time. The order of LNET
> lines in
> modprobe.conf is important when configuring multi-homed servers. *If a
> server
> node can be reached using more than one network, the first network
> specified in
> modprobe.conf will be used.*
> Is the last sentence means that I cannot do that?
> Thanks.
> --
> Patrice Hamelin
> Specialiste sénior en systèmes d'exploitation | Senior OS specialist
> Environnement Canada | Environment Canada
> 2121, route Transcanadienne | 2121 Transcanada Highway
> Dorval, QC H9P 1J3
> Gouvernement du Canada | Government of Canada
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

Support Guy
WhamCloud, Inc.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20111216/44ef759e/attachment.htm>

More information about the lustre-discuss mailing list