[Lustre-discuss] Lustre On Two Clusters

[Lee, Brett]

> -----Original Message-----
> From: lustre-discuss-bounces at lists.lustre.org [mailto:lustre-discuss-
> bounces at lists.lustre.org] On Behalf Of Mr. Mark L. Dotson (Contractor)
> Sent: Tuesday, May 07, 2013 9:16 AM
> To: lustre-discuss at lists.lustre.org
> Subject: [Lustre-discuss] Lustre On Two Clusters
> 
> I have Lustre installed and working on 1 cluster. Everything is IB. I can mount
> clients in this cluster with no problems. I want to mount this Lustre FS on
> another cluster that is attached to a separate IB switch.
> What's the best way to do this? Does it require a separate subnet for the IB
> interfaces, or does it matter?

Hi Mark,

Good to hear from you on the list.

Regarding your question, a couple options jump out at me.

1.  Add additional interfaces to the servers.  This will allow the Lustre servers to be on both IB networks, and able to directly serve the file system to the clients.
2.  Use LNet router(s), the basics of which is documented in the operations manuals.

Either way, you'll need to perform some network configuration in (at least) the servers "lustre.conf".

-Brett

> 
> Currently, my /etc/modprobe.d/lustre.conf has the following:
> 
> options lnet networks="o2ib0(ib0)"
> 
> Lustre version is 2.3
> OS's are CentOS 6.4.
> 
> Any help would be much appreciated. Thanks.
> 
> Mark
> 
> 
> --
> Mark Dotson
> Systems Administrator
> Lockheed-Martin
> dotsonml.ctr at afrl.hpc.mil
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss


--
Brett Lee
Sr. Systems Engineer
Intel High Performance Data Division