[Lustre-discuss] Lustre On Two Clusters

[Mr. Mark L. Dotson (Contractor)]

Thanks, Lee.

Has anyone done any work with Lustre and IB WAN extenders? I need help 
with my configuration.

Thanks,

Mark

On 05/08/13 11:03, Lee, Brett wrote:
>> -----Original Message-----
>> From: lustre-discuss-bounces at lists.lustre.org [mailto:lustre-discuss-
>> bounces at lists.lustre.org] On Behalf Of Mr. Mark L. Dotson (Contractor)
>> Sent: Tuesday, May 07, 2013 9:16 AM
>> To: lustre-discuss at lists.lustre.org
>> Subject: [Lustre-discuss] Lustre On Two Clusters
>>
>> I have Lustre installed and working on 1 cluster. Everything is IB. I can mount
>> clients in this cluster with no problems. I want to mount this Lustre FS on
>> another cluster that is attached to a separate IB switch.
>> What's the best way to do this? Does it require a separate subnet for the IB
>> interfaces, or does it matter?
>
> Hi Mark,
>
> Good to hear from you on the list.
>
> Regarding your question, a couple options jump out at me.
>
> 1.  Add additional interfaces to the servers.  This will allow the Lustre servers to be on both IB networks, and able to directly serve the file system to the clients.
> 2.  Use LNet router(s), the basics of which is documented in the operations manuals.
>
> Either way, you'll need to perform some network configuration in (at least) the servers "lustre.conf".
>
> -Brett
>
>>
>> Currently, my /etc/modprobe.d/lustre.conf has the following:
>>
>> options lnet networks="o2ib0(ib0)"
>>
>> Lustre version is 2.3
>> OS's are CentOS 6.4.
>>
>> Any help would be much appreciated. Thanks.
>>
>> Mark
>>
>>
>> --
>> Mark Dotson
>> Systems Administrator
>> Lockheed-Martin
>> dotsonml.ctr at afrl.hpc.mil
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>
>
> --
> Brett Lee
> Sr. Systems Engineer
> Intel High Performance Data Division
>


-- 
Mark Dotson
Systems Administrator
Lockheed-Martin
dotsonml.ctr at afrl.hpc.mil