[Lustre-discuss] lustre performance degrade on SuSE 11

Tharindu Rukshan Bamunuarachchi tharindub at millenniumit.com
Wed Aug 12 06:09:42 PDT 2009


One more notice ...

I have created OSS/MDS on SuSE 11 (1.8.1) and tried to access it from SuSE 10 (1.8.0).
I can reach required bandwidth (~46.8 MB/s) !!!

If I have not done any mistake, seems to be SuSE 11 Lustre (1.8.1) Client does not perform well with SuSE 10 Lustre (1.8.0) MDS/OSS.
Could It be possible ?

Is there any incompatibility between 1.8.0 and 1.8.1 ?

cheers,
__
tharindu

-----Original Message-----
From: Tharindu Rukshan Bamunuarachchi [mailto:tharindub at millenniumit.com]
Sent: Wednesday, August 12, 2009 5:55 PM
To: 'Mag Gam'
Cc: 'lustre-discuss at lists.lustre.org'
Subject: RE: [Lustre-discuss] lustre performance degrade on SuSE 11

Do you have any idea about following error ... ? I can see this on both MDS and OSS ...?
I tried to Google this, but could not find anything interesting ?


LustreError: 3039:0:(socklnd_cb.c:2228:ksocknal_recv_hello()) Unknown protocol version (2.x expected) from 172.25.88.202




172.25.88.202 is lustre client.


cheers,
__
tharindu


-----Original Message-----
From: Mag Gam [mailto:magawake at gmail.com]
Sent: Wednesday, August 12, 2009 5:21 PM
To: Tharindu Rukshan Bamunuarachchi
Cc: lustre-discuss at lists.lustre.org
Subject: Re: [Lustre-discuss] lustre performance degrade on SuSE 11

How many NICs do you have on your client, MDS, OSS?

I am suspecting its a routing issue. Do you have more than 1 NIC on
all of these boxes?

options lnet 'networks="tcp0(eth0,eth1),elan0"'

I advise you to take a look at 5.1.1 in the Lustre manual,
manual.lustre.org/images/4/48/LustreManual_1.6_man_v19.pdf




On Wed, Aug 12, 2009 at 7:31 AM, Tharindu Rukshan
Bamunuarachchi<tharindub at millenniumit.com> wrote:
>
> I can SCP from/to client machine at 50 MB/s rate.
> Interface is up at 1000Full.
> No packet loss.
>
>
> Just like to emphasize ... Client is SuSE 11 (1.8.1) and OSS/MDS are SuSE 10 (1.8.0)
>
>
>
> suse11-202:~ # scp SLES-11-DVD-x86_64-GM-DVD1.iso 172.25.88.220:
> Password:
> SLES-11-DVD-x86_64-GM-DVD1.iso                100%  539MB  49.0MB/s   00:11
>
>
> Kernel Interface table
> Iface   MTU Met   RX-OK RX-ERR RX-DRP RX-OVR   TX-OK TX-ERR TX-DRP TX-OVR Flg
> eth0   1500   0 1741587      0      0      0 2002121      0      0      0 BMRU
>
>
> cheers,
> __
> tharindu
>
> -----Original Message-----
> From: Mag Gam [mailto:magawake at gmail.com]
> Sent: Wednesday, August 12, 2009 4:40 PM
> To: Tharindu Rukshan Bamunuarachchi
> Cc: lustre-discuss at lists.lustre.org
> Subject: Re: [Lustre-discuss] lustre performance degrade on SuSE 11
>
> Is your network setup properly? Can you scp/ftp file to your OSS as a
> test? Check if your network interfaces are properly connected
> (autoneg, 1000Full). make sure you aren't getting any packet loss
> (netstat -i). Also First then that and see how it goes.
>
>
> On Wed, Aug 12, 2009 at 3:37 AM, Tharindu Rukshan
> Bamunuarachchi<tharindub at millenniumit.com> wrote:
>> hi All,
>>
>>
>>
>> I have following lustre installation.
>>
>>
>>
>> Node A : OSS (SuSE 10) – 1.8.0
>>
>> Node B : MDS (SuSE 10) – 1.8.0
>>
>>
>>
>> Node C: Client (SuSE 11) – 1.8.1
>>
>>
>>
>> When try to run “dd” command on lustre mount, it is only writing at 2.1 MB/s
>>
>> But If mount same file system on Node B, I can achive 45 MB/s performance.
>>
>>
>>
>> All nodes are connected to same 3560G cisco switch.
>>
>>
>>
>> I saw following error in MDS server message file. Is this related to
>> performance of lustre file system ?
>>
>>
>>
>> LustreError: 3039:0:(socklnd_cb.c:2228:ksocknal_recv_hello()) Unknown
>> protocol version (2.x expected) from 172.25.88.202
>>
>>
>>
>>
>>
>> cheers,
>>
>> __
>>
>> tharindu
>>
>>
>>
>> *******************************************************************************************************************************************************************
>>
>> "The information contained in this email including in any attachment is
>> confidential and is meant to be read only by the person to whom it is
>> addressed. If you are not the intended recipient(s), you are prohibited from
>> printing, forwarding, saving or copying this email. If you have received
>> this e-mail in error, please immediately notify the sender and delete this
>> e-mail and its attachments from your computer."
>>
>> *******************************************************************************************************************************************************************
>>
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>>
>>
>
>
> *******************************************************************************************************************************************************************
>
> "The information contained in this email including in any attachment is confidential and is meant to be read only by the person to whom it is addressed. If you are not the intended recipient(s), you are prohibited from printing, forwarding, saving or copying this email. If you have received this e-mail in error, please immediately notify the sender and delete this e-mail and its attachments from your computer."
>
> *******************************************************************************************************************************************************************
>


*******************************************************************************************************************************************************************

"The information contained in this email including in any attachment is confidential and is meant to be read only by the person to whom it is addressed. If you are not the intended recipient(s), you are prohibited from printing, forwarding, saving or copying this email. If you have received this e-mail in error, please immediately notify the sender and delete this e-mail and its attachments from your computer."

*******************************************************************************************************************************************************************



More information about the lustre-discuss mailing list