[Lustre-discuss] Help

Tue Dec 14 14:38:38 PST 2010

Hello Sheila and Andreas
Thanks for replying and pointing me to the right direction. I have followed the manual and was able to run read/write test but I am not sure how to analyze the performance based on the numbers. Can someone help me with that? Here is my configuration and I am attaching the read and write logs.

1)       I have 3 physical servers out of which 1 is a router (routernode) and 2 are clients (Node 1 and Node 2). The network is IB network and Node 1 is directly connected to Routernode’s 1st IB Port. Node 2 is directly connected to routernode’s 2nd IB Port.
2)       I wrote a script as follows.
#!/bin/bash
export LST_SESSION=$$
lst new_session write -timeout 1000
lst add_group servers 192.168.100.101 at o2ib0
lst add_group writers/readers 172.16.100.101 at o2ib1
lst add_batch bulk_write
lst add_test -batch bulk_write --from writers/readers --to servers brw write/read check=full size=1024K
lst run bulk_write
lst stat servers & sleep 30
lst end_session

Thanks a lot for all your help

Nihir
________________________________
From: Sheila Barthel [mailto:sheila.barthel at oracle.com]
Sent: Tuesday, December 14, 2010 5:13 AM
To: Nihir Parikh
Cc: Wang Yibin; lustre-discuss at lists.lustre.org
Subject: Re: [Lustre-discuss] Help

LNET self-test is discussed in the Lustre manual:

http://wiki.lustre.org/manual/LustreManual18_HTML/LustreIOKit.html#50651262_pgfId-1290255

On 12/13/2010 6:35 PM, Nihir Parikh wrote:
Hello Wang Yibin,
Can I please get step by step information on how to run lnet_selftest?

Thanks
Nihir

________________________________
From: Wang Yibin [mailto:wang.yibin at oracle.com]
Sent: Sunday, November 21, 2010 6:12 PM
To: Nihir Parikh
Cc: lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
Subject: Re: [Lustre-discuss] Help

在 2010-11-20，上午8:39， Nihir Parikh 写道：

Hello Wang Yibin,
Thanks for getting back to me. Yes, S2 and S3 can ping each other using lctl ping.

This indicates that your routing is work as expected.

I was using nuttcp test and I also tried ib tests that comes with the IB utilities. I will lnet-selftest.

These utilities do not understand lnet protocol so they won't work.

My goal was to measure the bandwidth when it has to reach across different network. Are there any such tests specific to lustre?

Lnet has its own testsuite which is called lnet self-test.
To measure the bandwidth, you can load lnet_selftest module on your nodes and execute lst in brw mode.

Thanks
Nihir

________________________________
From: Wang Yibin [mailto:wang.yibin at oracle.com]
Sent: Thursday, November 18, 2010 6:32 AM
To: Nihir Parikh
Cc: lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
Subject: Re: [Lustre-discuss] Help

Hi,

在 2010-11-17，上午9:17， Nihir Parikh 写 道：

Now my problem is to run some network tests from S2 --> S3 and S3 --> S2 to measure the bandwidth but somehow both S2 and S3 complain that network is unreachable. What am I doing wrong?

Your configuration seems OK to me. Can S2 and S3 ping each other using 'lctl ping'?
What kind of network test did you do? Note that only lustre LNET can do the routing.
There's a script in lustre testsuite that's specifically for testing the network connectivity - lnet-selftest.sh.

Thanks
Nihir

_______________________________________________
Lustre-discuss mailing list
Lustre-discuss at lists.lustre.org<mailto:Lustre-discuss at lists.lustre.org>
http://lists.lustre.org/mailman/listinfo/lustre-discuss

_______________________________________________
Lustre-discuss mailing list
Lustre-discuss at lists.lustre.org<mailto:Lustre-discuss at lists.lustre.org>
http://lists.lustre.org/mailman/listinfo/lustre-discuss

________________________________

_______________________________________________

Lustre-discuss mailing list

Lustre-discuss at lists.lustre.org<mailto:Lustre-discuss at lists.lustre.org>

http://lists.lustre.org/mailman/listinfo/lustre-discuss

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20101214/73f1914d/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: write.log
Type: application/octet-stream
Size: 1640 bytes
Desc: write.log
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20101214/73f1914d/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: read.log
Type: application/octet-stream
Size: 1674 bytes
Desc: read.log
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20101214/73f1914d/attachment-0001.obj>