<div dir="ltr"><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small;color:#993399">Hi Martin</div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small;color:#993399"><br></div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small;color:#993399">Thanks for your inputs. I am checking the configurations you pointed out. I will post my finding / response soon.</div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small;color:#993399">Sorry for the typo, i realized that i had a typo as soon as i sent that email. It was a copy paste/modification error in the email. I executed the correct command still no luck.</div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small;color:#993399"><br></div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small;color:#993399">Thanks</div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small;color:#993399"><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jul 21, 2016 at 2:33 AM, Martin Hecht <span dir="ltr"><<a href="mailto:hecht@hlrs.de" target="_blank">hecht@hlrs.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi,<br>
<br>
I think your client doesn't have the o2ib lnet (it should appear in the<br>
output of the lctl ping, even if you ping on the tcp lnet).<br>
In your /etc/modprobe.d/lustre.conf o2ib is associated with the ib0<br>
interface, but your /var/log/messages talks about ib1.<br>
If it is a dual port card where just one port is used, the easiest would<br>
be to plug the cable to the other interface. (If there are two ib<br>
connections, things might become a bit more complicated. There are<br>
examples for multi rail configurations using several lnets in the lustre<br>
manual, but maybe this goes too far.)<br>
<br>
With the attempt to mount via tcp (or tcp0, which is the same) I think<br>
the problem is that the file system config on the mgs doesn't contain<br>
the tcp-NIDs and/or the routes are not configured correctly. It seems<br>
the attempt to mount via tcp causes the client to use o2ib for the<br>
connections to the MDS and OSSes. So, I would recommend to get that<br>
working first and then look at tcp0 at a later stage (if you need it at<br>
all - native o2ib is more performant).<br>
<br>
Last but not least I have noticed a typo in your client mount command:<br>
<span class="">mount -t lustre 192.168.200.52@ob2:/mylustre /lustre<br>
</span>this should be "o2ib" here, too.<br>
<br>
best regards,<br>
Martin<br>
<span class=""><br>
On 07/20/2016 08:09 PM, sohamm wrote:<br>
> Hi<br>
><br>
> Any guidance/help on this is greatly appreciated.<br>
><br>
> Thanks<br>
><br>
> On Mon, Jul 18, 2016 at 7:25 PM, sohamm <<a href="mailto:sohamm@gmail.com">sohamm@gmail.com</a>> wrote:<br>
><br>
>> Hi Ben<br>
>> Both the networks have netmasks of value 255.255.255.0<br>
>><br>
>> Thanks<br>
>><br>
>> On Mon, Jul 18, 2016 at 10:08 AM, Ben Evans <<a href="mailto:bevans@cray.com">bevans@cray.com</a>> wrote:<br>
>><br>
>>> What do your netmasks look like on each network?<br>
>>><br>
>>> From: lustre-discuss <<a href="mailto:lustre-discuss-bounces@lists.lustre.org">lustre-discuss-bounces@lists.lustre.org</a>> on behalf<br>
>>> of sohamm <<a href="mailto:sohamm@gmail.com">sohamm@gmail.com</a>><br>
>>> Date: Monday, July 18, 2016 at 1:56 AM<br>
>>> To: "<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>" <<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>><br>
>>> Subject: Re: [lustre-discuss] lustre-discuss Digest, Vol 124, Issue 17<br>
>>><br>
>>> Hi Thomas<br>
>>> Below are the results of the commands you suggested.<br>
>>><br>
</span>>>> *From Client*<br>
<span class="">>>> [root@dev1 ~]# lctl ping 192.168.200.52@o2ib<br>
>>> failed to ping 192.168.200.52@o2ib: Input/output error<br>
>>> [root@dev1 ~]# lctl ping 192.168.111.52@tcp<br>
>>> 12345-0@lo<br>
>>> 12345-192.168.200.52@o2ib<br>
>>> 12345-192.168.111.52@tcp<br>
>>> [root@dev1 ~]# mount -t lustre 192.168.111.52@tcp:/mylustre /lustre<br>
>>> mount.lustre: mount 192.168.111.52@tcp:/mylustre at /lustre failed:<br>
>>> Input/output error<br>
>>> Is the MGS running?<br>
>>> mount: mounting 192.168.111.52@tcp:/mylustre on /lustre failed: Invalid<br>
>>> argument<br>
>>><br>
>>> cat /var/log/messages | tail<br>
>>> Jul 18 01:37:04 dev1 user.warn kernel: [2250504.401397] ib1: multicast<br>
>>> join failed for ff12:401b:ffff:0000:0000:0000:ffff:ffff, status -22<br>
>>> Jul 18 01:37:26 dev1 user.warn kernel: [2250526.257309] LNet: No route to<br>
>>> 12345-192.168.200.52@o2ib via <?> (all routers down)<br>
>>> Jul 18 01:37:36 dev1 user.warn kernel: [2250536.481862] ib1: multicast<br>
>>> join failed for ff12:401b:ffff:0000:0000:0000:ffff:ffff, status -22<br>
>>> Jul 18 01:41:53 dev1 user.warn kernel: [2250792.947299] LNet: No route to<br>
>>> 12345-192.168.200.52@o2ib via <?> (all routers down)<br>
>>><br>
>>><br>
</span>>>> *From MGS*<br>
<div class="HOEnZb"><div class="h5">>>> [root@lustre_mgs01_vm03 ~]# lctl ping 192.168.111.102@tcp<br>
>>> 12345-0@lo<br>
>>> 12345-192.168.111.102@tcp<br>
>>><br>
>>> Please let me know what else i can try. Looks like i am missing something<br>
>>> with the ib config? Do i need router setup as part of lnet ?<br>
>>> if i am able to ping mgs from client on the tcp network, it should still<br>
>>> work ?<br>
>>><br>
>>> Thanks<br>
>>><br>
>>><br>
>>> On Sun, Jul 17, 2016 at 1:07 PM, <<a href="mailto:lustre-discuss-request@lists.lustre.org">lustre-discuss-request@lists.lustre.org</a><br>
>>>> wrote:<br>
>>>> Send lustre-discuss mailing list submissions to<br>
>>>> <a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
>>>><br>
>>>> To subscribe or unsubscribe via the World Wide Web, visit<br>
>>>> <a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
>>>> or, via email, send a message with subject or body 'help' to<br>
>>>> <a href="mailto:lustre-discuss-request@lists.lustre.org">lustre-discuss-request@lists.lustre.org</a><br>
>>>><br>
>>>> You can reach the person managing the list at<br>
>>>> <a href="mailto:lustre-discuss-owner@lists.lustre.org">lustre-discuss-owner@lists.lustre.org</a><br>
>>>><br>
>>>> When replying, please edit your Subject line so it is more specific<br>
>>>> than "Re: Contents of lustre-discuss digest..."<br>
>>>><br>
>>>><br>
>>>> Today's Topics:<br>
>>>><br>
>>>> 1. llapi_file_get_stripe() and /proc/fs/lustre/osc/ entries<br>
>>>> (John Bauer)<br>
>>>> 2. luster client mount issues (sohamm)<br>
>>>> 3. Re:<br>
>>>> <br>
>>>> luster client mount issues (Thomas Roth)<br>
>>>><br>
>>>><br>
>>>> ----------------------------------------------------------------------<br>
>>>><br>
>>>> Message: 1<br>
>>>> Date: Sat, 16 Jul 2016 15:11:22 -0500<br>
>>>> From: John Bauer <<a href="mailto:bauerj@iodoctors.com">bauerj@iodoctors.com</a>><br>
>>>> To: "<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>"<br>
>>>> <<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>><br>
>>>> Subject: [lustre-discuss] llapi_file_get_stripe() and<br>
>>>> /proc/fs/lustre/osc/ entries<br>
>>>> Message-ID: <<a href="mailto:03ceaaa0-b004-ae43-eaa1-437da2a5b717@iodoctors.com">03ceaaa0-b004-ae43-eaa1-437da2a5b717@iodoctors.com</a>><br>
>>>> Content-Type: text/plain; charset="utf-8"; Format="flowed"<br>
>>>><br>
>>>> I am using *llapi_file_get_stripe()* to get the ost indexes that a file<br>
>>>> is striped on. That part is working fine. But there are multiple Lustre<br>
>>>> file systems on the node resulting in multiple **OST0000* *in the<br>
>>>> directory /proc/fs/lustre/osc. Is there something in the *struct<br>
>>>> lov_user_ost_data* or *struct lov_user_md* that would indicate which of<br>
>>>> the following directories pertains to the file's OST ?<br>
>>>><br>
>>>> dr-xr-xr-x 2 root root 0 Jul 16 12:31 nbp1-OST0000-osc-ffff880287ae4c00<br>
>>>> dr-xr-xr-x 2 root root 0 Jul 16 12:31 nbp2-OST0000-osc-ffff881034d99000<br>
>>>> dr-xr-xr-x 2 root root 0 Jul 16 12:31 nbp6-OST0000-osc-ffff881003cd7800<br>
>>>> dr-xr-xr-x 2 root root 0 Jul 16 12:31 nbp7-OST0000-osc-ffff880ffe051c00<br>
>>>> dr-xr-xr-x 2 root root 0 Jul 16 12:31 nbp8-OST0000-osc-ffff880ffe054c00<br>
>>>> dr-xr-xr-x 2 root root 0 Jul 16 12:31 nbp9-OST0000-osc-ffff880fcf179400<br>
>>>><br>
>>>> Thanks<br>
>>>><br>
>>>> --<br>
>>>> I/O Doctors, LLC<br>
>>>> 507-766-0378<br>
>>>> <a href="mailto:bauerj@iodoctors.com">bauerj@iodoctors.com</a><br>
>>>><br>
>>>> -------------- next part --------------<br>
>>>> An HTML attachment was scrubbed...<br>
>>>> URL: <<br>
>>>> <a href="http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20160716/95176929/attachment.html" rel="noreferrer" target="_blank">http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20160716/95176929/attachment.html</a><br>
>>>> ------------------------------<br>
>>>><br>
>>>> Message: 2<br>
>>>> Date: Sat, 16 Jul 2016 14:34:35 -0700<br>
>>>> From: sohamm <<a href="mailto:sohamm@gmail.com">sohamm@gmail.com</a>><br>
>>>> To: <a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
>>>> Subject: [lustre-discuss] luster client mount issues<br>
>>>> Message-ID:<br>
>>>> <<br>
>>>> <a href="mailto:CAKGc%2BeBQ%2BMCdbSrc7Ft4gd%2BzmZ6FbAZHaVhSQtpgOshYrJqhhw@mail.gmail.com">CAKGc+eBQ+MCdbSrc7Ft4gd+zmZ6FbAZHaVhSQtpgOshYrJqhhw@mail.gmail.com</a>><br>
>>>> Content-Type: text/plain; charset="utf-8"<br>
>>>><br>
>>>> Hi<br>
>>>><br>
>>>> I am trying to mount lustre client. Below are steps and necessary<br>
>>>> information surrounding the issue. Please let me know if i am missing<br>
>>>> something<br>
>>>><br>
>>>> Thanks<br>
>>>> Div<br>
>>>><br>
>>>> *Mgs:*<br>
>>>><br>
>>>> [root@lustre_mgs01_vm03 ~]# cat /etc/modprobe.d/lustre.conf<br>
>>>><br>
>>>> options lnet networks=o2ib(ib0),tcp0(eth0)<br>
>>>><br>
>>>><br>
>>>><br>
>>>> [root@lustre_mgs01_vm03 ~]# modprobe lnet<br>
>>>><br>
>>>> [root@lustre_mgs01_vm03 ~]# lsmod | grep lnet<br>
>>>><br>
>>>> lnet 449065 0<br>
>>>><br>
>>>> libcfs 405839 1 lnet<br>
>>>><br>
>>>> [root@lustre_mgs01_vm03 ~]# lctl network up<br>
>>>><br>
>>>> LNET configured<br>
>>>><br>
>>>> [root@lustre_mgs01_vm03 ~]# lctl list_nids<br>
>>>><br>
>>>> 192.168.200.52@o2ib<br>
>>>><br>
>>>> 192.168.111.52@tcp<br>
>>>><br>
>>>> *On Client:*<br>
>>>> I am able to ping MGS on both tcp and ib network<br>
>>>><br>
>>>> [root@dev1~]# ping 192.168.111.52<br>
>>>><br>
>>>> PING 192.168.111.52 (192.168.111.52) 56(84) bytes of data.<br>
>>>><br>
>>>> 64 bytes from <a href="http://192.168.111.52" rel="noreferrer" target="_blank">192.168.111.52</a>: icmp_req=1 ttl=64 time=5.81 ms<br>
>>>><br>
>>>> 64 bytes from <a href="http://192.168.111.52" rel="noreferrer" target="_blank">192.168.111.52</a>: icmp_req=2 ttl=64 time=0.802 ms<br>
>>>><br>
>>>> 64 bytes from <a href="http://192.168.111.52" rel="noreferrer" target="_blank">192.168.111.52</a>: icmp_req=3 ttl=64 time=0.780 ms<br>
>>>><br>
>>>> ^C<br>
>>>><br>
>>>> --- 192.168.111.52 ping statistics ---<br>
>>>><br>
>>>> 3 packets transmitted, 3 received, 0% packet loss, time 2000ms<br>
>>>><br>
>>>> rtt min/avg/max/mdev = 0.780/2.464/5.811/2.366 ms<br>
>>>><br>
>>>> [root@dev1 ~]# ping 192.168.200.52<br>
>>>><br>
>>>> PING 192.168.200.52 (192.168.200.52) 56(84) bytes of data.<br>
>>>><br>
>>>> 64 bytes from <a href="http://192.168.200.52" rel="noreferrer" target="_blank">192.168.200.52</a>: icmp_req=1 ttl=64 time=24.4 ms<br>
>>>><br>
>>>> 64 bytes from <a href="http://192.168.200.52" rel="noreferrer" target="_blank">192.168.200.52</a>: icmp_req=2 ttl=64 time=2.14 ms<br>
>>>><br>
>>>> 64 bytes from <a href="http://192.168.200.52" rel="noreferrer" target="_blank">192.168.200.52</a>: icmp_req=3 ttl=64 time=0.782 ms<br>
>>>><br>
>>>> 64 bytes from <a href="http://192.168.200.52" rel="noreferrer" target="_blank">192.168.200.52</a>: icmp_req=4 ttl=64 time=9.30 ms<br>
>>>><br>
>>>> ^C<br>
>>>><br>
>>>> --- 192.168.200.52 ping statistics ---<br>
>>>><br>
>>>> 4 packets transmitted, 4 received, 0% packet loss, time 3005ms<br>
>>>><br>
>>>><br>
>>>> *client mount commands*<br>
>>>><br>
>>>> mount -t lustre 192.168.111.52@tcp:/mylustre /lustre ( or)<br>
>>>><br>
>>>> mount -t lustre 192.168.111.52@tcp0:/mylustre /lustre ( or)<br>
>>>><br>
>>>> mount -t lustre 192.168.200.52@ob2:/mylustre /lustre<br>
>>>><br>
>>>><br>
>>>> *cat /var/log/messages | tail -40*<br>
>>>><br>
>>>> Jul 16 17:03:17 dev1 user.err kernel: [2133277.466013] LustreError:<br>
>>>> 162-5:<br>
>>>> Missing mount data: check that /sbin/mount.lustre is installed.<br>
>>>><br>
>>>> Jul 16 17:03:17 dev1 user.err kernel: [2133277.466064] LustreError:<br>
>>>> 13627:0:(obd_mount.c:1325:lustre_fill_super()) Unable to mount (-22)<br>
>>>><br>
>>>> Jul 16 17:03:23 dev1 user.warn kernel: [2133282.680519] Lustre:<br>
>>>> 12364:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has<br>
>>>> timed out for slow reply: [sent 1468702998/real 1468702998]<br>
>>>> req@ffff8801e0bc3c00 x1539427524411444/t0(0) o250->MGC192.168.111.52<br>
>>>><br>
>>>> Jul 16 17:03:24 dev1 user.err kernel: [2133283.680193] LustreError:<br>
>>>> 13628:0:(client.c:1083:ptlrpc_import_delay_req()) @@@ send limit expired<br>
>>>> req@ffff8801e0bc7000 x1539427524411448/t0(0) o101->MGC192.168.111.52@tcp<br>
>>>> @192.168.111.52@tcp:26/25 lens 328/344 e 0 to 0 dl<br>
>>>><br>
>>>> Jul 16 17:03:31 dev1 user.err kernel: [2133290.760978] LustreError:<br>
>>>> 13657:0:(client.c:1083:ptlrpc_import_delay_req()) @@@ send limit expired<br>
>>>> req@ffff8801b7159800 x1539427524411456/t0(0) o101->MGC192.168.111.52@tcp<br>
>>>> @192.168.111.52@tcp:26/25 lens 328/344 e 0 to 0 dl<br>
>>>><br>
>>>> Jul 16 17:03:43 dev1 user.warn kernel: [2133302.681412] Lustre:<br>
>>>> 12364:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has<br>
>>>> failed due to network error: [sent 1468703023/real 1468703023]<br>
>>>> req@ffff8801d6bfc800 x1539427524411460/t0(0) o250->MGC192.168.111<br>
>>>><br>
>>>> Jul 16 17:04:08 dev1 user.warn kernel: [2133327.681402] Lustre:<br>
>>>> 12364:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has<br>
>>>> failed due to network error: [sent 1468703048/real 1468703048]<br>
>>>> req@ffff8801d6bfec00 x1539427524411464/t0(0) o250->MGC192.168.111<br>
>>>><br>
>>>> Jul 16 17:04:15 dev1 user.err kernel: [2133334.680175] LustreError:<br>
>>>> 13628:0:(client.c:1083:ptlrpc_import_delay_req()) @@@ send limit expired<br>
>>>> req@ffff8801e0bc7000 x1539427524411452/t0(0) o101->MGC192.168.111.52@tcp<br>
>>>> @192.168.111.52@tcp:26/25 lens 328/344 e 0 to 0 dl<br>
>>>><br>
>>>> Jul 16 17:04:15 dev1 user.err kernel: [2133334.680316] LustreError:<br>
>>>> 15c-8:<br>
>>>> MGC192.168.111.52@tcp: The configuration from log 'mylustre-client'<br>
>>>> failed<br>
>>>> (-5). This may be the result of communication errors between this node<br>
>>>> and<br>
>>>> the MGS, a bad configuration, or other e<br>
>>>><br>
>>>> Jul 16 17:04:15 dev1 user.err kernel: [2133334.680357] LustreError:<br>
>>>> 13628:0:(llite_lib.c:1046:ll_fill_super()) Unable to process log: -5<br>
>>>><br>
>>>> Jul 16 17:04:15 dev1 user.warn kernel: [2133334.680881] Lustre: Unmounted<br>
>>>> mylustre-client<br>
>>>><br>
>>>> Jul 16 17:04:15 dev1 user.err kernel: [2133334.731730] LustreError:<br>
>>>> 13628:0:(obd_mount.c:1325:lustre_fill_super()) Unable to mount (-5)<br>
>>>> -------------- next part --------------<br>
>>>> An HTML attachment was scrubbed...<br>
>>>> URL: <<br>
>>>> <a href="http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20160716/28fb2cad/attachment-0001.htm" rel="noreferrer" target="_blank">http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20160716/28fb2cad/attachment-0001.htm</a><br>
>>>> ------------------------------<br>
>>>><br>
>>>> Message: 3<br>
>>>> Date: Sun, 17 Jul 2016 10:19:18 +0200<br>
>>>> From: Thomas Roth <<a href="mailto:t.roth@gsi.de">t.roth@gsi.de</a>><br>
>>>> To: <<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>><br>
>>>> Subject: Re: [lustre-discuss] luster client mount issues<br>
>>>> Message-ID: <<a href="mailto:578B3F86.1060203@gsi.de">578B3F86.1060203@gsi.de</a>><br>
>>>> Content-Type: text/plain; charset="windows-1252"; format=flowed<br>
>>>><br>
>>>> Hi,<br>
>>>><br>
>>>> try 'lctl ping' from your clients to the MDS to check if you get through<br>
>>>> on lnet, e.g.<br>
>>>><br>
>>>> lctl ping ping 192.168.200.52@o2ib<br>
>>>><br>
>>>> or<br>
>>>><br>
>>>> lctl ping 192.168.111.52@tcp<br>
>>>><br>
>>>><br>
>>>> and vice versa from the MDS to the clients' nids.<br>
>>>><br>
>>>> Regards,<br>
>>>> Thomas<br>
>>>><br>
>>>> On 07/16/2016 11:34 PM, sohamm wrote:<br>
>>>>> Hi<br>
>>>>><br>
>>>>> I am trying to mount lustre client. Below are steps and necessary<br>
>>>>> information surrounding the issue. Please let me know if i am missing<br>
>>>>> something<br>
>>>>><br>
>>>>> Thanks<br>
>>>>> Div<br>
>>>>><br>
>>>>> *Mgs:*<br>
>>>>><br>
>>>>> [root@lustre_mgs01_vm03 ~]# cat /etc/modprobe.d/lustre.conf<br>
>>>>><br>
>>>>> options lnet networks=o2ib(ib0),tcp0(eth0)<br>
>>>>><br>
>>>>><br>
>>>>><br>
>>>>> [root@lustre_mgs01_vm03 ~]# modprobe lnet<br>
>>>>><br>
>>>>> [root@lustre_mgs01_vm03 ~]# lsmod | grep lnet<br>
>>>>><br>
>>>>> lnet 449065 0<br>
>>>>><br>
>>>>> libcfs 405839 1 lnet<br>
>>>>><br>
>>>>> [root@lustre_mgs01_vm03 ~]# lctl network up<br>
>>>>><br>
>>>>> LNET configured<br>
>>>>><br>
>>>>> [root@lustre_mgs01_vm03 ~]# lctl list_nids<br>
>>>>><br>
>>>>> 192.168.200.52@o2ib<br>
>>>>><br>
>>>>> 192.168.111.52@tcp<br>
>>>>><br>
>>>>> *On Client:*<br>
>>>>> I am able to ping MGS on both tcp and ib network<br>
>>>>><br>
>>>>> [root@dev1~]# ping 192.168.111.52<br>
>>>>><br>
>>>>> PING 192.168.111.52 (192.168.111.52) 56(84) bytes of data.<br>
>>>>><br>
>>>>> 64 bytes from <a href="http://192.168.111.52" rel="noreferrer" target="_blank">192.168.111.52</a>: icmp_req=1 ttl=64 time=5.81 ms<br>
>>>>><br>
>>>>> 64 bytes from <a href="http://192.168.111.52" rel="noreferrer" target="_blank">192.168.111.52</a>: icmp_req=2 ttl=64 time=0.802 ms<br>
>>>>><br>
>>>>> 64 bytes from <a href="http://192.168.111.52" rel="noreferrer" target="_blank">192.168.111.52</a>: icmp_req=3 ttl=64 time=0.780 ms<br>
>>>>><br>
>>>>> ^C<br>
>>>>><br>
>>>>> --- 192.168.111.52 ping statistics ---<br>
>>>>><br>
>>>>> 3 packets transmitted, 3 received, 0% packet loss, time 2000ms<br>
>>>>><br>
>>>>> rtt min/avg/max/mdev = 0.780/2.464/5.811/2.366 ms<br>
>>>>><br>
>>>>> [root@dev1 ~]# ping 192.168.200.52<br>
>>>>><br>
>>>>> PING 192.168.200.52 (192.168.200.52) 56(84) bytes of data.<br>
>>>>><br>
>>>>> 64 bytes from <a href="http://192.168.200.52" rel="noreferrer" target="_blank">192.168.200.52</a>: icmp_req=1 ttl=64 time=24.4 ms<br>
>>>>><br>
>>>>> 64 bytes from <a href="http://192.168.200.52" rel="noreferrer" target="_blank">192.168.200.52</a>: icmp_req=2 ttl=64 time=2.14 ms<br>
>>>>><br>
>>>>> 64 bytes from <a href="http://192.168.200.52" rel="noreferrer" target="_blank">192.168.200.52</a>: icmp_req=3 ttl=64 time=0.782 ms<br>
>>>>><br>
>>>>> 64 bytes from <a href="http://192.168.200.52" rel="noreferrer" target="_blank">192.168.200.52</a>: icmp_req=4 ttl=64 time=9.30 ms<br>
>>>>><br>
>>>>> ^C<br>
>>>>><br>
>>>>> --- 192.168.200.52 ping statistics ---<br>
>>>>><br>
>>>>> 4 packets transmitted, 4 received, 0% packet loss, time 3005ms<br>
>>>>><br>
>>>>><br>
>>>>> *client mount commands*<br>
>>>>><br>
>>>>> mount -t lustre 192.168.111.52@tcp:/mylustre /lustre ( or)<br>
>>>>><br>
>>>>> mount -t lustre 192.168.111.52@tcp0:/mylustre /lustre ( or)<br>
>>>>><br>
>>>>> mount -t lustre 192.168.200.52@ob2:/mylustre /lustre<br>
>>>>><br>
>>>>><br>
>>>>> *cat /var/log/messages | tail -40*<br>
>>>>><br>
>>>>> Jul 16 17:03:17 dev1 user.err kernel: [2133277.466013] LustreError:<br>
>>>> 162-5:<br>
>>>>> Missing mount data: check that /sbin/mount.lustre is installed.<br>
>>>>><br>
>>>>> Jul 16 17:03:17 dev1 user.err kernel: [2133277.466064] LustreError:<br>
>>>>> 13627:0:(obd_mount.c:1325:lustre_fill_super()) Unable to mount (-22)<br>
>>>>><br>
>>>>> Jul 16 17:03:23 dev1 user.warn kernel: [2133282.680519] Lustre:<br>
>>>>> 12364:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent<br>
>>>> has<br>
>>>>> timed out for slow reply: [sent 1468702998/real 1468702998]<br>
>>>>> req@ffff8801e0bc3c00 x1539427524411444/t0(0) o250->MGC192.168.111.52<br>
>>>>><br>
>>>>> Jul 16 17:03:24 dev1 user.err kernel: [2133283.680193] LustreError:<br>
>>>>> 13628:0:(client.c:1083:ptlrpc_import_delay_req()) @@@ send limit<br>
>>>> expired<br>
>>>>> req@ffff8801e0bc7000 x1539427524411448/t0(0)<br>
>>>> o101->MGC192.168.111.52@tcp<br>
>>>>> @192.168.111.52@tcp:26/25 lens 328/344 e 0 to 0 dl<br>
>>>>><br>
>>>>> Jul 16 17:03:31 dev1 user.err kernel: [2133290.760978] LustreError:<br>
>>>>> 13657:0:(client.c:1083:ptlrpc_import_delay_req()) @@@ send limit<br>
>>>> expired<br>
>>>>> req@ffff8801b7159800 x1539427524411456/t0(0)<br>
>>>> o101->MGC192.168.111.52@tcp<br>
>>>>> @192.168.111.52@tcp:26/25 lens 328/344 e 0 to 0 dl<br>
>>>>><br>
>>>>> Jul 16 17:03:43 dev1 user.warn kernel: [2133302.681412] Lustre:<br>
>>>>> 12364:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent<br>
>>>> has<br>
>>>>> failed due to network error: [sent 1468703023/real 1468703023]<br>
>>>>> req@ffff8801d6bfc800 x1539427524411460/t0(0) o250->MGC192.168.111<br>
>>>>><br>
>>>>> Jul 16 17:04:08 dev1 user.warn kernel: [2133327.681402] Lustre:<br>
>>>>> 12364:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent<br>
>>>> has<br>
>>>>> failed due to network error: [sent 1468703048/real 1468703048]<br>
>>>>> req@ffff8801d6bfec00 x1539427524411464/t0(0) o250->MGC192.168.111<br>
>>>>><br>
>>>>> Jul 16 17:04:15 dev1 user.err kernel: [2133334.680175] LustreError:<br>
>>>>> 13628:0:(client.c:1083:ptlrpc_import_delay_req()) @@@ send limit<br>
>>>> expired<br>
>>>>> req@ffff8801e0bc7000 x1539427524411452/t0(0)<br>
>>>> o101->MGC192.168.111.52@tcp<br>
>>>>> @192.168.111.52@tcp:26/25 lens 328/344 e 0 to 0 dl<br>
>>>>><br>
>>>>> Jul 16 17:04:15 dev1 user.err kernel: [2133334.680316] LustreError:<br>
>>>> 15c-8:<br>
>>>>> MGC192.168.111.52@tcp: The configuration from log 'mylustre-client'<br>
>>>> failed<br>
>>>>> (-5). This may be the result of communication errors between this node<br>
>>>> and<br>
>>>>> the MGS, a bad configuration, or other e<br>
>>>>><br>
>>>>> Jul 16 17:04:15 dev1 user.err kernel: [2133334.680357] LustreError:<br>
>>>>> 13628:0:(llite_lib.c:1046:ll_fill_super()) Unable to process log: -5<br>
>>>>><br>
>>>>> Jul 16 17:04:15 dev1 user.warn kernel: [2133334.680881] Lustre:<br>
>>>> Unmounted<br>
>>>>> mylustre-client<br>
>>>>><br>
>>>>> Jul 16 17:04:15 dev1 user.err kernel: [2133334.731730] LustreError:<br>
>>>>> 13628:0:(obd_mount.c:1325:lustre_fill_super()) Unable to mount (-5)<br>
>>>>><br>
>>>>><br>
>>>>><br>
>>>>> _______________________________________________<br>
>>>>> lustre-discuss mailing list<br>
>>>>> <a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
>>>>> <a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
>>>>><br>
>>>> --<br>
>>>> --------------------------------------------------------------------<br>
>>>> Thomas Roth<br>
>>>> Department: HPC<br>
>>>> Location: SB3 1.262<br>
>>>> Phone: <a href="tel:%2B49-6159-71%201453" value="+496159711453">+49-6159-71 1453</a> Fax: <a href="tel:%2B49-6159-71%202986" value="+496159712986">+49-6159-71 2986</a><br>
>>>><br>
>>>> GSI Helmholtzzentrum f?r Schwerionenforschung GmbH<br>
>>>> Planckstra?e 1<br>
>>>> 64291 Darmstadt<br>
>>>> <a href="http://www.gsi.de" rel="noreferrer" target="_blank">www.gsi.de</a><br>
>>>><br>
>>>> Gesellschaft mit beschr?nkter Haftung<br>
>>>> Sitz der Gesellschaft: Darmstadt<br>
>>>> Handelsregister: Amtsgericht Darmstadt, HRB 1528<br>
>>>><br>
>>>> Gesch?ftsf?hrung: Professor Dr. Karlheinz Langanke<br>
>>>> Ursula Weyrich<br>
>>>> J?rg Blaurock<br>
>>>><br>
>>>> Vorsitzender des Aufsichtsrates: St Dr. Georg Sch?tte<br>
>>>> Stellvertreter: Ministerialdirigent Dr. Rolf Bernhardt<br>
>>>><br>
>>>><br>
>>>> ------------------------------<br>
>>>><br>
>>>> Subject: Digest Footer<br>
>>>><br>
>>>> _______________________________________________<br>
>>>> lustre-discuss mailing list<br>
>>>> <a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
>>>> <a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
>>>><br>
>>>><br>
>>>> ------------------------------<br>
>>>><br>
>>>> End of lustre-discuss Digest, Vol 124, Issue 17<br>
>>>> ***********************************************<br>
>>>><br>
>>><br>
><br>
<br>
<br>
<br>
</div></div></blockquote></div><br></div>