[Lustre-discuss] Multihome question : unable to mount lustre over tcp.

[vaibhav pol]

Dear Lustre users,
           I am using lustre file system(lustre-1.8.1)  over ib.Now i
required lustre over ib and over Ethernet also.
    I modified the modprobe.conf on client , mds(mdt),oss(ost).
    I add below line in modprobe.conf.
    options lnet networks=o2ib(ib0),tcp1(eth1)
    I am able to  mount lustre over ib on client but not able to mount over
Ethernet.
    I am getting following error on stdout .

    mount.lustre: mount  172.29.2.25 at tcp1:/home at /mnt failed: No such file
or directory
    Is the MGS specification correct?
    Is the file system name correct?
    If upgrading, is the copied client log valid? (see upgrade docs)

    and /var/log/message is

    kernel: LustreError: 6943:0:(ldlm_lib.c:329:client_obd_setup()) can't
add initial connection
    kernel: LustreError: 6943:0:(obd_config.c:370:class_setup()) setup
home-MDT0000-mdc-ffff810f39c8ac00 failed (-2)
    kernel: LustreError:
6943:0:(obd_config.c:1197:class_config_llog_handler()) Err -2 on cfg
command:
    kernel: Lustre:    cmd=cf003 0:home-MDT0000-mdc  1:home-MDT0000_UUID
2:172.31.65.49 at o2ib
    kernel: LustreError: 15c-8: MGC172.29.2.25 at tcp1: The configuration from
log 'home-client' failed (-2). This may be the result of communication
errors between this node and the MGS, a bad configuration, or other errors.
See the syslog for more information.
    kernel: LustreError: 6933:0:(llite_lib.c:1171:ll_fill_super()) Unable to
process log: -2
    kernel: LustreError: 6933:0:(obd_config.c:441:class_cleanup()) Device 2
not setup
    kernel: LustreError: 6933:0:(ldlm_request.c:1030:ldlm_cli_cancel_req())
Got rc -108 from cancel RPC: canceling anyway
    kernel: LustreError: 6933:0:(ldlm_request.c:1533:ldlm_cli_cancel_list())
ldlm_cli_cancel_list: -108
    kernel: Lustre: client ffff810f39c8ac00 umount complete
    kernel: LustreError: 6933:0:(obd_mount.c:1997:lustre_fill_super())
Unable to mount  (-2)

    I am able to ping mgs from client .

     lctl list_nids  command output on mgs give following output.

      172.31.65.49 at o2ib
      172.29.2.25 at tcp1

    also i  able to mount lustre client on mgs  itself  over Ethernet

    Following is tunefs.lustre output


    1) mgs tunefs.lustre output

        checking for existing Lustre data: found CONFIGS/mountdata
        Reading CONFIGS/mountdata

           Read previous values:
        Target:     MGS
        Index:      unassigned
        Lustre FS:  scratch
        Mount type: ldiskfs
        Flags:      0x174
                      (MGS needs_index first_time update writeconf )
        Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
        Parameters:


           Permanent disk data:
        Target:     MGS
        Index:      unassigned
        Lustre FS:  scratch
        Mount type: ldiskfs
        Flags:      0x174
                      (MGS needs_index first_time update writeconf )
        Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr

    2) mds(mdt) tunefs.lustre output
         Read previous values:
        Target:     home-MDT0000
        Index:      0
        Lustre FS:  home
        Mount type: ldiskfs
        Flags:      0x1
              (MDT )
        Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
        Parameters:
mgsnode=172.31.65.49 at o2ibmdt.group_upcall=/usr/sbin/l_getgroups


           Permanent disk data:
        Target:     home-MDT0000
        Index:      0
        Lustre FS:  home
        Mount type: ldiskfs
        Flags:      0x1
              (MDT )
        Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
        Parameters:
mgsnode=172.31.65.49 at o2ibmdt.group_upcall=/usr/sbin/l_getgroups

     3) oss(ost) tunefs.lustre output
           Read previous values:
        Target:     home-OST0003
        Index:      3
        Lustre FS:  home
        Mount type: ldiskfs
        Flags:      0x2
                      (OST )
        Persistent mount opts: errors=remount-ro,extents,mballoc
        Parameters: mgsnode=172.31.65.49 at o2ib mdt.quota_type=ug


           Permanent disk data:
        Target:     home-OST0003
        Index:      3
        Lustre FS:  home
        Mount type: ldiskfs
        Flags:      0x2
                      (OST )
        Persistent mount opts: errors=remount-ro,extents,mballoc
        Parameters: mgsnode=172.31.65.49 at o2ib mdt.quota_type=ug

        exiting before disk write.

I am not able to figure out what is the exact problem.


Thanks and regards
Vaibhi
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20101210/fb62c5d7/attachment.htm>