[Lustre-discuss] NFS Export Issues

Andreas Dilger andreas.dilger at oracle.com
Fri Jul 16 16:50:48 PDT 2010


On 2010-07-16, at 16:55, William Olson wrote:
> On 7/16/2010 9:16 AM, Andreas Dilger wrote:
>> My only other suggestion is to dump the Lustre kernel debug log on the NFS server after a mount failure to see where/why it is getting the permission error.
>> 
>> # lctl clear
>> # (mount NFS client)
>> # lctl dk /tmp/debug
>> 
> 
>   
> [root at lustreclient ~]# lctl clear
> 
> [root at NFSclient ~]# mount 192.168.100.77:/mnt/lustre_mail_fs /mnt/lustre
> mount: 192.168.100.77:/mnt/lustre_mail_fs failed, reason given by server: Permission denied
> 
> Jul 16 15:52:51 lustreclient mountd[14552]: authenticated mount request from 192.168.100.2:954 for /mnt/lustre_mail_fs (/mnt/lustre_mail_fs)
> Jul 16 15:52:51 lustreclient mountd[14552]: can't stat exported dir /mnt/lustre_mail_fs: Permission denied
> 
> [root at lustreclient ~]# lctl dk /tmp/debug
> Debug log: 0 lines, 0 kept, 0 dropped, 0 bad.
> 

Hmm, you must have a low debug level.  Please try enabling full debug during the mount:

# lctl clear
# DBGSAVE=$(lctl get_param -n debug)
# lctl set_param debug=-1
# mount ...
# lctl dk /tmp/debug
# lctl set_param debug="$DBGSAVE"

>> Then search through the logs for -2 errors (-EPERM).
>> 

>> Cheers, Andreas
>> 
>> On 2010-07-16, at 10:06, William Olson<lustre_admin at reachone.com>  wrote:
>> 
>>   
>>> On 7/15/2010 5:48 PM, Andreas Dilger wrote:
>>>     
>>>> On 2010-07-15, at 08:33, William Olson wrote:
>>>> 
>>>>       
>>>>> Somebody, anybody?  I'm sure it's something fairly simple, but it
>>>>> escapes me, assistance would be greatly appreciated!
>>>>> 
>>>>>         
>>>> I can't comment, since my NFS re-exporting (to a MacOS client) is working fine.  Hopefully soon I can stop doing that and use the native Mac client, but I don't think my wife is willing to use alpha software yet.
>>>> 
>>>> 
>>>>       
>>> LOL, yeah.  Understood.
>>>     
>>>> Have you restarted the NFS server after changing the exports?
>>>> 
>>>>       
>>> Many many times after every change..
>>>     
>>>> Are you sure the permissions are correct?
>>>> 
>>>>       
>>> As stated below all processes that I've tested have full access and no permissions issues when interacting with the lustre file system directly..  Accepting for the mountd while attempting to stat the lustre fs during an NFS client connection..
>>>     
>>>> Have you verified that exporting a non-lustre filesystem from this server works?
>>>> 
>>>>       
>>> Indeed, as stated below I have done so.
>>>     
>>>> My /etc/exports is:
>>>> /myth           192.168.10.160(rw,async,insecure)
>>>> 
>>>>       
>>> I may not have tried the async option, I'll give that a shot really quick just for kicks.. ;)
>>> Nope, same result still... hrm..
>>> 
>>> Thanks for Responding at least Andreas!
>>> 
>>> I'm convinced that this is more of a lustre centric issue than an NFS issue, must be some interaction either on the kernel level or otherwise that's running into a permissions block somewhere..
>>> 
>>>     
>>>>>> Hello All,
>>>>>> 
>>>>>>    Having trouble exporting a lustre mount with NFS..
>>>>>> 
>>>>>> When mounting the NFS export on client:
>>>>>> [root at nfsclient /]# mount 192.168.100.77:/mnt/lustre_mail_fs
>>>>>> /mnt/lustre  (have tried nearly every possible switch that I can think
>>>>>> of, don't think it's related to "how" I attempt to mount)
>>>>>> mount: 192.168.100.77:/mnt/lustre_mail_fs failed, reason given by
>>>>>> server: Permission denied
>>>>>> 
>>>>>> Server shows log:
>>>>>> Jul 14 10:24:28 lustreclient mountd[9868]: authenticated mount request
>>>>>> from 192.168.100.2:720 for /mnt/lustre_mail_fs (/mnt/lustre_mail_fs)
>>>>>> Jul 14 10:24:28 lustreclient mountd[9868]: can't stat exported dir
>>>>>> /mnt/lustre_mail_fs: Permission denied
>>>>>> 
>>>>>> Everything from a NFS service/config perspective appears to be
>>>>>> functional, and I can indeed export a local filesystem without errors...
>>>>>> 
>>>>>> Additionally, I have no trouble using the mounted lustre filesystem, I
>>>>>> can even rsync data from the nfs client to the lustre file system on the
>>>>>> nfs server..
>>>>>> 
>>>>>> Any clues?  Your knowledge and experience would be greatly appreciated!
>>>>>> See below for config specifics..
>>>>>> 
>>>>>> Thanks!
>>>>>> Billy Olson
>>>>>> 
>>>>>> Server/Client Specifics:
>>>>>> Lustre Client/NFS Server: 192.168.100.77
>>>>>> CentOS release 5.4 (Final)
>>>>>> lustre-client-modules-1.8.3-2.6.18_164.11.1.el5_lustre.1.8.3
>>>>>> lustre-client-1.8.3-2.6.18_164.11.1.el5_lustre.1.8.3
>>>>>> Kernel:  2.6.18-164.11.1.el5
>>>>>> 
>>>>>> /etc/exports:
>>>>>> /mnt/lustre_mail_fs 192.168.100.0/24(ro,insecure)
>>>>>> I've tried various other options all the same outcome, these seemed like
>>>>>> the best to test with though..
>>>>>> 
>>>>>> [root at lustreclient ]# rpcinfo -p
>>>>>>     program vers proto   port
>>>>>>      100000    2   tcp    111  portmapper
>>>>>>      100000    2   udp    111  portmapper
>>>>>>      100024    1   udp    645  status
>>>>>>      100024    1   tcp    648  status
>>>>>>      100011    1   udp    702  rquotad
>>>>>>      100011    2   udp    702  rquotad
>>>>>>      100011    1   tcp    705  rquotad
>>>>>>      100011    2   tcp    705  rquotad
>>>>>>      100003    2   udp   2049  nfs
>>>>>>      100003    3   udp   2049  nfs
>>>>>>      100003    4   udp   2049  nfs
>>>>>>      100021    1   udp  37527  nlockmgr
>>>>>>      100021    3   udp  37527  nlockmgr
>>>>>>      100021    4   udp  37527  nlockmgr
>>>>>>      100003    2   tcp   2049  nfs
>>>>>>      100003    3   tcp   2049  nfs
>>>>>>      100003    4   tcp   2049  nfs
>>>>>>      100021    1   tcp  52555  nlockmgr
>>>>>>      100021    3   tcp  52555  nlockmgr
>>>>>>      100021    4   tcp  52555  nlockmgr
>>>>>>      100005    1   udp    716  mountd
>>>>>>      100005    1   tcp    719  mountd
>>>>>>      100005    2   udp    716  mountd
>>>>>>      100005    2   tcp    719  mountd
>>>>>>      100005    3   udp    716  mountd
>>>>>>      100005    3   tcp    719  mountd
>>>>>> 
>>>>>> [root at lustreclient ]# exportfs -v -r
>>>>>> exporting 192.168.100.0/24:/mnt/lustre_mail_fs
>>>>>> 
>>>>>> NFS Client: 192.168.100.2
>>>>>> 
>>>>>> _______________________________________________
>>>>>> Lustre-discuss mailing list
>>>>>> Lustre-discuss at lists.lustre.org
>>>>>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>>>>>> 
>>>>>> 
>>>>>>           
>>>>> _______________________________________________
>>>>> Lustre-discuss mailing list
>>>>> Lustre-discuss at lists.lustre.org
>>>>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>>>>> 
>>>>>         
>>>> Cheers, Andreas
>>>> --
>>>> Andreas Dilger
>>>> Lustre Technical Lead
>>>> Oracle Corporation Canada Inc.
>>>> 
>>>> 
>>>>       
>>>     
> 


Cheers, Andreas
--
Andreas Dilger
Lustre Technical Lead
Oracle Corporation Canada Inc.




More information about the lustre-discuss mailing list