[Lustre-discuss] ost_write operation failed with -28 in 1.8.5 lustre client

Rajendra prasad rajendra.dn at gmail.com
Tue May 3 20:16:08 PDT 2011


Hi,

Thank you for the info. There are around 600 clients in the setup.

Due to an issue, i had restarted the OSS servers and remounted the OSTs
yesterday.. Post which i am not seeing these errors till now.

However I will upgrade the lustre client version to 1.8.5 in all the
clients.

Regards,
Prasad


On Tue, May 3, 2011 at 1:28 AM, Andreas Dilger <adilger at whamcloud.com>wrote:

> On Apr 29, 2011, at 09:04, Rajendra prasad wrote:
> > I am running lustre servers on 1.8.5 (recently upgraded from 1.8.2).
> Clients are still on 1.8.2 .
> >
> > I am getting the error "ost_write operation failed with -28" in the
> clients. Due to this i am getting error message as "No space left on the
> device" oftenly. As per lfs df -h output all the OSTs are occupied around
> 55% only.
> >
> > lfs df -h
> > UUID                       bytes        Used   Available Use% Mounted on
> > lustre-MDT0000_UUID        52.3G        4.2G       48.1G   8%
> /opt/lustre[MDT:0]
> > lustre-OST0000_UUID       442.9G      245.6G      197.3G  55%
> /opt/lustre[OST:0]
> > lustre-OST0001_UUID       442.9G      238.7G      204.3G  53%
> /opt/lustre[OST:1]
> > lustre-OST0002_UUID       442.9G      243.2G      199.7G  54%
> /opt/lustre[OST:2]
> > lustre-OST0003_UUID       442.9G      236.5G      206.5G  53%
> /opt/lustre[OST:3]
> > lustre-OST0004_UUID       442.9G      234.8G      208.1G  53%
> /opt/lustre[OST:4]
> > lustre-OST0005_UUID       442.9G      239.7G      203.3G  54%
> /opt/lustre[OST:5]
> > lustre-OST0006_UUID       442.9G      237.2G      205.7G  53%
> /opt/lustre[OST:6]
> > lustre-OST0007_UUID       442.9G      227.9G      215.0G  51%
> /opt/lustre[OST:7]
> > filesystem summary:         3.5T        1.9T        1.6T  53% /opt/lustre
> > As per the below bugzilla, i have upgraded one of the lustre client
> verstion to 1.8.5 but still the issue persist in that client.
> >
> >                 https://bugzilla.lustre.org/show_bug.cgi?id=22755
> >
> > Lustre clients are on Suse linux 10.1 . In order to install lustre client
> packages of 1.8.5, i have upgraded the Suse kernel also.
>
> How many clients do you have?  I don't think this is an inode problem,
> since it wouldn't fail with ENOSPC during ost_write.  There is also a
> problem with clients holding all of the space in grants (about
> 32MB/client/OST) as described in the above bug.  However, unless you have
> upgraded ALL of the clients to 1.8.5, that problem will not be fixed.
>
> Cheers, Andreas
> --
> Andreas Dilger
> Principal Engineer
> Whamcloud, Inc.
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20110504/a28d3adb/attachment.htm>


More information about the lustre-discuss mailing list