<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
<title></title>
</head>
<body bgcolor="#ffffff" text="#000000">
Alex wrote:
<blockquote cite="mid:200811041747.25761.linux@vfemail.net" type="cite">
<pre wrap="">On Tuesday 04 November 2008 16:37, Brian J. Murrell wrote:
</pre>
<blockquote type="cite">
<pre wrap="">On Tue, 2008-11-04 at 15:51 +0200, Alex wrote:
</pre>
<blockquote type="cite">
<pre wrap="">[root@rs1 ~]# lfs df -h
UUID bytes Used Available Use% Mounted on
testfs-MDT0000_UUID 130.4G 460.1M 122.5G 0%
/mnt/lustre[MDT:0] testfs-OST0000_UUID 18.3G 17.4G 2.0M
94% /mnt/lustre[OST:0] testfs-OST0001_UUID 18.3G 15.5G 2.0G
84% /mnt/lustre[OST:1] testfs-OST0002_UUID 36.7G 15.5G
19.4G 42% /mnt/lustre[OST:2] testfs-OST0003_UUID 36.7G 15.5G
19.4G 42% /mnt/lustre[OST:3] filesystem summary: 110.0G 63.8G
40.7G 57% /mnt/lustre [root@rs1 ~]#
As you can see OST:0 is full!
</pre>
</blockquote>
<pre wrap="">Indeed. Is this a 1.6 or a 1.4 installation?
</pre>
</blockquote>
<pre wrap=""><!---->
Hi Brian,
Many thanks for your reply. See my answers inline.
[root@rs1 ~]# rpm -q lustre
lustre-1.6.5.1-2.6.18_53.1.14.el5_lustre.1.6.5.1smp
[root@rs1 ~]#
</pre>
<blockquote type="cite">
<pre wrap="">As long as you have not
forced an allocation policy with striping for example, with 1.6 your
OSTs should fill in a more-or-less even manner and you should not see
this type of problem.
</pre>
</blockquote>
<pre wrap=""><!---->
I have activated striping on /mnt/lustre after some OSTs has been filled
arbitray, in order to be able to use entire /mnt/lustre size (110GB), so
thats the cause of my present problem.
</pre>
<blockquote type="cite">
<blockquote type="cite">
<pre wrap="">Question1: Is any command to use in order to move arround 60% of OST:0
data from OST:0 to other OST or to all other OSTes (arround 20% to each
other)?
</pre>
</blockquote>
</blockquote>
<pre wrap=""><!---->
Now i have:
[root@rhclm ~]# cat /proc/fs/lustre/lov/testfs-mdtlov/qos_prio_free
90%
[root@rhclm ~]#
</pre>
<blockquote type="cite">
<pre wrap="">Deactivate allocation to the full OST on the MDS
</pre>
</blockquote>
<pre wrap=""><!---->
How can i do this? lctl conf_param testfs-MDT0000.lov.qos_prio_free=100 will
do the trick?
</pre>
</blockquote>
You need to disable an OST on the MDS server but not on the clients.
This will prevent the clients from creating new object on the full OST
but you still will be able to access it for reading.<br>
lctl --device N deactivate <br>
where N is the device number which you can obtain by running lctl dl
command<br>
<blockquote cite="mid:200811041747.25761.linux@vfemail.net" type="cite">
<pre wrap="">
</pre>
<blockquote type="cite">
<pre wrap="">and do some "mv" (or
cp/rm if you are more comfortable with that) operations which will
result in moving the objects for the file to other OSTs.
</pre>
</blockquote>
<pre wrap=""><!---->
All right. Let me explain better... I found that /mnt/lustre/test3.img is 12Gb
in size and is striped between all OSTs (arround 3GB/OST). Indeed, if i
remove /mnt/lustre/test3.img i'll get some free space on OST:0, as well as on
other OSTs. Now, i want to make up some free space ONLY on OST:0, MOVING some
objects from it to another OST.
[root@rs1 ~]# lfs getstripe /mnt/lustre/test3.img
OBDS:
0: testfs-OST0000_UUID ACTIVE
1: testfs-OST0001_UUID ACTIVE
2: testfs-OST0002_UUID ACTIVE
3: testfs-OST0003_UUID ACTIVE
/mnt/lustre/test3.img
obdidx objid objid group
0 7 0x7 0
2 6 0x6 0
3 70 0x46 0
1 69 0x45 0
[root@rs1 ~]#
So, how can i move objid=7 from OST:0 to OST:2, keeping
intact /mnt/lustre/test3.img file?
</pre>
</blockquote>
I don't know how to move a particular object but you could move a whole
file to another OST and that would release some space from the full OST.<br>
mkdir /mnt/lustre/tmp<br>
lfs setstripe -i 2 -c 1 /mnt/lustre/tmp<br>
and then copy or move file test3.img into tmp dir<br>
<br>
<blockquote cite="mid:200811041747.25761.linux@vfemail.net" type="cite">
<pre wrap="">
Regards,
Alx
_______________________________________________
Lustre-discuss mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a>
<a class="moz-txt-link-freetext" href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a>
</pre>
</blockquote>
<br>
</body>
</html>