<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body>
Hsieh,<br>
<br>
This sounds similar to a bug with pre-2.5 servers and 2.7 (or newer) clients. The client and server have a disagreement about which does the delete, and the delete doesnt happen. Since youre running 2.5, I dont think you should see this, but the symptoms
are the same. You can temporarily fix things by restarting/remounting your OST(s), which will trigger orphan cleanup. But if that works, the only long term fix is to upgrade your servers to a version that is expected to work with your clients. (The 2.10
maintenance release is nice if you are not interested in the newest features, otherwise, 2.12 is also an option.)<br>
<br>
I would also recommend where possible that you keep clients and servers in sync - we do interop testing, but same version on both is much more widely used.<br>
<br>
- Patrick
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> lustre-discuss <lustre-discuss-bounces@lists.lustre.org> on behalf of Tung-Han Hsieh <thhsieh@twcp1.phys.ntu.edu.tw><br>
<b>Sent:</b> Sunday, March 3, 2019 4:00:17 AM<br>
<b>To:</b> lustre-discuss@lists.lustre.org<br>
<b>Subject:</b> [lustre-discuss] Data migration from one OST to anther</font>
<div> </div>
</div>
<div class="BodyFragment"><font size="2"><span style="font-size:11pt;">
<div class="PlainText">Dear All,<br>
<br>
We have a problem of data migration from one OST two another.<br>
<br>
We have installed Lustre-2.5.3 on the MDS and OSS servers, and Lustre-2.8<br>
on the clients. We want to migrate some data from one OST to another in<br>
order to re-balance the data occupation among OSTs. In the beginning we<br>
follow the old method (i.e., method found in Lustre-1.8.X manuals) for<br>
the data migration. Suppose we have two OSTs:<br>
<br>
root@client# /opt/lustre/bin/lfs df<br>
UUID 1K-blocks Used Available Use% Mounted on<br>
chome-OST0028_UUID 7692938224 7246709148 55450156 99% /work[OST:40]<br>
chome-OST002a_UUID 14640306852 7094037956 6813847024 51% /work[OST:42]<br>
<br>
and we want to migrate data from chome-OST0028_UUID to chome-OST002a_UUID.<br>
Our procedures are:<br>
<br>
1. We deactivate chome-OST0028_UUID:<br>
root@mds# echo 0 > /opt/lustre/fs/osc/chome-OST0028-osc-MDT0000/active<br>
<br>
2. We find all files located in chome-OST0028_UUID:<br>
root@client# /opt/lustre/bin/lfs find --obd chome-OST0028_UUID /work > list<br>
<br>
3. In each file listed in the file "list", we did:<br>
<br>
cp -a <file> <file>.tmp<br>
mv <file>.tmp <file><br>
<br>
During the migration, we really saw that more and more data written into<br>
chome-OST002a_UUID. But we did not see any disk release in chome-OST0028_UUID.<br>
In Lustre-1.8.X, doing this way we did saw that chome-OST002a_UUID has<br>
more data coming in, and chome-OST0028_UUID has more and more free space.<br>
<br>
It looks like that the data files referenced by MDT have copied to<br>
chome-OST002a_UUID, but the junks still remain in chome-OST0028_UUID.<br>
Even though we activate chome-OST0028_UUID after migration, the situation<br>
is still the same:<br>
<br>
root@mds# echo 1 > /opt/lustre/fs/osc/chome-OST0028-osc-MDT0000/active<br>
<br>
Is there any way to cure this problem ?<br>
<br>
<br>
Thanks very much.<br>
<br>
T.H.Hsieh<br>
_______________________________________________<br>
lustre-discuss mailing list<br>
lustre-discuss@lists.lustre.org<br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</div>
</span></font></div>
</body>
</html>