<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div apple-content-edited="true" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Ok, so I got some automated reply that my post is too big. I’ve uploaded the print screens some place.</div><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><br class=""></div><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">So, first, here’s the listing of some random folders in /O/1/<br class=""><br class="">debugfs: ls -l /O/1/d14<br class=""> 30408754 40700 (2) 0 0 12288 24-Apr-2015 05:36 .<br class=""> 30408739 40755 (2) 0 0 4096 6-Apr-2015 08:53 ..<br class=""> 216 100644 (17) 0 0 4153280 23-Apr-2015 14:20 7662<br class=""> 339 100644 (17) 0 0 4153280 23-Apr-2015 19:24 7790<br class=""> 369 100644 (17) 0 0 4153280 23-Apr-2015 20:29 7822<br class=""> 402 100644 (17) 0 0 4153280 23-Apr-2015 21:37 7854<br class=""> 433 100644 (17) 0 0 4153280 23-Apr-2015 22:56 7886<br class=""> 491 100644 (17) 0 0 4153280 24-Apr-2015 01:52 7950<br class=""> 547 100644 (17) 0 0 4153280 24-Apr-2015 05:36 8014<br class=""> 7575 100644 (17) 0 0 4153280 23-Apr-2015 07:34 7534<br class=""> 120 100644 (17) 0 0 4153280 23-Apr-2015 09:29 7566<br class=""> 153 100644 (17) 0 0 4153280 23-Apr-2015 11:08 7598<br class=""> 184 100644 (17) 0 0 4153280 23-Apr-2015 12:51 7630<br class=""> 248 100644 (17) 0 0 4153280 23-Apr-2015 15:46 7694<br class=""> 308 100644 (17) 0 0 4153280 23-Apr-2015 18:15 7758<br class=""> 464 100644 (17) 0 0 4153280 24-Apr-2015 00:20 7918<br class=""> 521 100644 (17) 0 0 4153280 24-Apr-2015 03:35 7982<br class=""><br class="">debugfs: ls -l /O/1/d13<br class=""> 30408753 40700 (2) 0 0 12288 24-Apr-2015 05:31 .<br class=""> 30408739 40755 (2) 0 0 4096 6-Apr-2015 08:53 ..<br class=""> 152 100644 (17) 0 0 4153280 23-Apr-2015 11:04 7597<br class=""> 215 100644 (17) 0 0 4153280 23-Apr-2015 14:17 7661<br class=""> 401 100644 (17) 0 0 4153280 23-Apr-2015 21:35 7853<br class=""> 463 100644 (17) 0 0 4153280 24-Apr-2015 00:18 7917<br class=""> 490 100644 (17) 0 0 4153280 24-Apr-2015 01:49 7949<br class=""> 546 100644 (17) 0 0 4153280 24-Apr-2015 05:31 8013<br class=""> 119 100644 (17) 0 0 4153280 23-Apr-2015 09:26 7565<br class=""> 183 100644 (17) 0 0 4153280 23-Apr-2015 12:48 7629<br class=""> 247 100644 (17) 0 0 4153280 23-Apr-2015 15:44 7693<br class=""> 278 100644 (17) 0 0 4153280 23-Apr-2015 17:02 7725<br class=""> 307 100644 (17) 0 0 4153280 23-Apr-2015 18:13 7757<br class=""> 338 100644 (17) 0 0 4153280 23-Apr-2015 19:22 7789<br class=""> 370 100644 (17) 0 0 4153280 23-Apr-2015 20:27 7821<br class=""> 432 100644 (17) 0 0 4153280 23-Apr-2015 22:53 7885<br class=""> 522 100644 (17) 0 0 4153280 24-Apr-2015 03:31 7981<br class=""><br class="">debugfs: ls -l /O/1/d12<br class=""> 30408752 40700 (2) 0 0 16384 24-Apr-2015 05:27 .<br class=""> 30408739 40755 (2) 0 0 4096 6-Apr-2015 08:53 ..<br class=""> 214 100644 (17) 0 0 4153280 23-Apr-2015 14:14 7660<br class=""> 246 100644 (17) 0 0 4153280 23-Apr-2015 15:42 7692<br class=""> 306 100644 (17) 0 0 4153280 23-Apr-2015 18:10 7756<br class=""> 337 100644 (17) 0 0 4153280 23-Apr-2015 19:20 7788<br class=""> 462 100644 (17) 0 0 4153280 24-Apr-2015 00:16 7916<br class=""> 489 100644 (17) 0 0 4153280 24-Apr-2015 01:46 7948<br class=""> 151 100644 (1) 0 0 4153280 23-Apr-2015 11:01 7596<br class=""> 118 100644 (17) 0 0 4153280 23-Apr-2015 09:23 7564<br class=""> 400 100644 (17) 0 0 4153280 23-Apr-2015 21:33 7852<br class=""> 544 100644 (17) 0 0 4153280 24-Apr-2015 05:27 8012<br class=""> 182 100644 (17) 0 0 4153280 23-Apr-2015 12:46 7628<br class=""> 431 100644 (17) 0 0 4153280 23-Apr-2015 22:51 7884<br class=""><br class="">Apparently, all of them have 4MB and it seems the number of files is growing. Some of them were created yesterday and some today.<br class="">Don’t know if I can attach some print screens to this email and will be shown in the thread, but I’ll try anyway. Basically, after unmounting / re-mounting lustre partitions on the server yesterday (and I actually tried the same on 2 of them), I could see on the graphs that the used storage is decreasing (actually, from the graphs, which show free storage, is increasing). So maybe, is it some sort of caching? </div><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><br class=""></div><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">The links:</div><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><a href="http://5.175.193.50/ps1.png" class="">http://5.175.193.50/ps1.png</a></div><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><a href="http://5.175.193.50/ps2.png" class="">http://5.175.193.50/ps2.png</a><br class=""><br class="Apple-interchange-newline">
</div><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Thanks,</div><div style="orphans: auto; text-align: start; text-indent: 0px; widows: auto; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Radu</div>
</div></div></div><br class=""><div><blockquote type="cite" class=""><div class="">On 23 Apr 2015, at 21:01, Mohr Jr, Richard Frank (Rick Mohr) <<a href="mailto:rmohr@utk.edu" class="">rmohr@utk.edu</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><br class=""><blockquote type="cite" class="">On Apr 23, 2015, at 1:07 PM, Colin Faber <<a href="mailto:cfaber@gmail.com" class="">cfaber@gmail.com</a>> wrote:<br class=""><br class=""><br class="">Based on the directory structure here, this appears to be an OST. are you sure your targets are correctly named?<br class=""><br class=""></blockquote><br class="">That is what I would have guessed until I took a look at my own MDT. Sure enough, I have the directories /O/1/d[0-31] and each one seems to have 3 files that are about 3.5MB each (along with some other smaller ones). Here is what one of those directories looks like:<br class=""><br class="">debugfs: ls -l /O/1/d14<br class=""> 16777293 40700 (2) 0 0 4096 20-Apr-2015 14:09 .<br class=""> 16777278 40755 (2) 0 0 4096 13-May-2014 16:51 ..<br class=""> 58129 100644 (1) 0 0 8256 13-May-2014 16:51 14<br class=""> 58162 100644 (1) 0 0 8256 13-May-2014 16:51 46<br class=""> 58197 100644 (1) 0 0 8256 13-May-2014 16:51 78<br class=""> 58237 100644 (1) 0 0 37632 13-May-2014 19:28 110<br class=""> 58271 100644 (1) 0 0 38464 13-May-2014 19:28 142<br class=""> 58305 100644 (1) 0 0 37888 13-May-2014 19:28 174<br class=""> 58343 100644 (1) 0 0 37184 13-May-2014 19:28 206<br class=""> 58396 100644 (1) 0 0 37312 13-May-2014 19:28 238<br class=""> 58429 100644 (1) 0 0 36160 13-May-2014 19:28 270<br class=""> 12824 100644 (1) 0 0 3623232 20-Apr-2015 14:09 43150<br class=""> 12915 100644 (1) 0 0 3800960 20-Apr-2015 14:09 43182<br class=""> 12954 100644 (1) 0 0 3769216 20-Apr-2015 14:09 43214<br class=""><br class="">The three large files seem to have been created the last time the MDT was mounted. The timestamps for the other smaller files coincides with the Lustre upgrade we performed last year. But I am not sure what is contained in these files.<br class=""><br class="">Radu: Are the timestamps for all of your files the same? Or is the system gradually accumulating them over time for some reason?<br class=""><br class="">--<br class="">Rick Mohr<br class="">Senior HPC System Administrator<br class="">National Institute for Computational Sciences<br class=""><a href="http://www.nics.tennessee.edu" class="">http://www.nics.tennessee.edu</a><br class=""><br class=""></div></blockquote></div><br class=""></body></html>