<div dir="ltr">Hello Alex,<div><br></div><div>While not actually a Lustre solution, if this is a linux/unix system, you might be able to add swap space onto a USB device or such similar by using the linux mkswap command. This is not as fast as system memory, but it can provide some wiggle room in tight memory situations.</div><div><br></div><div>Just an idea...</div><div>Megan Larko</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Mar 26, 2015 at 8:00 AM, <span dir="ltr"><<a href="mailto:lustre-discuss-request@lists.lustre.org" target="_blank">lustre-discuss-request@lists.lustre.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Send lustre-discuss mailing list submissions to<br>
<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
<br>
To subscribe or unsubscribe via the World Wide Web, visit<br>
<a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
or, via email, send a message with subject or body 'help' to<br>
<a href="mailto:lustre-discuss-request@lists.lustre.org">lustre-discuss-request@lists.lustre.org</a><br>
<br>
You can reach the person managing the list at<br>
<a href="mailto:lustre-discuss-owner@lists.lustre.org">lustre-discuss-owner@lists.lustre.org</a><br>
<br>
When replying, please edit your Subject line so it is more specific<br>
than "Re: Contents of lustre-discuss digest..."<br>
<br>
<br>
Today's Topics:<br>
<br>
1. lester on mds with low memory (Alexander Oltu)<br>
<br>
<br>
----------------------------------------------------------------------<br>
<br>
Message: 1<br>
Date: Thu, 26 Mar 2015 11:14:47 +0100<br>
From: Alexander Oltu <<a href="mailto:Alexander.Oltu@uib.no">Alexander.Oltu@uib.no</a>><br>
To: <a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
Subject: [lustre-discuss] lester on mds with low memory<br>
Message-ID: <<a href="mailto:9B6188D0-2728-4D6C-A40A-2F22C66D3963@uib.no">9B6188D0-2728-4D6C-A40A-2F22C66D3963@uib.no</a>><br>
Content-Type: text/plain; charset=us-ascii<br>
<br>
Hi,<br>
<br>
We are trying to run lester (<a href="https://github.com/ORNL-TechInt/lester" target="_blank">https://github.com/ORNL-TechInt/lester</a>) on MDS with low memory and about 41M files in Lustre filesystem. There is an extensive amount of file operations going all the time on the filesystem.<br>
<br>
This is the current memory situation on MDS:<br>
<br>
cat /proc/meminfo |egrep 'MemTotal|MemFree|Buffers|Slab'<br>
MemTotal: 16533620 kB<br>
MemFree: 1025312 kB<br>
Buffers: 12591976 kB<br>
Slab: 1391508 kB<br>
<br>
By dropping caches we can make maximum available memory of 1,5GB. When we run Lester it gets killed by OOM (System has no swap).<br>
I tried using UNIX IO manager and decreasing group and dir readahead, but there is still not enough memory to finish scan.<br>
<br>
Anyone has any experience with running lester on low memory? Will appreciate any suggestion. (There is no option to add physical RAM).<br>
<br>
Thanks,<br>
Alex.<br>
<br>
------------------------------<br>
<br>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
<br>
<br>
End of lustre-discuss Digest, Vol 108, Issue 11<br>
***********************************************<br>
</blockquote></div><br></div>