[lustre-discuss] lustre-discuss Digest, Vol 108, Issue 11

Ms. Megan Larko dobsonunit at gmail.com
Sat Mar 28 19:19:05 PDT 2015


Hello Alex,

While not actually a Lustre solution, if this is a linux/unix system, you
might be able to add swap space onto a USB device or such similar by using
the linux mkswap command.  This is not as fast as system memory, but it can
provide some wiggle room in tight memory situations.

Just an idea...
Megan Larko

On Thu, Mar 26, 2015 at 8:00 AM, <lustre-discuss-request at lists.lustre.org>
wrote:

> Send lustre-discuss mailing list submissions to
>         lustre-discuss at lists.lustre.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         http://lists.lustre.org/mailman/listinfo/lustre-discuss
> or, via email, send a message with subject or body 'help' to
>         lustre-discuss-request at lists.lustre.org
>
> You can reach the person managing the list at
>         lustre-discuss-owner at lists.lustre.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of lustre-discuss digest..."
>
>
> Today's Topics:
>
>    1. lester on mds with low memory (Alexander Oltu)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Thu, 26 Mar 2015 11:14:47 +0100
> From: Alexander Oltu <Alexander.Oltu at uib.no>
> To: lustre-discuss at lists.lustre.org
> Subject: [lustre-discuss] lester on mds with low memory
> Message-ID: <9B6188D0-2728-4D6C-A40A-2F22C66D3963 at uib.no>
> Content-Type: text/plain; charset=us-ascii
>
> Hi,
>
> We are trying to run lester (https://github.com/ORNL-TechInt/lester) on
> MDS with low memory and about 41M files in Lustre filesystem. There is an
> extensive amount of file operations going all the time on the filesystem.
>
> This is the current memory situation on MDS:
>
> cat /proc/meminfo |egrep 'MemTotal|MemFree|Buffers|Slab'
> MemTotal:       16533620 kB
> MemFree:         1025312 kB
> Buffers:        12591976 kB
> Slab:            1391508 kB
>
> By dropping caches we can make maximum available memory of 1,5GB. When we
> run Lester it gets killed by OOM (System has no swap).
> I tried using UNIX IO manager and decreasing group and dir readahead, but
> there is still not enough memory to finish scan.
>
> Anyone has any experience with running lester on low memory? Will
> appreciate any suggestion. (There is no option to add physical RAM).
>
> Thanks,
> Alex.
>
> ------------------------------
>
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>
>
> End of lustre-discuss Digest, Vol 108, Issue 11
> ***********************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20150328/02cafe94/attachment.htm>


More information about the lustre-discuss mailing list