[Lustre-discuss] Frequent system calls cause high load on meta data server

[Colin Faber]

Hi,

Yes, this is somewhat expected behavior.  More client memory can help this  
as it allows for more local caching. 

-cf

-----Original message-----
From: Christian Becker <christian.becker at math.tu-dortmund.de>
To: "lustre-discuss at lists.lustre.org" <lustre-discuss at lists.lustre.org>
Sent: Fri, May 4, 2012 22:34:26 MDT
Subject: [Lustre-discuss] Frequent system calls cause high load on meta data	 
server

Dear colleagues,

one of our users calls within his R application an external program via 
the system function very often (/home is a lustre file system):


  for (i=0;i<10000;i++)
  {
    system("/home/user/bin/program arg0 arg1 ....");
  }

The runtime for the external program is only a few seconds. With hundred 
of these jobs running, the load on the meta data server goes up to 25 
(2way quad core with lustre 1.8.3).


Is such a behavior known, if yes, how can I avoid it?


best regards,
Christian


_______________________________________________
Lustre-discuss mailing list
Lustre-discuss at lists.lustre.org
http://lists.lustre.org/mailman/listinfo/lustre-discuss

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20120504/5ed5c16d/attachment.htm>