<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Hi,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I am doing some performance benchmarking on Lustre file system. To understand my results, I wanted to know how a file is written on the OSTs.
<o:p></o:p></p>
<p class="MsoNormal">Following is what I am doing:<o:p></o:p></p>
<p class="MsoNormal">I have a file of 64 GB to be written<o:p></o:p></p>
<p class="MsoNormal">number of ranks is 64<o:p></o:p></p>
<p class="MsoNormal">number of nodes is 4<o:p></o:p></p>
<p class="MsoNormal">stripe count is 4<o:p></o:p></p>
<p class="MsoNormal">stripe size is 1GB<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Let the 4 OSTs be OST1, OST2, OST3, and OST4.<o:p></o:p></p>
<p class="MsoNormal">Let the nodes be N1, N2, N3 and N4.<o:p></o:p></p>
<p class="MsoNormal">So each rank is writing 1 GB to 1 of the 4 OSTs.<o:p></o:p></p>
<p class="MsoNormal"><b>What I want to know is that, since 16 ranks are writing 1GB from say N1, are all those ranks writing to OST1 only or it might be the case that out of the 16 ranks, some are writing to OST1, some to OST2 and so on.<o:p></o:p></b></p>
<p class="MsoNormal"><b><o:p> </o:p></b></p>
<p class="MsoNormal"><b>Also, if I increase my stripe count i.e number of OSTs to total number of OSTs, but each rank is still writing 1GB and total ranks are 64, why does the performance degrade?<o:p></o:p></b></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
<p class="MsoNormal">Prakrati<o:p></o:p></p>
</div>
</body>
</html>