<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div>Comments inlne.</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>lustre-discuss <<a href="mailto:lustre-discuss-bounces@lists.lustre.org">lustre-discuss-bounces@lists.lustre.org</a>> on behalf of "E.S. Rosenberg" <<a href="mailto:esr+lustre@mail.hebrew.edu">esr+lustre@mail.hebrew.edu</a>><br>
<span style="font-weight:bold">Date: </span>Monday, March 20, 2017 at 10:19 AM<br>
<span style="font-weight:bold">To: </span>"<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>" <<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>><br>
<span style="font-weight:bold">Subject: </span>[lustre-discuss] how homogenous should a lustre cluster be?<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr">
<div>
<div>
<div>
<div>
<div>
<div>Dear all,<br>
</div>
<br>
</div>
>How homogenous/not homogenous are your clusters?<br>
<br>
</div>
>At the moment all our OSS are identical and running lustrefs (lustre 2.8.0), now that I am taking one OSS offline for hardware maintenance I started wondering if I can bring it back as a ZFS OSS or would that make my lustre blow up?</div>
</div>
</div>
</div>
</div>
</div>
</span>
<div><br>
</div>
<div>Two things - 1) If you are re-making or replacing an existing OSS you need to do it properly, or there will be problems. See the Lustre Manual for the process. </div>
<div><br>
</div>
<div>2) We test with mixed clusters all the time. No issues at all with making one OSS ZFS and other OSS ldiskfs, no issues with multiple hardware types in a cluster. </div>
<div>Depending on the mix of hardware, you may wish to implement striping policies to avoid performance and space utilization issues. For example, if you stripe across multiple OST, and one OST is older, slower hardware the overall IO speed will be limited
by your slowest OST. OST pools are very useful for this. </div>
<span id="OLK_SRC_BODY_SECTION">
<div>
<div>
<div dir="ltr">
<div>
<div>
<div><br>
<br>
</div>
>Also in a more general sense do other people have lustre clusters with OSS/OSTs that are different hardware generations etc.?</div>
</div>
</div>
</div>
</div>
</span>
<div>></div>
<div>There are many customers with multiple hardware generations in a cluster. Uses tend to vary with the site/use. Typically when people add a big pile of new OSS, they put the new gear up as a separate filesystem or pool to simplify the performance/space
situation. </div>
<span id="OLK_SRC_BODY_SECTION">
<div>
<div>
<div dir="ltr">
<div>
<div><br>
<br>
</div>
>Thanks,<br>
</div>
>Eli</div>
</div>
</div>
</span>
<div><br>
</div>
<div>Hope this helps </div>
<div>Cliffw</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div>
<div>
<div dir="ltr"><br>
</div>
</div>
</div>
</span>
</body>
</html>