I agree with Michael, keep it simple so it won't become unmanageable when you grow your system to ten's or hundred's of OSTs.<br>From Lustre point of vew it does not matter which OSS mounts which OST as long as the distribution of the OST's across OSS's is evenly balanced. Lustre objects are placed on the OSTs using load balancing algorithm which is based on OSTs available space.<br>
You can change that default behaviour using OST pools.<br><br>Cheers<br><br>Wojciech<br><br><div class="gmail_quote">On 31 March 2011 15:54, Michael Barnes <span dir="ltr"><<a href="mailto:Michael.Barnes@jlab.org">Michael.Barnes@jlab.org</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"><br>
Frank,<br>
<br>
File striping and allocation are essentially randomized across OSTs<br>
so from lustre's point of view there is no difference between between<br>
a and b. AFAIK, Lustre does try to do some balancing based on available<br>
space and possibly other simple heuristics, but the ordering of the OSTs<br>
does not affect this decision making process.<br>
<br>
>From a management point of view, b is much simpler to manage, and in the<br>
case that you add more storage to your system, you just keep adding the<br>
OSTs in sequence.<br>
<br>
-mb<br>
<div><div></div><div class="h5"><br>
On Mar 31, 2011, at 10:06 AM, Heckes, Frank wrote:<br>
<br>
> Hi all,<br>
><br>
> sorry if this question has been answered before.<br>
><br>
> What is the optimal 'strategy' assigning OSTs to OSS nodes:<br>
><br>
> -a- Assign OST via round-robin to the OSS<br>
> -b- Assign in consecutive order (as long as the backend storage provides<br>
> enought capacity for iops and bandwidth)<br>
> -c- Something 'in-between' the 'extremes' of -a- and -b-<br>
><br>
> E.g.:<br>
><br>
> -a- OSS_1 OSS_2 OST_3<br>
> |_ |_ |_<br>
> OST_1 OST_2 OST_3<br>
> OST_4 OST_5 OST_6<br>
> OST_7 OST_8 OST_9<br>
><br>
> -b- OSS_1 OSS_2 OST_3<br>
> |_ |_ |_<br>
> OST_1 OST_4 OST_7<br>
> OST_2 OST_5 OST_8<br>
> OST_3 OST_6 OST_9<br>
><br>
> I thought -a- would be best for task-local (each task write to own<br>
> file) and single file (all task write to single file) I/O since its like<br>
> a raid-0 approach used disk I/O (and SUN create our first FS this way).<br>
> Does someone made any systematic investigations which approach is best<br>
> or have some educated opinion?<br>
> Many thanks in advance.<br>
> BR<br>
><br>
> -Frank Heckes<br>
><br>
> ------------------------------------------------------------------------------------------------<br>
> ------------------------------------------------------------------------------------------------<br>
> Forschungszentrum Juelich GmbH<br>
> 52425 Juelich<br>
> Sitz der Gesellschaft: Juelich<br>
> Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498<br>
> Vorsitzender des Aufsichtsrats: MinDirig Dr. Karl Eugen Huthmacher<br>
> Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender),<br>
> Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,<br>
> Prof. Dr. Sebastian M. Schmidt<br>
> ------------------------------------------------------------------------------------------------<br>
> ------------------------------------------------------------------------------------------------<br>
><br>
> Besuchen Sie uns auf unserem neuen Webauftritt unter <a href="http://www.fz-juelich.de" target="_blank">www.fz-juelich.de</a><br>
> _______________________________________________<br>
> Lustre-discuss mailing list<br>
> <a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><br>
> <a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
<br>
</div></div>--<br>
+-----------------------------------------------<br>
<font color="#888888">| Michael Barnes<br>
|<br>
| Thomas Jefferson National Accelerator Facility<br>
| Scientific Computing Group<br>
| 12000 Jefferson Ave.<br>
| Newport News, VA 23606<br>
| (757) 269-7634<br>
+-----------------------------------------------<br>
</font><div><div></div><div class="h5"><br>
<br>
<br>
<br>
_______________________________________________<br>
Lustre-discuss mailing list<br>
<a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>Wojciech Turek<br><br>Senior System Architect<br><br>High Performance Computing Service<br>University of Cambridge<br>Email: <a href="mailto:wjt27@cam.ac.uk" target="_blank">wjt27@cam.ac.uk</a><br>
Tel: (+)44 1223 763517 <br>