[Lustre-discuss] [mpich-devel] ROMIO for Lustre
robl at mcs.anl.gov
Sun Sep 22 12:00:35 PDT 2013
On Sat, Sep 21, 2013 at 11:21:19PM -0500, Jaln wrote:
> Hi everyone,
> I'm not sure, whether the lustre or the MPI forum is the right place for my
both, i guess :>
> The question is about the ROMIO optimization on Lustre,
> In one SC'08 paper,
> , it's said that the way ROMIO assigns the file domains to I/O aggregators
> will not make two aggregators access the same OST.
> In my understanding, this means, the data locality on Lustre layer has been
> taken care of in the ROMIO, such that the aggregators will not
> have competition on the same OST.
> My question is "is this optimization used in all current lustre system,
> e.g., Hopper at NERSC?"
Wei-keng never contributed the specific ROMIO optimizations he discussed in
the SC 08 paper, but his work did spur a lot of community discussion
Emoly Lu contributed a bunch of Lustre ADIO driver work, which Pascal
Deveze and Martin Pokorny improved upon. MPICH-1.3 and newer contain
David Knaak from Cray implemented his own improvements. Cray's MPI-IO
is based on ROMIO but the cray modifications are proprietary. MPT-3.2
and newer contain lustre-specific optimizations.
The community has been quiet with respect to Lustre MPI-IO work since
then. I hope that's because everything "just works".
Mathematics and Computer Science Division
Argonne National Lab, IL USA
More information about the lustre-discuss