[Lustre-discuss] build from source

[Dilger, Andreas]

The lustre.org site is sadly out of date. Hopefully that will be fixed soon, but for now it probably isn't a good place to go for information about Lustre.

The HPDD and OpenSFS sites have more current information. 

That said, you should first ask yourself whether you actually need to build Lustre or just use existing packages. It is a lot easier to use existing packages. If you are just testing on your laptop, you can test in a VM and use a pre-built kernel most easily. 

Note that there is no Lustre server support for 3.17 kernels yet, so you can't use that combination today.

For clients you do not need to patch the kernel, but for servers you either need to use ldiskfs with a kernel that has patches for it, or use ZFS. You don't strictly need to patch even the server kernel anymore, but you will miss some performance improvements. 

Cheers, Andreas

houssen <houssen at ipgp.fr> wrote on January 18, 2015 at 09:13:24 MST:
> Hello,
> 
> I'm totally new to Lustre.
> 
> First when I googled "lustre parallel file system", I hit this : http://wiki.lustre.org/index.php/Building_and_Installing_Lustre_from_Source_Code.
> Here it's said that to build lustre from source, I need basically to :
> 1. download a specific kernel lustre is optimized for (or probably validated with)
> 2. patch the kernel source code with quilt
> 3. compile and install the patched kernel 
> 4. compile and install lustre-1.8
> 
> After more googling, I got directed to : https://downloads.hpdd.intel.com/public/lustre/latest-maintenance-release/el6/server/SRPMS.
> Here the install process seems to be as basic as "rpmbuild --rebuild lustre-2.5.x.src.rpm" according to https://wiki.hpdd.intel.com/display/PUB/Rebuilding+the+Lustre-client+rpms+for+a+new+kernel (one may build a specific kernel with "rpmbuild --rebuild kernel-xxx.src.rpm", and then, build lustre with this specific kernel adding --define options when rpmbuild'ing lustre)
> 
> Does this means the kernel patching (quilt) is no more necessary for lustre-2.5.x ? (or the kernel available for download on https://downloads.hpdd.intel.com/public/lustre/latest-maintenance-release is already patched ?)
> Is it recommended to build lustre-2.5.x with a 2.6.32 kernel ? Or not to build lustre with a specific kernel ?
> Final question that is not clear to me, does lustre must be configured with a --with-mpi-io and / or --with-hdf5 option to "account for" the existing MPI-IO / HDF5 install ? (my final aim is to benchmark big files writting using MPI-IO / HDF5 on a lustre FS)
> 
> Franck
> 
> PS : I run Fedora 21 (kernel 3-17-8) on a laptop
> _______________________________________________
> lwg mailing list
> lwg at lists.opensfs.org
> http://lists.opensfs.org/listinfo.cgi/lwg-opensfs.org