<div dir="ltr"><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div>Greetings,<br><br></div><div>WRT to Subject: Lustre Installation...<br> From: Devendra Patil<br><br><br></div>For CentOS 7.2 (not using ZFS, but XFS backing):<br></div>Server kernel: kernel-3.10.0-327.3.1.el7_lustre.x86_64<br></div>Client kernel: kernel-3.0.10-327.3.1.el7.x86_64<br><br></div>Lustre 2.8.0:<br></div>Server: basically, I used the rpms that matched the kernel. such as lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.rpm<br></div>and similar files such as kernel-headers-3.10.0-327.3.1.el7_lustre.x86_64, <br></div>lustre-modules-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64<br></div>lustre-osd-ldiskfs-2.8.0-3.10.0_327.3.1.el7_lustre.X86_64<br></div><div>lustre-osd-ldiskfs-mount-2.8.0-3.10.0_327.3.1.el7_lustre.X86_64</div>...and lustre-dkms, lustre-iokit, lustre-osd-zfs, lustre-osd-zfs-mount....<br><br></div>Client is very similar, but shorter Lustre rpm list:<br></div>lustre-client-2.8.0-3.10.0_327.3.1.el7.x86_64<br></div>lustre-client-modules-2.8.0-3.10.0_327.3.1.el7.x86_64<br></div>lustre-client-dkms-2.8.0-1.el7.noarch<br></div>lustre-client-tests-2.8.0-3.10.0_327.3.1.el7.x86_64<br><br></div>Cheers!<br></div>megan<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Jan 27, 2017 at 7:17 AM, <span dir="ltr"><<a href="mailto:lustre-discuss-request@lists.lustre.org" target="_blank">lustre-discuss-request@lists.lustre.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Send lustre-discuss mailing list submissions to<br>
<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.<wbr>org</a><br>
<br>
To subscribe or unsubscribe via the World Wide Web, visit<br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer" target="_blank">http://lists.lustre.org/<wbr>listinfo.cgi/lustre-discuss-<wbr>lustre.org</a><br>
or, via email, send a message with subject or body 'help' to<br>
<a href="mailto:lustre-discuss-request@lists.lustre.org">lustre-discuss-request@lists.<wbr>lustre.org</a><br>
<br>
You can reach the person managing the list at<br>
<a href="mailto:lustre-discuss-owner@lists.lustre.org">lustre-discuss-owner@lists.<wbr>lustre.org</a><br>
<br>
When replying, please edit your Subject line so it is more specific<br>
than "Re: Contents of lustre-discuss digest..."<br>
<br>
<br>
Today's Topics:<br>
<br>
1. Lustre Installation... (Devendra Patil)<br>
2. Re: Lustre Installation... (Jeff Slapp)<br>
<br>
<br>
------------------------------<wbr>------------------------------<wbr>----------<br>
<br>
Message: 1<br>
Date: Fri, 27 Jan 2017 15:35:34 +0530<br>
From: Devendra Patil <<a href="mailto:dspatil7768@gmail.com">dspatil7768@gmail.com</a>><br>
To: <a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.<wbr>org</a><br>
Subject: [lustre-discuss] Lustre Installation...<br>
Message-ID:<br>
<<a href="mailto:CAPVOsYUt31%2BoZmVZvbOayssG2a1ANsBYumStZoApkeEupKBDuQ@mail.gmail.com">CAPVOsYUt31+<wbr>oZmVZvbOayssG2a1ANsBYumStZoApk<wbr>eEupKBDuQ@mail.gmail.com</a>><br>
Content-Type: text/plain; charset="utf-8"<br>
<br>
Hello,<br>
<br>
I'm newbie to lustre. Currently I'm facing issue while installing lustre on<br>
CentOs 7.2. Can anyone guide me which OS to use and compatible lustre<br>
version for it.<br>
<br>
Thank you,<br>
Devendra Patil<br>
-------------- next part --------------<br>
An HTML attachment was scrubbed...<br>
URL: <<a href="http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20170127/f5d3b3cb/attachment-0001.htm" rel="noreferrer" target="_blank">http://lists.lustre.org/<wbr>pipermail/lustre-discuss-<wbr>lustre.org/attachments/<wbr>20170127/f5d3b3cb/attachment-<wbr>0001.htm</a>><br>
<br>
------------------------------<br>
<br>
Message: 2<br>
Date: Fri, 27 Jan 2017 12:17:18 +0000<br>
From: Jeff Slapp <Jeff.Slapp@DataCore.com><br>
To: Devendra Patil <<a href="mailto:dspatil7768@gmail.com">dspatil7768@gmail.com</a>>,<br>
"<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.<wbr>org</a>" <<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.<wbr>org</a>><br>
Subject: Re: [lustre-discuss] Lustre Installation...<br>
Message-ID:<br>
<<a href="mailto:9ae4f4edcfd448018dad607386e5fa92@Mail-RE3.datacoresoftware.com">9ae4f4edcfd448018dad607386e5f<wbr>a92@Mail-RE3.datacoresoftware.<wbr>com</a>><br>
Content-Type: text/plain; charset="utf-8"<br>
<br>
Good day Devendra,<br>
<br>
Below are the steps I used to install the MGS, OSS and client using ZFS. If you are using CentOS 7.2 you will need to adjust some of the parameters below to match:<br>
<br>
[INITIAL OS INSTALL]<br>
Using CentOS 7.3.1611 with the following roles enabled:<br>
File and Storage Server<br>
Guest Agents (if in a VM)<br>
Large System Performance<br>
Network File System Client<br>
Performance Tools<br>
Compatibility Libraries<br>
Development Tools<br>
<br>
[POST OS INSTALL STEPS TO BE PERFORMED ON ALL LUSTRE NODES (MGS/MGT AND OSS)]<br>
hostname [YOUR SERVER NAME] - or use nmtui to configure network interfaces<br>
vi /etc/yum.repos.d/lustre_<wbr>server.repo<br>
[lustre-server]<br>
name=CentOS-$releasever - Lustre server<br>
baseurl=<a href="https://downloads.hpdd.intel.com/public/lustre/lustre-2.9.0/el7.3.1611/server/" rel="noreferrer" target="_blank">https://downloads.<wbr>hpdd.intel.com/public/lustre/<wbr>lustre-2.9.0/el7.3.1611/<wbr>server/</a><br>
gpgcheck=0<br>
yum -y install <a href="http://dl.fedoraproject.org/pub/epel/7/x86_64/e/epel-release-7-8.noarch.rpm" rel="noreferrer" target="_blank">http://dl.fedoraproject.org/<wbr>pub/epel/7/x86_64/e/epel-<wbr>release-7-8.noarch.rpm</a><br>
yum clean all<br>
kernel_version=`yum list --showduplicates kernel | grep lustre-server | awk '{print $2}'`<br>
kernel_firmware_version=`yum list --showduplicates kernel-firmware | grep lustre-server | awk '{print $2}'`<br>
yum -y install --nogpgcheck --setopt=protected_multilib=<wbr>false kernel-${kernel_version} kernel-firmware-${kernel_<wbr>firmware_version} kernel-devel-${kernel_version} kernel-headers-${kernel_<wbr>version}<br>
yum clean all<br>
yum -y install yum-plugin-versionlock<br>
yum versionlock add kernel<br>
yum versionlock add kernel-firmware<br>
yum versionlock add kernel-devel<br>
yum versionlock add kernel-headers<br>
yum clean all<br>
yum-config-manager --disable lustre-server<br>
yum -y install <a href="http://download.zfsonlinux.org/epel/zfs-release.el7_3.noarch.rpm" rel="noreferrer" target="_blank">http://download.zfsonlinux.<wbr>org/epel/zfs-release.el7_3.<wbr>noarch.rpm</a><br>
yum clean all<br>
yum-config-manager --disable zfs<br>
yum-config-manager --enable zfs-kmod<br>
** reboot **<br>
yum -y install wget<br>
yum -y install rpm-build<br>
yum -y install kmod-zfs-devel libzfs2-devel<br>
yum -y install libselinux-devel libtool<br>
rm -f lustre-2.9.0-1.src.rpm&& wget -q <a href="https://downloads.hpdd.intel.com/public/lustre/lustre-2.9.0/el7/server/SRPMS/lustre-2.9.0-1.src.rpm" rel="noreferrer" target="_blank">https://downloads.hpdd.intel.<wbr>com/public/lustre/lustre-2.9.<wbr>0/el7/server/SRPMS/lustre-2.9.<wbr>0-1.src.rpm</a><br>
rm -rf ~rpmbuild&& rpmbuild --rebuild --with zfs lustre-2.9.0-1.src.rpm<br>
cd ~/rpmbuild/RPMS/`uname -m`/&& yum -y install kmod-lustre-osd-zfs-2.9.0* kmod-lustre-2.9.0* lustre-osd-zfs-mount-2.9.0* lustre-2.9.0* lustre-iokit*<br>
modprobe zfs<br>
systemctl stop firewalld<br>
systemctl disable firewalld<br>
systemctl preset zfs-import-cache zfs-import-scan zfs-mount zfs-share zfs-zed zfs.target<br>
systemctl enable zfs-import-scan<br>
chkconfig lustre on<br>
echo "options lnet networks=tcp0(eth0)" > /etc/modprobe.d/lustre.conf<br>
<br>
[MGS/MDT SPECIFIC]<br>
zpool create -f mgs01-pool mirror /dev/sd[b-c]<br>
mkfs.lustre --mdt --mgs --backfstype=zfs --fsname=ZFS01 --index=0 --mgsnode=[MGS IP ADDRESS]@tcp0 mgs01-pool/ZFS01<br>
mkdir /mnt/ZFS01<br>
lctl dl<br>
mount -t lustre mgs01-pool/ZFS01 /mnt/ZFS01<br>
lctl dl<br>
<br>
[OSS SPECIFIC]<br>
zpool create -f oss01-pool raidz /dev/sd[b-e]<br>
mkfs.lustre --ost --backfstype=zfs --fsname=ZFS01 --index=0 --mgsnode=[MGS IP ADDRESS]@tcp0 oss01-pool/ZFS01<br>
mkdir /mnt/ZFS01<br>
lctl dl<br>
mount -t lustre oss01-pool/ZFS01 /mnt/ZFS01<br>
lctl dl<br>
<br>
[LUSTRE CLIENT INSTALL]<br>
vi /etc/yum.repos.d/lustre_<wbr>client.repo<br>
[lustre-client]<br>
name=CentOS-$releasever - Lustre client<br>
baseurl=<a href="https://downloads.hpdd.intel.com/public/lustre/lustre-2.9.0/el7.3.1611/client/" rel="noreferrer" target="_blank">https://downloads.<wbr>hpdd.intel.com/public/lustre/<wbr>lustre-2.9.0/el7.3.1611/<wbr>client/</a><br>
gpgcheck=0<br>
yum -y install lustre-client-2.9.0* kmod-lustre-client-2.9.0*<br>
mkdir /mnt/lustre<br>
echo "options lnet networks=tcp0(eth0)" > /etc/modprobe.d/lustre.conf<br>
mount -t lustre [IP ADDRESS OF MGS SERVER]@tcp0:/ZFS01 /mnt/lustre<br>
<br>
<br>
Hope this helps.<br>
<br>
<br>
From: lustre-discuss [mailto:<a href="mailto:lustre-discuss-bounces@lists.lustre.org">lustre-discuss-<wbr>bounces@lists.lustre.org</a>] On Behalf Of Devendra Patil<br>
Sent: Friday, January 27, 2017 5:06 AM<br>
To: <a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.<wbr>org</a><br>
Subject: [lustre-discuss] Lustre Installation...<br>
<br>
Hello,<br>
<br>
I'm newbie to lustre. Currently I'm facing issue while installing lustre on CentOs 7.2. Can anyone guide me which OS to use and compatible lustre version for it.<br>
<br>
Thank you,<br>
Devendra Patil<br>
-------------- next part --------------<br>
An HTML attachment was scrubbed...<br>
URL: <<a href="http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20170127/b4ccc842/attachment.htm" rel="noreferrer" target="_blank">http://lists.lustre.org/<wbr>pipermail/lustre-discuss-<wbr>lustre.org/attachments/<wbr>20170127/b4ccc842/attachment.<wbr>htm</a>><br>
<br>
------------------------------<br>
<br>
Subject: Digest Footer<br>
<br>
______________________________<wbr>_________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.<wbr>org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer" target="_blank">http://lists.lustre.org/<wbr>listinfo.cgi/lustre-discuss-<wbr>lustre.org</a><br>
<br>
<br>
------------------------------<br>
<br>
End of lustre-discuss Digest, Vol 130, Issue 21<br>
******************************<wbr>*****************<br>
</blockquote></div><br></div>