[Lustre-discuss] Lustre build and install on Ubuntu

[Mandar Joshi]

Hi,

	If I am understanding it correctly, Nathan's steps below are to
build Lustre client. I want to create Lustre server .deb packages.
	I have patched my kernel with Lustre server patches and also have
ported ldiskfs patches for my kernel and I have successfully booted into
that kernel on Ubuntu and I am trying to create lustre server packages.(I am
able to run my patched-kernel and Lustre 2.6 on RHEL though). 

It seems that many people have not tried Lustre server on Debian now a days.
There are few ways people have created packages on Debian but most of them
are for Lustre clients.

Lustre Debian package links:
Link1:
http://linuxsysadm.wordpress.com/2014/10/10/lustre-2-6-on-debian-wheezy-clie
nts/ 
Lnik2:
https://hpc.uni.lu/blog/2013/generating-debian-packages-under-3-dot-2-kernel
-for-lustre-2-dot-1/ 

Following link have some suggestions to build lustre server, but again it
seems to be old.
Link 3:
https://groups.google.com/a/whamcloud.com/forum/#!topic/wc-discuss/3DNCH1Bt3
q8 
Link 4: http://wiki.lustre.org/index.php/Debian_Install 

With suggestions from above links, now I am able to create few .deb
packages, but it seems that Lustre server modules package is missing.

Steps I followed:
sh autogen.sh
./configure --enable-dist
make dist
mkdir BUILD
cd BUILD/
ln -s ../lustre-2.6.53.tar.gz lustre-2.6.53.orig.tar.gz
tar xzvf ../lustre-2.6.53.tar.gz
cd lustre-2.6.53/
./configure --with-linux=<Path to my Linux source> --with-o2ib=yes
dpkg-buildpackage --------> successful [Instead of dpkg-buildpackage if
'make debs' is run it fails ]

Packages built:
linux-patch-lustre_2.6.53-1_all.deb
lustre_2.6.53-1_amd64.changes
lustre_2.6.53-1.dsc
lustre-dev_2.6.53-1_amd64.deb
lustre-source_2.6.53-1_all.deb
lustre-tests_2.6.53-1_amd64.deb
lustre-utils_2.6.53-1_amd64.deb

[As I have already booted into my patched kernel, I assume I do not need to
install linux-patch-lustre....deb]
As per link#4 above, lustre-modules-2.6.XX-lustre-X.X.X._XXXXXX.deb and
liblustre-X-X.deb packages seem to be missing.

I tried " module-assistant -u/your/working/directory  -k
/path/to/the/kernel/linux-2.6-X.X " as suggested in Link#4 but it does not
list any lustre modules in "SELECT" option.

Is anything I am missing here?

Anyone tried Lustre server build, install and running for Ubuntu? I know its
not supported OS for Lustre server now a days, but still it would be great
if somebody can throw more light on the same.

PS: Adding Pratik in the loop who is working with me.
--
Mandar Joshi






-----Original Message-----
From: Grodowitz, Nathan T. [mailto:grodowitznt at ornl.gov] 
Sent: Saturday, November 08, 2014 2:19 AM
To: Dilger, Andreas
Cc: Grodowitz, Nathan T.; Mandar Joshi; lustre-discuss at lists.lustre.org
Subject: Re: [Lustre-discuss] Lustre build and install on Ubuntu

Andreas,

I will look at adding this in over the weekend. Should not be a problem.

Thank you,

Nathan Grodowitz
ITSD Linux R&D HPC Admin
865-576-4715

On Nov 5, 2014, at 4:01 PM, Dilger, Andreas
<andreas.dilger at intel.com<mailto:andreas.dilger at intel.com>> wrote:

Nathan, would you and/or Mandar be willing to incorporate the below steps
into the "make debs" build target of the Lustre master branch?

While we don't maintain Debian or Ubuntu builds ourselves, it does seem like
there is an increasing interest in this, and I hate seeing people having to
rediscover the same problems and struggle to fix them each time.

At one point, I also thought that there was a Lustre client in the Debian
unstable repo, but is that no longer the case? I don't see that as removing
the reason to getting "make debs" to work in the master branch, since there
will always be people who want to try the latest code instead of waiting for
the Debian/Ubuntu repo to be updated.

Cheers, Andreas

On Nov 5, 2014, at 7:25, "Grodowitz, Nathan T."
<grodowitznt at ornl.gov<mailto:grodowitznt at ornl.gov>> wrote:

Hello Mandar,

I recently did some work with 2.6 as a client on ubuntu 12.04. These are
some of the steps that were taken below:

apt-get source module-assistant
cd module-assistant

# Get the patches from the following pages
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=702648
# save detection.patch
http://debian.2.n7.nabble.com/Bug-697269-FTBS-with-uapi-patched-module-assis
tant-td2872117.html
# save parsing.patch

patch < detection.patch
patch < parsing.patch

sudo apt-get build-dep module-assistant
dpkg-buildpackage -rfakeroot -us -uc
cd ../
sudo dpkg -i module-assistant-0.14.deb

Then you can take a look at
LU-1706<https://jira.hpdd.intel.com/browse/LU-1706>, which explains build
script patching that must take place, even on newer versions of Ubuntu.

Once that is done, follow these steps to build the client. For your build,
you will want to build the server as well.

cd lustre-release
git checkout v2_6_0
sh ./autogen.sh
./configure --disable-server --disable-iokit --disable-tests make debs cd
debs sudo dpkg -i lustre-client-modules-3.11.0-15-generic_2.6.0-1_amd64.deb
lustre-utils_2.6.0-1_amd64.deb


Hopefully that helps.

Nathan Grodowitz


On Nov 5, 2014, at 8:10 AM, Mandar Joshi
<mandar.joshi at calsoftinc.com<mailto:mandar.joshi at calsoftinc.com><mailto:mand
ar.joshi at calsoftinc.com>> wrote:

Hi,
              I have 2 questions regarding building and installing Lustre
server on Ubuntu. We have a running Lustre setup on RHEL and now trying to
build and install on Ubuntu.

1.       Whether latest Lustre (2.6+) server can be built on Ubuntu with the
same steps as for RHEL? Or are there different steps for Ubuntu.
2.       Has anyone tried this before and/or Whether Lustre2.6.x server is
supported on Ubuntu.
3.       In another experiment, I took my RHEL working rpms (patched kernel
& lustre) and converted them to .deb packages using "alien". I could install
all rpms and then could also boot into my lustre-patched-kernel. I am able
to mkfs.lustre my MGS (and even could mount it) But mkfs.lustre for MDT
fails.
a.       First it gave errors like "Invalid filesystem option set". So I
installed e2fsprogs-1.42.7.wc1-7.el6.x86_64.rpm and
e2fsprogs-libs-1.42.7.wc1-7.el6.x86_64.rpm (which I had used for my RHEL)
using "alien"
b.      After this now it gives me another error, "Filesystem has
unsupported feature(s) while setting up superblock". I found similar issue
athttps://www.mail-archive.com/pkg-lustre-maintainers@lists.alioth.debian.or
g/msg00263.html . I am NOT getting message "Your mke2fs.conf file does not
define the ldiskfs filesystem type.". Still tried solution suggested in the
next mail, which did not work. Even links for ldiskfsprogs are not working
to try. Do I need some other version of e2fsprogs?
Can anyone throw light on this ?

Thanks,
Mandar Joshi
_______________________________________________
Lustre-discuss mailing list
Lustre-discuss at lists.lustre.org<mailto:Lustre-discuss at lists.lustre.org><mail
to:Lustre-discuss at lists.lustre.org>
http://lists.lustre.org/mailman/listinfo/lustre-discuss

_______________________________________________
Lustre-discuss mailing list
Lustre-discuss at lists.lustre.org<mailto:Lustre-discuss at lists.lustre.org>
http://lists.lustre.org/mailman/listinfo/lustre-discuss