<div dir="ltr"><div dir="ltr"><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Hi,<br></div><div>I have been trying to install Lustre client (v2.13.55) on Ubuntu 18.04 and 16.04 for the past 6 days and have not been successful. I have been getting the below errors:</div><div><br></div><div>All I want is a direction to debug the issue (Have tried almost all the solutions present in the web). I dont understand what is the requirement for Lustre as on some nodes I'm able to install it and on nodes it just wouldn't install. (I checked the versions of the installed packages (dpkg -l) and found only minor version changes)</div><div><br></div><div>Again Any Help is really appreciated.</div><div><br></div><div><b>Ubuntu 18.04:</b></div><div><b><br></b></div><div><div><u><b>Steps to Build custom kernel </b>- but same as the server it will run the client on.</u></div><div>1. uname -r (output: 5.4.0-42-generic)<br>2. git clone git://<a href="https://mailtrack.io/trace/link/9d8dbf7625bb99cabf6a3629f21d8e0d14418dfb?url=http%3A%2F%2Fkernel.ubuntu.com%2Fubuntu%2Fubuntu-bionic.git&userId=3941104&signature=d677cc853c3a2a99" target="_blank">kernel.ubuntu.com/ubuntu/ubuntu-bionic.git</a> ubuntu-kernel<br>3. cd ubuntu-kernel/<br>4. git tag | grep 5.4.0-42<br>5. git checkout Ubuntu-hwe-5.4-5.4.0-42.46_18.04.1<br>6. cp /boot/config-5.4.0-42-generic .config<br>7. touch .scmversion<br></div><div>8. sudo apt-get install libncurses-dev flex bison openssl libssl-dev dkms libelf-dev libudev-dev libpci-dev libiberty-dev autoconf<br>9. sudo apt-get build-dep linux linux-image-$(uname -r)<br>10. make -j $(nproc)<br></div><div><br></div><div><u><b>Steps to Build Lustre client:</b></u></div><div>1. git clone git://<a href="https://mailtrack.io/trace/link/cc63c89f0f6e035b31ffe195e51d16f198f20077?url=http%3A%2F%2Fgit.whamcloud.com%2Ffs%2Flustre-release.git&userId=3941104&signature=7139133553cf8999" target="_blank">git.whamcloud.com/fs/lustre-release.git</a></div>2. cd lustre-release/<br>3. git checkout v2_13_53<br>4. sh autogen.sh<br>5. pwd<br>6. ./configure --disable-server --with-linux=/home/zeblok/ubuntu-kernel<br>7. make debs -j $(nproc)<b><br></b></div><div><pre style="white-space:pre-wrap;font-size:14px"><b>Error:</b></pre><pre style="white-space:pre-wrap;font-size:14px">make[1]: Leaving directory '/<span style="font-family:Arial,Helvetica,sans-serif">home/zeblok/lustre-release'</span></pre><pre style="white-space:pre-wrap;font-size:14px"> dpkg-genbuildinfo
dpkg-genchanges >../lustre_2.13.53-1_amd64.changes
dpkg-genchanges: warning: package lustre-server-utils in control file but not in files list
dpkg-genchanges: warning: package lustre-resource-agents in control file but not in files list
dpkg-genchanges: warning: package lustre-client-modules-dkms in control file but not in files list
dpkg-genchanges: info: including full source code in upload
dpkg-source -I.git -I*.out[0-9]* -I*.swp --after-build lustre-release
dpkg-buildpackage: info: full upload; Debian-native package (full source is included)
~/lustre-release/debian/tmp/modules-deb ~/lustre-release
Removing old /home/zeblok/lustre-release/debian/tmp/modules-deb/usr_src/modules/lustre/ tree
Extracting the package tarball, /usr/src/lustre.tar.bz2, please wait...
/usr/bin/fakeroot: 175: /usr/bin/fakeroot: debian/rules: Permission denied
/usr/bin/fakeroot: 175: /usr/bin/fakeroot: debian/rules: Permission denied
BUILD FAILED!
See /home/zeblok/lustre-release/debian/tmp/modules-deb/var_cache_modass/lustre.buildlog.5.4.0-42-generic.1595583181 for details.
mv: cannot stat '../lustre-dev__*.deb': No such file or directory
mv: cannot stat '../lustre-source__all.deb': No such file or directory
mv: cannot stat '../lustre-iokit__*.deb': No such file or directory
mv: cannot stat '../lustre-tests__*.deb': No such file or directory
mv: cannot stat '../lustre-*-utils__*.deb': No such file or directory
mv: cannot stat '../lustre_.dsc': No such file or directory
mv: cannot stat '../lustre__*.changes': No such file or directory
mv: cannot stat '../lustre_.tar.gz': No such file or directory
mv: cannot stat '../lustre-*-modules-5.4.0-42-generic__*.deb': No such file or directory
autoMakefile:1190: recipe for target 'debs' failed
make: *** [debs] Error 1</pre></div><div><br></div><div><b>Ubuntu 16.04:</b></div><div><b>Similar building process for <u>Ubuntu 16.04:</u></b></div><div><b><u><br></u></b></div> LD [M] /home/zeblok/lustre-release/lustre/ptlrpc/ptlrpc.o<br>Makefile:1471: recipe for target '_module_/home/zeblok/lustre-release' failed<br>make[5]: *** [_module_/home/zeblok/lustre-release] Error 2<br>make[5]: Leaving directory '/usr/src/linux-headers-4.4.0-186-generic'<br>autoMakefile:1051: recipe for target 'modules' failed<br>make[4]: *** [modules] Error 2<br>make[4]: Leaving directory '/home/zeblok/lustre-release'<br>autoMakefile:592: recipe for target 'all-recursive' failed<br>make[3]: *** [all-recursive] Error 1<br>make[3]: Leaving directory '/home/zeblok/lustre-release'<br>autoMakefile:490: recipe for target 'all' failed<br>make[2]: *** [all] Error 2<br>make[2]: Leaving directory '/home/zeblok/lustre-release'<br>debian/rules:218: recipe for target 'build-stamp' failed<br>make[1]: *** [build-stamp] Error 2<br>make[1]: Leaving directory '/home/zeblok/lustre-release'<br>dpkg-buildpackage: error: debian/rules build gave error exit status 2<br>cp: cannot stat '/control.bkp': No such file or directory<br>cp: cannot stat '/control.main.bkp': No such file or directory<br>cp: cannot stat '/control.modules.in.bkp': No such file or directory<br>autoMakefile:1188: recipe for target 'debs' failed<br>make: *** [debs] Error 2<br></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sat, Jul 25, 2020 at 3:59 AM Christian Kuntz <<a href="mailto:c.kuntz@opendrives.com">c.kuntz@opendrives.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Oh hey, I think I might know what this is! <div dir="auto"><br></div><div dir="auto">In debian/rules, line 344 uses some sed fanciness to make a new rules file in a different directory. Since the send file is just a text stream into a file, it doesn't maintain the x bit of the parent. To fix, I placed this in line 345:</div><div dir="auto"><br></div><div dir="auto"><code>chmod +x debian/$(SOURCE_PKG)/usr/src/modules/lustre/debian/rules</code><br></div><div dir="auto"><code><br></code></div><div dir="auto"><code>Hope this helps!</code></div><div dir="auto"><code><br></code></div><div dir="auto"><code>Christian</code></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jul 24, 2020, 3:50 AM Ankit Ladhania <<a href="mailto:ankit@tripock.com" target="_blank">ankit@tripock.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div>Hi Aurelien,</div><div>Thanks for replying.</div><div><br></div><div>Its a clean install. It was working fine in the previous linux header v5.3.0-62-generic but suddenly has stopped working on the newer version (v5.4.0-42-generic).</div><div><br></div><div>the steps I followed:</div><div><br></div><div><u><b>Steps to Build custom kernel </b>- but same as the server it will run the client on.</u></div><div>1. uname -r (output: 5.4.0-42-generic)<br>2. git clone git://<a href="https://mailtrack.io/trace/link/b0639b0344425c397c1a970e60f397cc7aa7419f?url=http%3A%2F%2Fkernel.ubuntu.com%2Fubuntu%2Fubuntu-bionic.git&userId=3941104&signature=a3a95f59044373d7" rel="noreferrer" target="_blank">kernel.ubuntu.com/ubuntu/ubuntu-bionic.git</a> ubuntu-kernel<br>3. cd ubuntu-kernel/<br>4. git tag | grep 5.4.0-42<br>5. git checkout Ubuntu-hwe-5.4-5.4.0-42.46_18.04.1<br>6. cp /boot/config-5.4.0-42-generic .config<br>7. touch .scmversion<br></div><div>8. sudo apt-get install libncurses-dev flex bison openssl libssl-dev dkms libelf-dev libudev-dev libpci-dev libiberty-dev autoconf<br>9. sudo apt-get build-dep linux linux-image-$(uname -r)<br>10. make -j $(nproc)<br></div><div><br></div><div><u><b>Steps to Build Lustre client:</b></u></div><div>1. git clone git://<a href="https://mailtrack.io/trace/link/c0dd536de951705dac553b5a83efac4980b5817c?url=http%3A%2F%2Fgit.whamcloud.com%2Ffs%2Flustre-release.git&userId=3941104&signature=f8338ef94e11e226" rel="noreferrer" target="_blank">git.whamcloud.com/fs/lustre-release.git</a></div>2. cd lustre-release/<br>3. git checkout v2_13_53<br>4. sh autogen.sh<br>5. pwd<br>6. ./configure --disable-server --with-linux=/home/zeblok/ubuntu-kernel<br>7. make debs -j $(nproc)<div><br></div><div>its breaking in the last step, with below error.<br><div><br></div><div><pre style="white-space:pre-wrap;font-size:14px">make[1]: Leaving directory '/home/zeblok/lustre-release'
dpkg-genbuildinfo
dpkg-genchanges >../lustre_2.13.53-1_amd64.changes
dpkg-genchanges: warning: package lustre-server-utils in control file but not in files list
dpkg-genchanges: warning: package lustre-resource-agents in control file but not in files list
dpkg-genchanges: warning: package lustre-client-modules-dkms in control file but not in files list
dpkg-genchanges: info: including full source code in upload
dpkg-source -I.git -I*.out[0-9]* -I*.swp --after-build lustre-release
dpkg-buildpackage: info: full upload; Debian-native package (full source is included)
~/lustre-release/debian/tmp/modules-deb ~/lustre-release
Removing old /home/zeblok/lustre-release/debian/tmp/modules-deb/usr_src/modules/lustre/ tree
Extracting the package tarball, /usr/src/lustre.tar.bz2, please wait...
/usr/bin/fakeroot: 175: /usr/bin/fakeroot: debian/rules: Permission denied
/usr/bin/fakeroot: 175: /usr/bin/fakeroot: debian/rules: Permission denied
BUILD FAILED!
See /home/zeblok/lustre-release/debian/tmp/modules-deb/var_cache_modass/lustre.buildlog.5.4.0-42-generic.1595583181 for details.
mv: cannot stat '../lustre-dev__*.deb': No such file or directory
mv: cannot stat '../lustre-source__all.deb': No such file or directory
mv: cannot stat '../lustre-iokit__*.deb': No such file or directory
mv: cannot stat '../lustre-tests__*.deb': No such file or directory
mv: cannot stat '../lustre-*-utils__*.deb': No such file or directory
mv: cannot stat '../lustre_.dsc': No such file or directory
mv: cannot stat '../lustre__*.changes': No such file or directory
mv: cannot stat '../lustre_.tar.gz': No such file or directory
mv: cannot stat '../lustre-*-modules-5.4.0-42-generic__*.deb': No such file or directory
autoMakefile:1190: recipe for target 'debs' failed
make: *** [debs] Error 1</pre></div><div><br></div><div>I tried the step you said but got the same result.</div><div><br></div><div><br clear="all"><div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><b>Regards,<br>Ankit Ladhania</b><div><div>IN: +91 933 444 2209<br>US: +1 (256) 203-0077<div>Skype: ankit.ladhania</div></div></div></div></div></div></div></div></div></div><br></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jul 24, 2020 at 3:30 PM Degremont, Aurelien <<a href="mailto:degremoa@amazon.com" rel="noreferrer" target="_blank">degremoa@amazon.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="FR">
<div>
<p class="MsoNormal"><span lang="EN-US">If I remember correctly, it looks like you already tried building Debian package in this directory.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Try cleaning everything and restart:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">make clean<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">git clean -dfx<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">sh ./autogen.sh<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">./configure --disable-server<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">make debs<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Aurélien<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal" style="margin-left:35.4pt"><b><span style="font-size:12pt;color:black">De :
</span></b><span style="font-size:12pt;color:black">lustre-devel <<a href="mailto:lustre-devel-bounces@lists.lustre.org" rel="noreferrer" target="_blank">lustre-devel-bounces@lists.lustre.org</a>> au nom de Ankit Ladhania <<a href="mailto:ankit@tripock.com" rel="noreferrer" target="_blank">ankit@tripock.com</a>><br>
<b>Date : </b>vendredi 24 juillet 2020 ā 11:46<br>
<b>Ā : </b>"<a href="mailto:lustre-devel@lists.lustre.org" rel="noreferrer" target="_blank">lustre-devel@lists.lustre.org</a>" <<a href="mailto:lustre-devel@lists.lustre.org" rel="noreferrer" target="_blank">lustre-devel@lists.lustre.org</a>><br>
<b>Objet : </b>[EXTERNAL] [lustre-devel] /usr/bin/fakeroot: debian/rules: Permission denied - Building Lustre client (v2.13.53)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:35.4pt"><u></u> <u></u></p>
</div>
<div>
<table border="0" cellspacing="0" cellpadding="0" width="625" style="width:468.8pt;margin-left:35.4pt;border-collapse:collapse">
<tbody>
<tr style="height:15.25pt">
<td width="625" valign="top" style="width:468.8pt;border:1.5pt solid rgb(237,125,49);padding:0cm 5.4pt;height:15.25pt">
<p><strong><span style="font-family:Calibri,sans-serif;color:black;background:rgb(255,255,153)">CAUTION</span></strong><span style="color:black;background:rgb(255,255,153)">: This email originated from outside of the organization. Do not click links or open attachments unless
you can confirm the sender and know the content is safe.</span><u></u><u></u></p>
</td>
</tr>
</tbody>
</table>
</div>
<p class="MsoNormal" style="margin-left:35.4pt"><u></u> <u></u></p>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-left:35.4pt"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:35.4pt">Hi,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:35.4pt">We are installing the Lustre Client (v2.13.53) on Ubuntu 18.04 (linux header: 5.4.0-42-generic)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:35.4pt">While doing `make debs` we are getting below error:<u></u><u></u></p>
</div>
<div>
<div>
<div>
<div>
<div>
<pre style="margin-left:35.4pt">make[1]: Leaving directory '/home/zeblok/lustre-release'<u></u><u></u></pre>
<pre style="margin-left:35.4pt"> dpkg-genbuildinfo<u></u><u></u></pre>
<pre style="margin-left:35.4pt"> dpkg-genchanges >../lustre_2.13.53-1_amd64.changes<u></u><u></u></pre>
<pre style="margin-left:35.4pt">dpkg-genchanges: warning: package lustre-server-utils in control file but not in files list<u></u><u></u></pre>
<pre style="margin-left:35.4pt">dpkg-genchanges: warning: package lustre-resource-agents in control file but not in files list<u></u><u></u></pre>
<pre style="margin-left:35.4pt">dpkg-genchanges: warning: package lustre-client-modules-dkms in control file but not in files list<u></u><u></u></pre>
<pre style="margin-left:35.4pt">dpkg-genchanges: info: including full source code in upload<u></u><u></u></pre>
<pre style="margin-left:35.4pt"> dpkg-source -I.git -I*.out[0-9]* -I*.swp --after-build lustre-release<u></u><u></u></pre>
<pre style="margin-left:35.4pt">dpkg-buildpackage: info: full upload; Debian-native package (full source is included)<u></u><u></u></pre>
<pre style="margin-left:35.4pt">~/lustre-release/debian/tmp/modules-deb ~/lustre-release<u></u><u></u></pre>
<pre style="margin-left:35.4pt">Removing old /home/zeblok/lustre-release/debian/tmp/modules-deb/usr_src/modules/lustre/ tree<u></u><u></u></pre>
<pre style="margin-left:35.4pt">Extracting the package tarball, /usr/src/lustre.tar.bz2, please wait...<u></u><u></u></pre>
<pre style="margin-left:35.4pt">/usr/bin/fakeroot: 175: /usr/bin/fakeroot: debian/rules: Permission denied<u></u><u></u></pre>
<pre style="margin-left:35.4pt">/usr/bin/fakeroot: 175: /usr/bin/fakeroot: debian/rules: Permission denied<u></u><u></u></pre>
<pre style="margin-left:35.4pt">BUILD FAILED!<u></u><u></u></pre>
<pre style="margin-left:35.4pt">See /home/zeblok/lustre-release/debian/tmp/modules-deb/var_cache_modass/lustre.buildlog.5.4.0-42-generic.1595583181 for details.<u></u><u></u></pre>
<pre style="margin-left:35.4pt">mv: cannot stat '../lustre-dev__*.deb': No such file or directory<u></u><u></u></pre>
<pre style="margin-left:35.4pt">mv: cannot stat '../lustre-source__all.deb': No such file or directory<u></u><u></u></pre>
<pre style="margin-left:35.4pt">mv: cannot stat '../lustre-iokit__*.deb': No such file or directory<u></u><u></u></pre>
<pre style="margin-left:35.4pt">mv: cannot stat '../lustre-tests__*.deb': No such file or directory<u></u><u></u></pre>
<pre style="margin-left:35.4pt">mv: cannot stat '../lustre-*-utils__*.deb': No such file or directory<u></u><u></u></pre>
<pre style="margin-left:35.4pt">mv: cannot stat '../lustre_.dsc': No such file or directory<u></u><u></u></pre>
<pre style="margin-left:35.4pt">mv: cannot stat '../lustre__*.changes': No such file or directory<u></u><u></u></pre>
<pre style="margin-left:35.4pt">mv: cannot stat '../lustre_.tar.gz': No such file or directory<u></u><u></u></pre>
<pre style="margin-left:35.4pt">mv: cannot stat '../lustre-*-modules-5.4.0-42-generic__*.deb': No such file or directory<u></u><u></u></pre>
<pre style="margin-left:35.4pt">autoMakefile:1190: recipe for target 'debs' failed<u></u><u></u></pre>
<pre style="margin-left:35.4pt">make: *** [debs] Error 1<u></u><u></u></pre>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-left:35.4pt"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:35.4pt">Also tried doing 'chmod a+x debian/rules' but with no progress.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:35.4pt"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:35.4pt">Not able to understand why this is breaking, any help is highly appreciated.<u></u><u></u></p>
</div>
<p class="MsoNormal" style="margin-left:35.4pt"><br clear="all">
<u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-left:35.4pt"><b>Regards,<br>
Ankit Ladhania</b> <u></u><u></u></p>
<div>
<div>
<p class="MsoNormal" style="margin-left:35.4pt">IN: +91 933 444 2209<br>
US: +1 (256) 203-0077 <u></u><u></u></p>
<div>
<p class="MsoNormal" style="margin-left:35.4pt">Skype: ankit.ladhania<u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-left:35.4pt"><span style="border:1pt solid windowtext;padding:0cm"><img width="32" height="32" style="width: 0.3333in; height: 0.3333in;" id="gmail-m_5835172803695782506m_-2503304510534789954gmail-m_-6044256647422719195_x0000_i1025" alt="Image supprimée par l'expéditeur."></span><u></u><u></u></p>
</div>
</div>
</div>
</div>
</blockquote></div><img width="0" height="0" alt="" style="display: flex;" src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7"></div>
_______________________________________________<br>
lustre-devel mailing list<br>
<a href="mailto:lustre-devel@lists.lustre.org" rel="noreferrer" target="_blank">lustre-devel@lists.lustre.org</a><br>
<a href="https://mailtrack.io/trace/link/0695b57bf4ddfa198d750b131a33a3c670ece42c?url=http%3A%2F%2Flists.lustre.org%2Flistinfo.cgi%2Flustre-devel-lustre.org&userId=3941104&signature=cee65cec6208e621" rel="noreferrer noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org</a><br>
</blockquote></div>
<br>
<a href="https://mailtrack.io/trace/link/15758f8916c88d705160a929b0b36b2c89701fbb?url=http%3A%2F%2Fopendrives.com&userId=3941104&signature=eabf41d08699a800" target="_blank"><img src="http://signature.opendrives.com/Ultra_Launch_Email_Footer_600v2.png"></a></blockquote></div><img width="0" height="0" class="mailtrack-img" alt="" style="display:flex" src="https://mailtrack.io/trace/mail/6039235db1089a45a710afe8e4eaba2f0d5266c3.png?u=3941104"></div>