<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
>And lsvcgssd.services are not running.</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
It is mandatory this service is running properly for all the other steps to work.</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Look at the detailed logs to see why this service is not running. Try running it in verbose mode if needed.</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Did you create and deploy the proper keytabs? Verify the 'klist -k' output is correct on each Lustre servers and lustre client.</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Then:</div>
<ul style="margin-top: 0px; margin-bottom: 0px;" data-editing-info="{"orderedStyleType":1,"unorderedStyleType":2}">
<li style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); list-style-type: "- ";">
<div class="elementToProof">Start your lustre servers</div>
</li><li style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); list-style-type: "- ";">
<div class="elementToProof">Configure the lustre target gss flavor (some lctl commands)</div>
</li><li style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); list-style-type: "- ";">
<div class="elementToProof">Then mount the client.</div>
</li></ul>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
See <a href="https://doc.lustre.org/lustre_manual.xhtml#managingSecurity.kerberos" id="LPlnk665277">
https://doc.lustre.org/lustre_manual.xhtml#managingSecurity.kerberos</a></div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Aurélien</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="appendonsend"></div>
<hr style="display: inline-block; width: 98%;">
<div id="divRplyFwdMsg" dir="ltr"><span style="font-family: Calibri, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);"><b>De :</b> Sushrut Bhokre <sushrut.bs@zohocorp.com><br>
<b>Envoyé :</b> mardi 6 août 2024 13:33<br>
<b>À :</b> Aurelien Degremont <adegremont@nvidia.com><br>
<b>Cc :</b> lustre-discuss <lustre-discuss@lists.lustre.org>; Neeraj Gawali <neeraj.gawali@zohocorp.com><br>
<b>Objet :</b> RE: [lustre-discuss] Error while Mounting Lustre client with Kerberos</span>
<div> </div>
</div>
<table style="background-color: rgb(255, 235, 156);">
<tbody>
<tr>
<td><span style="font-family: verdana; font-size: 10px; color: black;"><b>External email: Use caution opening links or attachments</b></span></td>
</tr>
</tbody>
</table>
<br>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
Hi,</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
We are using Lustre 2.15.5 version.</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
Our setup is like we want to to use Kerberos With Lustre so we build Lustre from git clone git://<a href="http://git.whamcloud.com/fs/lustre-release.git" id="OWA7b11aa24-5f23-b64c-f29f-1a6fd3e8b3df" class="OWAAutoLink" shash="aVM7lgntFlckovYz2A1BSuyD8Spc27u3/kdxESdW8NnbnPuCmUtC1QMRmDAGM93zYkHs90bJRhUahd64M4PTrR8lCBrKv8LbaztS3SI91b5hiZfk2bPdxuqYB8R4akc3EVXpc4NX7UuBmXyLHUxRnZV2+zUDFi8cgiecfn5wFlA=" originalsrc="http://git.whamcloud.com/fs/lustre-release.git" data-auth="Verified">git.whamcloud.com/fs/lustre-release.git</a> using
the following ./configure steup with some flagsbelow is the command.</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<b>./configure --with-zfs --with-o2ib=no --disable-ldiskfs --enable-gss</b></div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
and Lustre Clint is configured with the following ./configure step below</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<b>./configure --enable-gss --disable-server --enable-client --with-linux=/usr/src/kernels/$(uname -r)</b></div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
This command because we want Lustre with ZFS and with Kerberos. Can you Please tell are we correct up till now?</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<u>KDC Server:</u></div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
We have tried to set kdc on a dedicated node and it is functional.</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<img alt="Capture2.JPG" style="width: 976px; height: 471px;" width="976" height="471" data-outlook-trace="F:1|T:1" src="cid:0.28869241780.781903815863743390.1912777632a__inline__img__src"></div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<u>Lustre Storage Server:</u></div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
Replicated same <b>krb5.conf</b> file from KDC server. but when we are trying to start </div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
configure it with lustre client but there is a issue in mounting of lustre with kerberos (attached below).<br>
And lsvcgssd.services are not running.<br>
<img alt="Capture1.JPG" style="width: 769px; height: 190px;" width="769" height="190" data-outlook-trace="F:1|T:1" src="cid:1.28869241780.8630509482296441667.1912777632a__inline__img__src"></div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
Same goes for client too and we are also not able to mount with kerberos. (Can you also tell is our mount step is correct or not)</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<b>mount -t lustre -o mgsnode=192.168.10.25@tcp,flock,krb5i lustre:/mnt/lustre /mnt/lustre</b></div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
Regards,</div>
<div data-sigid="6883818000001780001" data-zbluepencil-ignore="true" id="x_Zm-_Id_-Sgn">
<div>Sushrut Bhokre</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div style="line-height: 0px; margin-top: 10px; margin-bottom: 10px; border-top: 1px solid rgb(204, 204, 204); font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div id="x_Zm-_Id_-Sgn1">---- On Tue, 06 Aug 2024 13:08:51 +0530 <b>Aurelien Degremont <adegremont@nvidia.com></b> wrote ---<br>
</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hi</div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
In order to help you, it would be great if you give way more detail of your current setup. What is your configuration, component versions, what is your Lustre error message, etc...</div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
How does your ticket look like?</div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Additionally, there were lots of improvements in Lustre Kerberos support during 2.16 cycle and I would recommend targeting that version (not released yet) for a production deployment. However, testing should still be doable with 2.15. </div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Aurélien</div>
<div id="x_x_1834700549appendonsend"><br>
</div>
<hr style="direction: ltr; margin-right: 0px; margin-left: 0px; display: inline-block; width: 98%;">
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div dir="ltr" id="x_x_1834700549divRplyFwdMsg">
<div style="font-family: Calibri, sans-serif; color: rgb(0, 0, 0);"><b>De :</b> lustre-discuss <<a href="mailto:lustre-discuss-bounces@lists.lustre.org" id="OWA99691180-5e6b-5aac-1542-cc75edd506ff" class="OWAAutoLink">lustre-discuss-bounces@lists.lustre.org</a>>
de la part de Neeraj Gawali via lustre-discuss <<a href="mailto:lustre-discuss@lists.lustre.org" id="OWA6706de8b-4c41-49b2-a7ca-bf2eea407211" class="OWAAutoLink">lustre-discuss@lists.lustre.org</a>><br>
<b>Envoyé :</b> mardi 6 août 2024 07:26<br>
<b>À :</b> lustre-discuss <<a href="mailto:lustre-discuss@lists.lustre.org" id="OWA59f997b6-2775-3f61-e44d-c98d0cd33c90" class="OWAAutoLink">lustre-discuss@lists.lustre.org</a>><br>
<b>Cc :</b> Sushrut Bhokre <<a href="mailto:sushrut.bs@zohocorp.com" id="OWAcf4cdccd-02e4-174e-1d2c-36a5506e4bb4" class="OWAAutoLink">sushrut.bs@zohocorp.com</a>><br>
<b>Objet :</b> [lustre-discuss] Error while Mounting Lustre client with Kerberos</div>
<div> </div>
</div>
<table style="direction: ltr; background-color: rgb(255, 235, 156);">
<tbody>
<tr>
<td style="direction: ltr;">
<div style="direction: ltr;"><span style="font-family: verdana; font-size: 10px;"><b>External email: Use caution opening links or attachments</b></span><span style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;"><br>
</span></div>
</td>
</tr>
</tbody>
</table>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 13.3333px; color: rgb(0, 0, 0);">
<span style="background-color: rgb(255, 255, 255);">Hii,</span></div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 16px; color: rgb(0, 0, 0);">
<span style="background-color: rgb(255, 255, 255);">Tried configuring kerberos over lustre(built by gss enabled through gitclone repository) but at last while mounting lustre with kerberos there is a issue of keytab file not found.Can anyone please look into
it for the support if the issue is present.<br>
<br>
Kereberos configuration(<a href="https://wiki.opensfs.org/images/8/8c/Kerberos_setup_guide.pdf" id="OWA81e78f50-5cc8-a6cf-98fc-9ba6e11de171" class="OWAAutoLink" shash="vRvzeTRK9I2zbmDjtcROUVYkTlo61/+k7VNf65ZGP1b1loXOQCzyNxXOeqi4VJN7K6+v1yIyySa6eSTqG3hUiAstfL0Zg6MgxHgnDVS8OH1Zxr2dvxqzX9Iq0AQ+i3Z3ud49F2p56Nh+5zgR9Qh+iV1mbIN6XXJFtd7px99hmDA=" originalsrc="https://wiki.opensfs.org/images/8/8c/Kerberos_setup_guide.pdf" data-auth="Verified">https://wiki.opensfs.org/images/8/8c/Kerberos_setup_guide.pdf</a>)</span></div>
<div style="direction: ltr; margin-right: 0px; margin-left: 0px; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<div id="x_Zm-_Id_-Sgn" data-zbluepencil-ignore="true" data-sigid="6883818000001780001">
<div><br>
</div>
</div>
<div style="font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 10pt;">
<br>
</div>
<br>
</body>
</html>