<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
The JobID is provided by the clients, the servers don't really care how it was generated.
<div class="">
<div><br class="">
<blockquote type="cite" class="">
<div class="">On Dec 14, 2021, at 03:24, Iannetti, Gabriele <<a href="mailto:G.Iannetti@gsi.de" class="">G.Iannetti@gsi.de</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div class="">Hi again,<br class="">
<br class="">
is it possible to use the introduced per-session JobID feature in Lustre 2.13 when
<br class="">
running the server with 2.12 and the clients with 2.13?<br class="">
<br class="">
Best, Gabriele<br class="">
<br class="">
________________________________________<br class="">
From: lustre-discuss <<a href="mailto:lustre-discuss-bounces@lists.lustre.org" class="">lustre-discuss-bounces@lists.lustre.org</a>> on behalf of Iannetti, Gabriele <<a href="mailto:G.Iannetti@gsi.de" class="">G.Iannetti@gsi.de</a>><br class="">
Sent: Tuesday, December 14, 2021 11:14<br class="">
To: Andreas Dilger<br class="">
Cc: <a href="mailto:lustre-discuss@lists.lustre.org" class="">lustre-discuss@lists.lustre.org</a><br class="">
Subject: Re: [lustre-discuss] Jobstats Support with Singularity Container<br class="">
<br class="">
Hi Andreas,<br class="">
<br class="">
we are currently running Lustre 2.12.5.<br class="">
<br class="">
So we could use the introduced feature of the complex JobID.<br class="">
As I understand the manual, we could generate a site- or node-specific JobID string.<br class="">
<br class="">
We need to investigate that possibility more in detail, but I assume here, that we set the complex JobID not on session basis per user,<br class="">
so the problem would remain, that all user started IO within a container would be done as root under the loop process structure.<br class="">
<br class="">
<blockquote type="cite" class="">For containers, you could set it for the process group when it starts and it should be inherited by all processes in the container?<br class="">
</blockquote>
<br class="">
Agreed, the introduced feature in Lustre 2.13 with the per-session JobID should help here.<br class="">
<br class="">
Thanks.<br class="">
<br class="">
Best, Gabriele<br class="">
<br class="">
________________________________________<br class="">
From: Andreas Dilger <<a href="mailto:adilger@whamcloud.com" class="">adilger@whamcloud.com</a>><br class="">
Sent: Saturday, December 11, 2021 09:37<br class="">
To: Iannetti, Gabriele<br class="">
Cc: <a href="mailto:lustre-discuss@lists.lustre.org" class="">lustre-discuss@lists.lustre.org</a><br class="">
Subject: Re: [lustre-discuss] Jobstats Support with Singularity Container<br class="">
<br class="">
See the Lustre Operations Manual for options setting the JobID. You can set it using fields like "%u" for UID, or you can set it per process group, or for the whole node. For containers, you could set it for the process group when it starts and it should be
inherited by all processes in the container?<br class="">
<br class="">
Cheers, Andreas<br class="">
<br class="">
<blockquote type="cite" class="">On Dec 10, 2021, at 08:00, Iannetti, Gabriele <<a href="mailto:G.Iannetti@gsi.de" class="">G.Iannetti@gsi.de</a>> wrote:<br class="">
<br class="">
Dear Lustre community,<br class="">
<br class="">
on our submit nodes users log in transparently into Singularity containers.<br class="">
Jobs submitted from those sessions are automatically transparently launched inside a container as well through the slurmd agent.<br class="">
Lustre is also mounted within the container.<br class="">
<br class="">
Since the setting `jobid_var=procname_uid` is set on the submit nodes, it is providing us a mangled output for the jobid field:<br class="">
<br class="">
jobid="loop7"<br class="">
jobid="loop7..0"<br class="">
jobid="loop7.0"<br class="">
jobid="loop7.00"<br class="">
jobid="loop7000"<br class="">
<br class="">
Loop devices are used in Singularity to facilitate the mounting of container filesystems from SIF images.<br class="">
<br class="">
Is there anything we can configure in Singularity or Lustre to pass the UID of the user that has started a container<br class="">
or is the container runtime with Singularity not supported for the Jobstats?<br class="">
<br class="">
Best<br class="">
Gabriele<br class="">
<br class="">
_______________________________________________<br class="">
lustre-discuss mailing list<br class="">
<a href="mailto:lustre-discuss@lists.lustre.org" class="">lustre-discuss@lists.lustre.org</a><br class="">
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org<br class="">
</blockquote>
_______________________________________________<br class="">
lustre-discuss mailing list<br class="">
<a href="mailto:lustre-discuss@lists.lustre.org" class="">lustre-discuss@lists.lustre.org</a><br class="">
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org<br class="">
</div>
</div>
</blockquote>
</div>
<br class="">
<div class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div>Cheers, Andreas</div>
<div>--</div>
<div>Andreas Dilger</div>
<div>Lustre Principal Architect</div>
<div>Whamcloud</div>
<div><br class="">
</div>
<div><br class="">
</div>
<div><br class="">
</div>
</div>
</div>
</div>
</div>
</div>
<br class="Apple-interchange-newline">
</div>
<br class="Apple-interchange-newline">
<br class="Apple-interchange-newline">
</div>
<br class="">
</div>
</body>
</html>