<div dir="ltr">Just a thought, instead of embedding the jobname itself, perhaps just a least significant 7 character sha-1 hash of the jobname. Small chance of collision, easy to decode/cross reference to jobid when needed. Just a thought.<div><br></div><div>--Jeff</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, May 12, 2023 at 3:08 PM Andreas Dilger via lustre-discuss <<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div style="overflow-wrap: break-word;">
Hi Thomas,
<div>thanks for working on this functionality and raising this question.</div>
<div><br>
</div>
<div>As you know, I'm inclined toward the <tt>user.job</tt> xattr, but I think it is never a good idea to unilaterally make policy decisions in the kernel that cannot be changed.</div>
<div>
<p>As such, it probably makes sense to have a tunable parameter like "<tt>mdt.*.job_xattr=user.job</tt>" and then this could be changed in the future if there is some conflict (e.g. some site already uses the "<tt>user.job</tt>" xattr
for some other purpose).</p>
<p>I don't think the <tt>job_xattr</tt> should allow totally arbitrary values (e.g. overwriting
<tt>trusted.lov</tt> or <tt>trusted.lma</tt> or <tt>security.*</tt> would be bad). One option is to only allow a limited selection of valid xattr namespaces, and possibly names:</p>
<ul type="square">
<li><tt>NONE</tt> to turn this feature off</li><li><tt>user</tt>, or <tt>trusted</tt> or <tt>
system</tt> (if admin wants to restrict the ability of regular users to change this value?), with "<tt>.job</tt>" added automatically</li><li><tt>user.*</tt> (or <tt>trusted.*</tt> or <tt>
system.*</tt>) to also allow specifying the xattr name</li></ul>
<p>If we allow the xattr name portion to be specified (which I'm not sure about, but putting it out for completeness), it should have some reasonable limits:</p>
<ul type="square">
<li><= 7 characters long to avoid wasting valuable xattr space in the inode</li><li>should not conflict with other known xattrs, which is tricky if we allow the name to be arbitrary. Possibly if in
<tt>trusted</tt> (and <tt>system</tt>?) it should only allow <tt>
trusted.job</tt> to avoid future conflicts?</li><li>maybe restrict it to contain "<tt>job</tt>" (or maybe "<tt>pbs</tt>", "<tt>slurm</tt>", ...) to reduce the chance of namespace clashes in
<tt>user</tt> or <tt>system</tt>? However, I'm reluctant to restrict names in
<tt>user</tt> since this <em>shouldn't</em> have any fatal side effects (e.g. data corruption like in
<tt>trusted</tt> or <tt>system</tt>), and the admin is supposed to know what they are doing...</li></ul>
<div><br>
<blockquote type="cite">
<div>On May 4, 2023, at 15:53, Bertschinger, Thomas Andrew Hjorth via lustre-discuss <<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a>> wrote:</div>
<br>
<div>
<div>Hello Lustre Users,<br>
<br>
There has been interest in a proposed feature <a href="https://jira.whamcloud.com/browse/LU-13031" target="_blank">
https://jira.whamcloud.com/browse/LU-13031</a> to store the jobid with each Lustre file at create time, in an extended attribute. An open question is which xattr namespace is to use between "user", the Lustre-specific namespace "lustre", "trusted", or even
perhaps "system".<br>
<br>
The correct namespace likely depends on how this xattr will be used. For example, will interoperability with other filesystems be important? Different namespaces have their own limitations so the correct choice depends on the use cases.<br>
<br>
I'm looking for feedback on applications for this feature. If you have thoughts on how you could use this, please feel free to share them so that we design it in a way that meets your needs.<br>
<br>
Thanks!<br>
<br>
Tom Bertschinger<br>
LANL<br>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</div>
</div>
</blockquote>
</div>
<br>
<div>
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div>Cheers, Andreas</div>
<div>--</div>
<div>Andreas Dilger</div>
<div>Lustre Principal Architect</div>
<div>Whamcloud</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
</div>
<br>
<br>
</div>
<br>
</div>
</div>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</blockquote></div><br clear="all"><div><br></div><span class="gmail_signature_prefix">-- </span><br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr">------------------------------<br>Jeff Johnson<br>Co-Founder<br>Aeon Computing<br><br><a href="mailto:jeff.johnson@aeoncomputing.com" target="_blank">jeff.johnson@aeoncomputing.com</a><br><a href="http://www.aeoncomputing.com" target="_blank">www.aeoncomputing.com</a><br>t: 858-412-3810 x1001 f: 858-412-3845<br>m: 619-204-9061<br><br>4170 Morena Boulevard, Suite C - San Diego, CA 92117<div><br></div><div>High-Performance Computing / Lustre Filesystems / Scale-out Storage</div></div></div></div></div>