<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>Dear Chad, <br>
    </p>
    <p>thanks a lot! That is apparently the solution. The files did have
      the immutable attribute set:</p>
    <p>lsattr file<br>
      ----i----------- file</p>
    <p>removing it with:</p>
    <p>chattr -i file</p>
    <p>fixed the problem. <br>
    </p>
    <p>I have no idea how this attribute was set, but at least now I
      know how to remove it. <br>
    </p>
    <p>Thank you!<br>
      Robert<br>
    </p>
    <div class="moz-cite-prefix">On 15.12.20 14:16, Chad DeWitt wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:CAAyf6vD+X8=3OJCWfd0_5G7h=Fc3r2Uy3LxPuqBkTaTzCz1iFA@mail.gmail.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div dir="ltr">
        <div dir="ltr">
          <div dir="ltr">
            <div dir="ltr">
              <div dir="ltr">
                <div dir="ltr">
                  <div dir="ltr">Hi Robert,
                    <div><br>
                    </div>
                    <div>Just rolling dice, but is it possible that the
                      append only attribute is set on the files in
                      question?</div>
                    <div><br>
                    </div>
                    <div>For instance, I have the attribute set on a
                      file named <i>testing</i> (the append attribute
                      is shown by the 'a' flag):</div>
                    <div><br>
                    </div>
                  </div>
                </div>
                <blockquote style="margin:0px 0px 0px
                  40px;border:none;padding:0px">
                  <div><font face="monospace"># lsattr testing</font></div>
                  <div><font face="monospace">-----a---------- testing</font></div>
                  <div><br>
                  </div>
                </blockquote>
                When I try to remove <i>testing</i> with the append
                flag set:</div>
              <div dir="ltr"><br>
              </div>
            </div>
          </div>
        </div>
        <blockquote style="margin:0 0 0 40px;border:none;padding:0px">
          <div>
            <div>
              <div>
                <div>
                  <div><font face="monospace"># rm testing</font></div>
                </div>
              </div>
            </div>
          </div>
          <div>
            <div>
              <div>
                <div>
                  <div><font face="monospace">rm: remove regular empty
                      file ‘testing’? y</font></div>
                </div>
              </div>
            </div>
          </div>
          <div>
            <div>
              <div>
                <div>
                  <div><font face="monospace">rm: cannot remove
                      ‘testing’: Operation not permitted</font></div>
                </div>
              </div>
            </div>
          </div>
        </blockquote>
        <div dir="ltr">
          <div dir="ltr">
            <div dir="ltr">
              <div dir="ltr">
                <div dir="ltr"><br>
                </div>
                <div>If that flag is set on your problematic files, the
                  unsetting the flag will allow you to delete them:</div>
                <div><br>
                </div>
              </div>
            </div>
            <blockquote style="margin:0px 0px 0px
              40px;border:none;padding:0px">
              <div dir="ltr">
                <div dir="ltr">
                  <div><font face="monospace"># chattr -a testing<br>
                    </font></div>
                  <div>
                    <div><font face="monospace"># rm testing</font></div>
                    <div><font face="monospace">rm: remove regular empty
                        file ‘testing’? y</font></div>
                  </div>
                </div>
              </div>
            </blockquote>
            <div dir="ltr">
              <div dir="ltr">
                <div dir="ltr">
                  <div dir="ltr">
                    <div><br>
                    </div>
                    <div>BTW - You have to use <font face="monospace">lsattr</font>
                      to see the append flag; a normal <font
                        face="monospace">ls</font> will not show it...</div>
                    <div><br>
                    </div>
                    <div>Chad</div>
                    <div><br>
                    </div>
                    <div>
                      <div>
                        <div dir="ltr" class="gmail_signature">
                          <div dir="ltr">
                            <div dir="ltr">
                              <div dir="ltr">
                                <div dir="ltr">
                                  <div dir="ltr">
                                    <p style="margin:0in 0in 0.0001pt"><span
style="background-color:rgba(255,255,255,0)"><font size="2"
                                          face="monospace, monospace">------------------------------------------------------------</font></span></p>
                                    <p style="margin:0in 0in 0.0001pt"><span
style="background-color:rgba(255,255,255,0)"><font size="2"
                                          face="monospace, monospace">Chad
                                          DeWitt, CISSP | University
                                          Research Computing</font></span></p>
                                    <p style="margin:0in 0in 0.0001pt"><span
style="background-color:rgba(255,255,255,0)"><font size="2"
                                          face="monospace, monospace">UNC
                                          Charlotte <b>| </b>Office
                                          of OneIT</font></span></p>
                                    <p style="margin:0in 0in 0.0001pt"><font
                                        size="2" face="monospace,
                                        monospace" color="#000000"><span
style="background-color:rgba(255,255,255,0)"><a
                                            href="mailto:ccdewitt@uncc.edu"
                                            target="_blank"
                                            moz-do-not-send="true">ccdewitt@uncc.edu</a> <b>| </b></span></font><font
                                        face="monospace, monospace"
                                        color="#000000"><span><a
                                            href="https://oneit.uncc.edu"
                                            target="_blank"
                                            moz-do-not-send="true">https://oneit.uncc.edu</a></span></font></p>
                                    <p style="margin:0in 0in 0.0001pt"><span
style="background-color:rgba(255,255,255,0)"><font size="2"
                                          face="monospace, monospace">------------------------------------------------------------</font></span></p>
                                  </div>
                                </div>
                              </div>
                            </div>
                          </div>
                        </div>
                      </div>
                      <br>
                    </div>
                  </div>
                </div>
              </div>
            </div>
          </div>
        </div>
      </div>
      <br>
      <div class="gmail_quote">
        <div dir="ltr" class="gmail_attr">On Tue, Dec 15, 2020 at 8:02
          AM Robert Redl <<a href="mailto:robert.redl@lmu.de"
            moz-do-not-send="true">robert.redl@lmu.de</a>> wrote:<br>
        </div>
        <blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
          <div>
            <p>Dear Lustre Users,</p>
            <p>we have some files in the system, that are not writable
              anymore. Symptoms: <br>
            </p>
            <p>- normal rm fails: rm: cannot remove 'file': Operation
              not permitted.<br>
              - lfs rmfid fails without error message. The file is just
              not deleted.<br>
              - lfs migrate fails: file: no write permission, skipped<br>
              - all commands are executes as root on a node which is
              listed in nosquash_nids.<br>
              - other files with the same permissions located in the
              same folder are writable.<br>
              - the affected file are readable. Creating a copy is
              possible, but deleting the original file not.<br>
              - the problem remains after running lfsck.<br>
            </p>
            <p>We use Lustre 2.12.5 on Centos 7 with ZFS backend. <br>
            </p>
            <p>Has anyone had such issues before? Any ideas how to
              delete these files?</p>
            <p>Thank you!<br>
              Robert<br>
            </p>
            <div>-- <br>
              <p style="color:rgb(128,128,128);font-size:smaller"> Dr.
                Robert Redl<br>
                Scientific Programmer, "Waves to Weather" (SFB/TRR165)<br>
                Meteorologisches Institut<br>
                Ludwig-Maximilians-Universität München<br>
                Theresienstr. 37, 80333 München, Germany<br>
                <br>
              </p>
            </div>
          </div>
          [Caution: Email from External Sender. Do not click or open
          links or attachments unless you know this sender.]<br>
          <br>
          <br>
          _______________________________________________<br>
          lustre-discuss mailing list<br>
          <a href="mailto:lustre-discuss@lists.lustre.org"
            target="_blank" moz-do-not-send="true">lustre-discuss@lists.lustre.org</a><br>
          <a
            href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org"
            rel="noreferrer" target="_blank" moz-do-not-send="true">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
        </blockquote>
      </div>
    </blockquote>
    <div class="moz-signature"><br>
    </div>
  </body>
</html>