<div dir="ltr">After the archive, does the state change to exists, archived ? If you modify the file while in the exists state, does it mark it as dirty or does it remain the same?</div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jun 23, 2016 at 10:13 AM, Michael Skiba <span dir="ltr"><<a href="mailto:michael.skiba@oracle.com" target="_blank">michael.skiba@oracle.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Colin here is the output from the POSIX copytool daemon. It looks like it was successful shown below. The file is out on the HSM SAMQFS file system.<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">1466633273.355200 lhsmtool_posix[16036]: archiving 'mnt/.lustre/fid/0x200000400:0x7:0x0' to 'samqfs1/0007/0000/0400/0000/0002/0000/0x200000400:0x7:0x0_tmp'<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">1466633273.366577 lhsmtool_posix[16036]: saving stripe info of 'mnt/.lustre/fid/0x200000400:0x7:0x0' in samqfs1/0007/0000/0400/0000/0002/0000/0x200000400:0x7:0x0_tmp.lov<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">1466633273.368356 lhsmtool_posix[16036]: start copy of 10240000000 bytes from 'mnt/.lustre/fid/0x200000400:0x7:0x0' to 'samqfs1/0007/0000/0400/0000/0002/0000/0x200000400:0x7:0x0_tmp'<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">1466633303.002966 lhsmtool_posix[16036]: %18<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">1466633333.011802 lhsmtool_posix[16036]: %39<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">1466633363.011127 lhsmtool_posix[16036]: %67<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">1466633393.001740 lhsmtool_posix[16036]: %90<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">1466633406.858331 lhsmtool_posix[16036]: copied 10240000000 bytes in 133.490582 seconds<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">1466633409.914213 lhsmtool_posix[16036]: data archiving for 'mnt/.lustre/fid/0x200000400:0x7:0x0' to 'samqfs1/0007/0000/0400/0000/0002/0000/0x200000400:0x7:0x0_tmp' done<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Here is the hsm release output.<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">1466633409.914854 lhsmtool_posix[16036]: cannot set attributes of 'mnt/.lustre/fid/0x200000400:0x7:0x0': Operation not permitted (1)<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Is there a step I am missing <u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">You can see that it did archive the data over to the HSM server by df –h you see 9.6G on /mnt and /samqfs1.<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">[root@isr-x4150-01 mnt]# df -h<u></u><u></u></span></p><span class=""><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Filesystem            Size  Used Avail Use% Mounted on<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">/dev/sda2             134G  7.0G  121G   6% /<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">tmpfs                 3.9G     0  3.9G   0% /dev/shm<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">/dev/sda1             477M  105M  348M  24% /boot<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">10.80.191.134@tcp0:/lustre<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">                      136G  9.6G  120G   8% /mnt<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">10.80.191.161:/samqfs1<u></u><u></u></span></p></span><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">                      558G  9.6G  549G   2% /samqfs1<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Hsm server <u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Filesystem             Size   Used  Available Capacity  Mounted on<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">rpool/ROOT/solaris-2   547G   5.6G       531G     2%    /<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">/devices                 0K     0K         0K     0%    /devices<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">/dev                     0K     0K         0K     0%    /dev<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">ctfs                     0K     0K         0K     0%    /system/contract<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">proc                     0K     0K         0K     0%    /proc<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">mnttab                   0K     0K         0K     0%    /etc/mnttab<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">swap                    10G   1.8M        10G     1%    /system/volatile<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">objfs                    0K     0K         0K     0%    /system/object<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">sharefs                  0K     0K         0K     0%    /etc/dfs/sharetab<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">/usr/lib/libc/libc_hwcap1.so.1<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">                       537G   5.6G       531G     2%    /lib/libc.so.1<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">fd                       0K     0K         0K     0%    /dev/fd<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">rpool/ROOT/solaris-2/var<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">                       547G   422M       531G     1%    /var<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">swap                    10G    12K        10G     1%    /tmp<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">rpool/VARSHARE         547G   2.6M       531G     1%    /var/share<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:red">samqfs1                558G   9.6G       548G     2%    /samqfs1<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">rpool/export           547G    32K       531G     1%    /export<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">rpool/export/home      547G    32K       531G     1%    /export/home<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">rpool/export/home/jack<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">                       547G    32K       531G     1%    /export/home/jack<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">rpool                  547G   4.5M       531G     1%    /rpool<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">rpool/VARSHARE/zones   547G    31K       531G     1%    /system/zones<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">rpool/VARSHARE/pkg     547G    32K       531G     1%    /var/share/pkg<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">rpool/VARSHARE/pkg/repositories<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">                       547G    31K       531G     1%    /var/share/pkg/repositories<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Thanks for your help………….<u></u><u></u></span></p><span class=""><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.oracle.com_&d=CwMFaQ&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=kcNjUK8DTn7_E5X3DctNYJpJ50JAjLYx11vy1qHclHU&s=LtEDPn9dmCZdGnpebZnAXZFvzsex1SXXNSk_59GwDVM&e=" target="_blank"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black;text-decoration:none"><img border="0" width="114" height="26" src="cid:image001.gif@01D1CD35.3DE7D7A0" alt="Oracle"></span></a><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><br></span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#666666">Michael J. Skiba | Principal Support Engineer<br>Phone: <a href="tel:+1%203032729724" target="_blank"><span style="color:black">+1 3032729724</span></a> | Mobile: <a href="tel:+1%203036198495" target="_blank"><span style="color:black">+1 3036198495</span></a> <br></span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:red">Oracle</span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#666666"> ISV<br>500 Elorado Blv. Bldg. 5<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#666666">Broomfield, Colorado 80021</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u><u></u></span></p><table border="0" cellspacing="3" cellpadding="0"><tbody><tr><td style="padding:.75pt .75pt .75pt .75pt"><p class="MsoNormal"><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.oracle.com_commitment&d=CwMFaQ&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=kcNjUK8DTn7_E5X3DctNYJpJ50JAjLYx11vy1qHclHU&s=Czg4XODZN2DaUmF1zgpBSFKqlqOllkn6IpAkHPXsRv4&e=" target="_blank"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black;text-decoration:none"><img border="0" width="44" height="28" src="cid:image002.gif@01D1CD35.3DE7D7A0" alt="Green Oracle"></span></a><span style="font-family:"Calibri","sans-serif";color:#1f497d"><u></u><u></u></span></p></td><td style="padding:.75pt .75pt .75pt .75pt"><p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Verdana","sans-serif";color:#4b7d42">Oracle is committed to developing practices and products that help protect the environment</span><span style="font-family:"Calibri","sans-serif";color:#1f497d"><u></u><u></u></span></p></td></tr></tbody></table><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p></span><div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in"><p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Colin Faber [mailto:<a href="mailto:colin.faber@seagate.com" target="_blank">colin.faber@seagate.com</a>] <br><b>Sent:</b> Thursday, June 23, 2016 9:43 AM<br><b>To:</b> Michael Skiba<br><b>Cc:</b> Lustre discussion<br><b>Subject:</b> Re: [lustre-discuss] can not get the hsm_release command to work with Lustre 2.7 and Oracle HSM 6.1<u></u><u></u></span></p></div><div><div class="h5"><p class="MsoNormal"><u></u> <u></u></p><div><p class="MsoNormal">Hi Michael,<u></u><u></u></p><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Does the backend copytool actually archive the file and notify lustre of the action? Based on your current state it only appears that the archive request was made and that it has not yet successfully archived.<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">In such a case release would be disallowed as it would amount to a data purge and stub out to a non-existent file.<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">-cf<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div></div><div><p class="MsoNormal"><u></u> <u></u></p><div><p class="MsoNormal">On Thu, Jun 23, 2016 at 9:27 AM, Michael Skiba <<a href="mailto:michael.skiba@oracle.com" target="_blank">michael.skiba@oracle.com</a>> wrote:<u></u><u></u></p><div><div><p class="MsoNormal">To all,<u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">               I am running a basic Lustre configuration 2.7 with Red Hat 6.6 and an Oracle HSM 6.1 system. The Lustre file system is running properly and works with the HSM samqfs File system.  I can manually  (nfs ) cp files back and forth to the Lustre and HSM file systems without a problem. I can run a Lustre  hsm_archive with no problems. When I try to request the hsm_release command it fails. I am trying to get the 5 request types to work stated in the manual on pg168 Chapter 22.4. Here are the steps below that I ran into on the Lustre Client. The Lustre Client mount point is /mnt  and the HSM mount point is /samqfs1. <u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">Any help would be most appreciated <u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">Her is the archive complete.<u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">[root@isr-x4150-01 ~]# lfs hsm_archive --archive=1 /mnt/0.out<u></u><u></u></p><p class="MsoNormal">[root@isr-x4150-01 ~]# df -h<u></u><u></u></p><p class="MsoNormal">Filesystem            Size  Used Avail Use% Mounted on<u></u><u></u></p><p class="MsoNormal">/dev/sda2             134G  7.0G  121G   6% /<u></u><u></u></p><p class="MsoNormal">tmpfs                 3.9G     0  3.9G   0% /dev/shm<u></u><u></u></p><p class="MsoNormal">/dev/sda1             477M  105M  348M  24% /boot<u></u><u></u></p><p class="MsoNormal"><a href="mailto:10.80.191.134@tcp0:/lustre" target="_blank">10.80.191.134@tcp0:/lustre</a><u></u><u></u></p><p class="MsoNormal">                      136G  9.6G  120G   8% /mnt<u></u><u></u></p><p class="MsoNormal">10.80.191.161:/samqfs1<u></u><u></u></p><p class="MsoNormal">                      558G   11G  548G   2% /samqfs1<u></u><u></u></p><p class="MsoNormal">[root@isr-x4150-01 ~]# lfs hsm_state /mnt/0.out<u></u><u></u></p><p class="MsoNormal">/mnt/0.out: (0x00000001) exists, archive_id:1<u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">Here is the hsm_release  request followed by the error.<u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">[root@isr-x4150-01 ~]# lfs hsm_release /mnt/0.out<u></u><u></u></p><p class="MsoNormal">Cannot send HSM request (use of /mnt/0.out): Operation not permitted<u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal"><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.oracle.com_&d=CwMFAg&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=hqsFWrKMaCUojiNflON-5wKRUoA1GP7EmTneF0W26MY&s=dyIsPVSVNQVZjQxnohvrEphS-XPbhyKHhs9wGtTLp1Y&e=" target="_blank"><span style="color:black;text-decoration:none"><img border="0" width="114" height="26" src="cid:image001.gif@01D1CD35.3DE7D7A0" alt="Oracle"></span></a><span style="color:#1f497d"><br></span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#666666">Michael J. Skiba | Principal Support Engineer<br>Phone: <a href="tel:+1%203032729724" target="_blank"><span style="color:black">+1 3032729724</span></a> | Mobile: <a href="tel:+1%203036198495" target="_blank"><span style="color:black">+1 3036198495</span></a> <br></span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:red">Oracle</span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#666666"> ISV<br>500 Elorado Blv. Bldg. 5</span><u></u><u></u></p><p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#666666">Broomfield, Colorado 80021</span><u></u><u></u></p><table border="0" cellspacing="3" cellpadding="0"><tbody><tr><td style="padding:.75pt .75pt .75pt .75pt"><p class="MsoNormal"><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.oracle.com_commitment&d=CwMFAg&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=hqsFWrKMaCUojiNflON-5wKRUoA1GP7EmTneF0W26MY&s=3UnZI3jBog33bwWP30Ll64fqdqVRB_r6sea6OwP06ZQ&e=" target="_blank"><span style="color:black;text-decoration:none"><img border="0" width="44" height="28" src="cid:image002.gif@01D1CD35.3DE7D7A0" alt="Green Oracle"></span></a><u></u><u></u></p></td><td style="padding:.75pt .75pt .75pt .75pt"><p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Verdana","sans-serif";color:#4b7d42">Oracle is committed to developing practices and products that help protect the environment</span><u></u><u></u></p></td></tr></tbody></table><p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p></div></div><p class="MsoNormal" style="margin-bottom:12.0pt"><br>_______________________________________________<br>lustre-discuss mailing list<br><a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a><br><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_listinfo.cgi_lustre-2Ddiscuss-2Dlustre.org&d=CwICAg&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=hqsFWrKMaCUojiNflON-5wKRUoA1GP7EmTneF0W26MY&s=tRDEocIS6lnYVSJnhfp9MdNAup4GFdSbGjOogFb9m1U&e=" target="_blank">https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_listinfo.cgi_lustre-2Ddiscuss-2Dlustre.org&d=CwICAg&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=hqsFWrKMaCUojiNflON-5wKRUoA1GP7EmTneF0W26MY&s=tRDEocIS6lnYVSJnhfp9MdNAup4GFdSbGjOogFb9m1U&e=</a><u></u><u></u></p></div><p class="MsoNormal"><u></u> <u></u></p></div></div></div></div></div></blockquote></div><br></div>