<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">it was permanently inactivated on the mds ... strange that it should show up at all. the OST list is persistent through the history of additions/deletions ...?<div><br></div><div><br></div><div><br></div><div><br><div>
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>Professor Samuel Aparicio BM BCh PhD FRCPath<br>Nan and Lorraine Robertson Chair UBC/BC Cancer Agency<br>675 West 10th, Vancouver V5Z 1L3, Canada.<br>office: +1 604 675 8200 lab website <a href="http://molonc.bccrc.ca">http://molonc.bccrc.ca</a><br><br><b>PLEASE SUPPORT MY FUNDRAISING FOR THE RIDE TO SEATTLE AND <br>THE WEEKEND TO END WOMENS CANCERS. YOU CAN DONATE AT THE LINKS BELOW</b><br>Ride to Seattle Fundraiser<br>Weekend to End Womens Cancers<br><br></div></div></span><br class="Apple-interchange-newline"></span><br class="Apple-interchange-newline">
</div>
<br><div><div>On Mar 21, 2011, at 3:29 AM, Larry wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div>If you *only* deactivate it on mds, then you can still see the ost on<br>client, just not to write on it anymore.<br><br>On Mon, Mar 21, 2011 at 11:49 AM, Samuel Aparicio <<a href="mailto:saparicio@bccrc.ca">saparicio@bccrc.ca</a>> wrote:<br><blockquote type="cite">Follow up to this posting. I notice on the client that lctl device_list<br></blockquote><blockquote type="cite">reports the following:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"> 0 UP mgc MGC10.9.89.51@tcp 5a76b5b6-82bf-2053-8c17-e68ffe552edc 5<br></blockquote><blockquote type="cite"> 1 UP lov lustre-clilov-ffff8100459a9c00<br></blockquote><blockquote type="cite">6775de4c-6c29-9316-a715-3472233477d1 4<br></blockquote><blockquote type="cite"> 2 UP mdc lustre-MDT0000-mdc-ffff8100459a9c00<br></blockquote><blockquote type="cite">6775de4c-6c29-9316-a715-3472233477d1 5<br></blockquote><blockquote type="cite"> 3 UP osc lustre-OST0000-osc-ffff8100459a9c00<br></blockquote><blockquote type="cite">6775de4c-6c29-9316-a715-3472233477d1 5<br></blockquote><blockquote type="cite"> 4 UP osc lustre-OST0001-osc-ffff8100459a9c00<br></blockquote><blockquote type="cite">6775de4c-6c29-9316-a715-3472233477d1 5<br></blockquote><blockquote type="cite"> 5 UP osc lustre-OST0002-osc-ffff8100459a9c00<br></blockquote><blockquote type="cite">6775de4c-6c29-9316-a715-3472233477d1 5<br></blockquote><blockquote type="cite"> 6 UP osc lustre-OST0003-osc-ffff8100459a9c00<br></blockquote><blockquote type="cite">6775de4c-6c29-9316-a715-3472233477d1 4<br></blockquote><blockquote type="cite"> 7 UP osc lustre-OST0004-osc-ffff8100459a9c00<br></blockquote><blockquote type="cite">6775de4c-6c29-9316-a715-3472233477d1 5<br></blockquote><blockquote type="cite"> 8 UP osc lustre-OST0005-osc-ffff8100459a9c00<br></blockquote><blockquote type="cite">6775de4c-6c29-9316-a715-3472233477d1 5<br></blockquote><blockquote type="cite"> 9 UP osc lustre-OST0006-osc-ffff8100459a9c00<br></blockquote><blockquote type="cite">6775de4c-6c29-9316-a715-3472233477d1 5<br></blockquote><blockquote type="cite"> 10 UP lov lustre-clilov-ffff810c92f2b800<br></blockquote><blockquote type="cite">0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 4<br></blockquote><blockquote type="cite"> 11 UP mdc lustre-MDT0000-mdc-ffff810c92f2b800<br></blockquote><blockquote type="cite">0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5<br></blockquote><blockquote type="cite"> 12 UP osc lustre-OST0000-osc-ffff810c92f2b800<br></blockquote><blockquote type="cite">0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5<br></blockquote><blockquote type="cite"> 13 UP osc lustre-OST0001-osc-ffff810c92f2b800<br></blockquote><blockquote type="cite">0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5<br></blockquote><blockquote type="cite"> 14 UP osc lustre-OST0002-osc-ffff810c92f2b800<br></blockquote><blockquote type="cite">0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5<br></blockquote><blockquote type="cite"> 15 UP osc lustre-OST0003-osc-ffff810c92f2b800<br></blockquote><blockquote type="cite">0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 4<br></blockquote><blockquote type="cite"> 16 UP osc lustre-OST0004-osc-ffff810c92f2b800<br></blockquote><blockquote type="cite">0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5<br></blockquote><blockquote type="cite"> 17 UP osc lustre-OST0005-osc-ffff810c92f2b800<br></blockquote><blockquote type="cite">0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5<br></blockquote><blockquote type="cite"> 18 UP osc lustre-OST0006-osc-ffff810c92f2b800<br></blockquote><blockquote type="cite">0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5<br></blockquote><blockquote type="cite"> 19 UP lov lustre-clilov-ffff81047a45c000<br></blockquote><blockquote type="cite">6a3d5815-4851-31b0-9400-c8892e11dae4 4<br></blockquote><blockquote type="cite"> 20 UP mdc lustre-MDT0000-mdc-ffff81047a45c000<br></blockquote><blockquote type="cite">6a3d5815-4851-31b0-9400-c8892e11dae4 5<br></blockquote><blockquote type="cite"> 21 UP osc lustre-OST0000-osc-ffff81047a45c000<br></blockquote><blockquote type="cite">6a3d5815-4851-31b0-9400-c8892e11dae4 5<br></blockquote><blockquote type="cite"> 22 UP osc lustre-OST0001-osc-ffff81047a45c000<br></blockquote><blockquote type="cite">6a3d5815-4851-31b0-9400-c8892e11dae4 5<br></blockquote><blockquote type="cite"> 23 UP osc lustre-OST0002-osc-ffff81047a45c000<br></blockquote><blockquote type="cite">6a3d5815-4851-31b0-9400-c8892e11dae4 5<br></blockquote><blockquote type="cite"> 24 UP osc lustre-OST0003-osc-ffff81047a45c000<br></blockquote><blockquote type="cite">6a3d5815-4851-31b0-9400-c8892e11dae4 4<br></blockquote><blockquote type="cite"> 25 UP osc lustre-OST0004-osc-ffff81047a45c000<br></blockquote><blockquote type="cite">6a3d5815-4851-31b0-9400-c8892e11dae4 5<br></blockquote><blockquote type="cite"> 26 UP osc lustre-OST0005-osc-ffff81047a45c000<br></blockquote><blockquote type="cite">6a3d5815-4851-31b0-9400-c8892e11dae4 5<br></blockquote><blockquote type="cite"> 27 UP osc lustre-OST0006-osc-ffff81047a45c000<br></blockquote><blockquote type="cite">6a3d5815-4851-31b0-9400-c8892e11dae4 5<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">However OST3 is non-existent, it was de-activated on the MDS - why would the<br></blockquote><blockquote type="cite">clients think it exists?<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Professor Samuel Aparicio BM BCh PhD FRCPath<br></blockquote><blockquote type="cite">Nan and Lorraine Robertson Chair UBC/BC Cancer Agency<br></blockquote><blockquote type="cite">675 West 10th, Vancouver V5Z 1L3, Canada.<br></blockquote><blockquote type="cite">office: +1 604 675 8200 lab website <a href="http://molonc.bccrc.ca">http://molonc.bccrc.ca</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">PLEASE SUPPORT MY FUNDRAISING FOR THE RIDE TO SEATTLE AND<br></blockquote><blockquote type="cite">THE WEEKEND TO END WOMENS CANCERS. YOU CAN DONATE AT THE LINKS BELOW<br></blockquote><blockquote type="cite">Ride to Seattle Fundraiser<br></blockquote><blockquote type="cite">Weekend to End Womens Cancers<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">On Mar 20, 2011, at 8:41 PM, Samuel Aparicio wrote:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">I am stuck with the following issue on a client attached to a lustre system.<br></blockquote><blockquote type="cite">we are running lustre 1.8.5<br></blockquote><blockquote type="cite">somehow connectivity to the OST failed at some point and the mount hung.<br></blockquote><blockquote type="cite">after unmounting and re-mounting the client attempts to reconnect.<br></blockquote><blockquote type="cite">lctl ping shows the client to be connected and normal ping to the OSS/MGS<br></blockquote><blockquote type="cite">servers shows connectivity.<br></blockquote><blockquote type="cite">remounting the filesystem results in only some files being visible.<br></blockquote><blockquote type="cite">the kernel messages are as follows:<br></blockquote><blockquote type="cite">---------<br></blockquote><blockquote type="cite">Lustre: setting import lustre-OST0003_UUID INACTIVE by administrator request<br></blockquote><blockquote type="cite">Lustre: lustre-OST0003-osc-ffff8110238c7400.osc: set parameter active=0<br></blockquote><blockquote type="cite">Lustre: Skipped 3 previous similar messages<br></blockquote><blockquote type="cite">LustreError: 14114:0:(lov_obd.c:315:lov_connect_obd()) not connecting OSC<br></blockquote><blockquote type="cite">^\; administratively disabled<br></blockquote><blockquote type="cite">Lustre: Client lustre-client has started<br></blockquote><blockquote type="cite">LustreError: 14207:0:(file.c:995:ll_glimpse_size()) obd_enqueue returned rc<br></blockquote><blockquote type="cite">-5, returning -EIO<br></blockquote><blockquote type="cite">LustreError: 14207:0:(file.c:995:ll_glimpse_size()) Skipped 1 previous<br></blockquote><blockquote type="cite">similar message<br></blockquote><blockquote type="cite">LustreError: 14207:0:(file.c:995:ll_glimpse_size()) obd_enqueue returned rc<br></blockquote><blockquote type="cite">-5, returning -EIO<br></blockquote><blockquote type="cite">LustreError: 14686:0:(file.c:995:ll_glimpse_size()) obd_enqueue returned rc<br></blockquote><blockquote type="cite">-5, returning -EIO<br></blockquote><blockquote type="cite">Lustre: 22218:0:(client.c:1476:ptlrpc_expire_one_request()) @@@ Request<br></blockquote><blockquote type="cite">x1363662012007464 sent from lustre-OST0000-osc-ffff8110238c7400 to NID<br></blockquote><blockquote type="cite">10.9.89.21@tcp 16s ago has timed out (16s prior to deadline).<br></blockquote><blockquote type="cite"> req@ffff810459ce4c00 x1363662012007464/t0<br></blockquote><blockquote type="cite">o8->lustre-OST0000_UUID@10.9.89.21@tcp:28/4 lens 368/584 e 0 to 1 dl<br></blockquote><blockquote type="cite">1300678232 ref 1 fl Rpc:N/0/0 rc 0/0<br></blockquote><blockquote type="cite">Lustre: 22218:0:(client.c:1476:ptlrpc_expire_one_request()) Skipped 182<br></blockquote><blockquote type="cite">previous similar messages<br></blockquote><blockquote type="cite">Lustre: 22219:0:(import.c:517:import_select_connection())<br></blockquote><blockquote type="cite">lustre-OST0000-osc-ffff8110238c7400: tried all connections, increasing<br></blockquote><blockquote type="cite">latency to 18s<br></blockquote><blockquote type="cite">Lustre: 22219:0:(import.c:517:import_select_connection()) Skipped 203<br></blockquote><blockquote type="cite">previous similar messages<br></blockquote><blockquote type="cite">------------<br></blockquote><blockquote type="cite">an LS of the filesytem shows<br></blockquote><blockquote type="cite">drwxr-xr-x 4 amcpherson users 4096 Mar 19 10:38 amcpherson<br></blockquote><blockquote type="cite">?--------- ? ? ? ? ? compute-2-0-testwrite<br></blockquote><blockquote type="cite">?--------- ? ? ? ? ? hello<br></blockquote><blockquote type="cite">----------<br></blockquote><blockquote type="cite">other clients on the system are able to mount and see the files perfectly<br></blockquote><blockquote type="cite">well.<br></blockquote><blockquote type="cite">can anyone help with what the errors above imply.<br></blockquote><blockquote type="cite">a simple network connectivity issue does not seem to be the case here,<br></blockquote><blockquote type="cite">yet the client attempts to re-connect to the OST, fail.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Professor Samuel Aparicio BM BCh PhD FRCPath<br></blockquote><blockquote type="cite">Nan and Lorraine Robertson Chair UBC/BC Cancer Agency<br></blockquote><blockquote type="cite">675 West 10th, Vancouver V5Z 1L3, Canada.<br></blockquote><blockquote type="cite">office: +1 604 675 8200 lab website <a href="http://molonc.bccrc.ca">http://molonc.bccrc.ca</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">PLEASE SUPPORT MY FUNDRAISING FOR THE RIDE TO SEATTLE AND<br></blockquote><blockquote type="cite">THE WEEKEND TO END WOMENS CANCERS. YOU CAN DONATE AT THE LINKS BELOW<br></blockquote><blockquote type="cite">Ride to Seattle Fundraiser<br></blockquote><blockquote type="cite">Weekend to End Womens Cancers<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_______________________________________________<br></blockquote><blockquote type="cite">Lustre-discuss mailing list<br></blockquote><blockquote type="cite"><a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><br></blockquote><blockquote type="cite"><a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_______________________________________________<br></blockquote><blockquote type="cite">Lustre-discuss mailing list<br></blockquote><blockquote type="cite"><a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><br></blockquote><blockquote type="cite"><a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote></div></blockquote></div><br></div></body></html>