<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Follow up to this posting. I notice on the client that lctl device_list reports the following:<div><br></div><div><br></div><div><div> 0 UP mgc MGC10.9.89.51@tcp 5a76b5b6-82bf-2053-8c17-e68ffe552edc 5</div><div> 1 UP lov lustre-clilov-ffff8100459a9c00 6775de4c-6c29-9316-a715-3472233477d1 4</div><div> 2 UP mdc lustre-MDT0000-mdc-ffff8100459a9c00 6775de4c-6c29-9316-a715-3472233477d1 5</div><div> 3 UP osc lustre-OST0000-osc-ffff8100459a9c00 6775de4c-6c29-9316-a715-3472233477d1 5</div><div> 4 UP osc lustre-OST0001-osc-ffff8100459a9c00 6775de4c-6c29-9316-a715-3472233477d1 5</div><div> 5 UP osc lustre-OST0002-osc-ffff8100459a9c00 6775de4c-6c29-9316-a715-3472233477d1 5</div><div> 6 UP osc lustre-OST0003-osc-ffff8100459a9c00 6775de4c-6c29-9316-a715-3472233477d1 4</div><div> 7 UP osc lustre-OST0004-osc-ffff8100459a9c00 6775de4c-6c29-9316-a715-3472233477d1 5</div><div> 8 UP osc lustre-OST0005-osc-ffff8100459a9c00 6775de4c-6c29-9316-a715-3472233477d1 5</div><div> 9 UP osc lustre-OST0006-osc-ffff8100459a9c00 6775de4c-6c29-9316-a715-3472233477d1 5</div><div> 10 UP lov lustre-clilov-ffff810c92f2b800 0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 4</div><div> 11 UP mdc lustre-MDT0000-mdc-ffff810c92f2b800 0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5</div><div> 12 UP osc lustre-OST0000-osc-ffff810c92f2b800 0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5</div><div> 13 UP osc lustre-OST0001-osc-ffff810c92f2b800 0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5</div><div> 14 UP osc lustre-OST0002-osc-ffff810c92f2b800 0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5</div><div> 15 UP osc lustre-OST0003-osc-ffff810c92f2b800 0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 4</div><div> 16 UP osc lustre-OST0004-osc-ffff810c92f2b800 0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5</div><div> 17 UP osc lustre-OST0005-osc-ffff810c92f2b800 0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5</div><div> 18 UP osc lustre-OST0006-osc-ffff810c92f2b800 0ecd69f5-6793-fcb1-0e05-8851c99e5dc5 5</div><div> 19 UP lov lustre-clilov-ffff81047a45c000 6a3d5815-4851-31b0-9400-c8892e11dae4 4</div><div> 20 UP mdc lustre-MDT0000-mdc-ffff81047a45c000 6a3d5815-4851-31b0-9400-c8892e11dae4 5</div><div> 21 UP osc lustre-OST0000-osc-ffff81047a45c000 6a3d5815-4851-31b0-9400-c8892e11dae4 5</div><div> 22 UP osc lustre-OST0001-osc-ffff81047a45c000 6a3d5815-4851-31b0-9400-c8892e11dae4 5</div><div> 23 UP osc lustre-OST0002-osc-ffff81047a45c000 6a3d5815-4851-31b0-9400-c8892e11dae4 5</div><div> 24 UP osc lustre-OST0003-osc-ffff81047a45c000 6a3d5815-4851-31b0-9400-c8892e11dae4 4</div><div> 25 UP osc lustre-OST0004-osc-ffff81047a45c000 6a3d5815-4851-31b0-9400-c8892e11dae4 5</div><div> 26 UP osc lustre-OST0005-osc-ffff81047a45c000 6a3d5815-4851-31b0-9400-c8892e11dae4 5</div><div> 27 UP osc lustre-OST0006-osc-ffff81047a45c000 6a3d5815-4851-31b0-9400-c8892e11dae4 5</div></div><div><br></div><div><br></div><div>However OST3 is non-existent, it was de-activated on the MDS - why would the clients think it exists?</div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br><div>
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>Professor Samuel Aparicio BM BCh PhD FRCPath<br>Nan and Lorraine Robertson Chair UBC/BC Cancer Agency<br>675 West 10th, Vancouver V5Z 1L3, Canada.<br>office: +1 604 675 8200 lab website <a href="http://molonc.bccrc.ca">http://molonc.bccrc.ca</a><br><br><b>PLEASE SUPPORT MY FUNDRAISING FOR THE RIDE TO SEATTLE AND <br>THE WEEKEND TO END WOMENS CANCERS. YOU CAN DONATE AT THE LINKS BELOW</b><br>Ride to Seattle Fundraiser<br>Weekend to End Womens Cancers<br><br></div></div><br class="Apple-interchange-newline"><br class="Apple-interchange-newline">
</div>
<br><div><div>On Mar 20, 2011, at 8:41 PM, Samuel Aparicio wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>I am stuck with the following issue on a client attached to a lustre system.</div><div>we are running lustre 1.8.5</div><div>somehow connectivity to the OST failed at some point and the mount hung.</div><div>after unmounting and re-mounting the client attempts to reconnect.</div><div>lctl ping shows the client to be connected and normal ping to the OSS/MGS servers shows connectivity.</div><div><br></div><div>remounting the filesystem results in only some files being visible.</div><div>the kernel messages are as follows:</div><div>---------</div><div><div>Lustre: setting import lustre-OST0003_UUID INACTIVE by administrator request</div><div>Lustre: lustre-OST0003-osc-ffff8110238c7400.osc: set parameter active=0</div><div>Lustre: Skipped 3 previous similar messages</div><div>LustreError: 14114:0:(lov_obd.c:315:lov_connect_obd()) not connecting OSC ^\; administratively disabled</div><div>Lustre: Client lustre-client has started</div><div>LustreError: 14207:0:(file.c:995:ll_glimpse_size()) obd_enqueue returned rc -5, returning -EIO</div><div>LustreError: 14207:0:(file.c:995:ll_glimpse_size()) Skipped 1 previous similar message</div><div>LustreError: 14207:0:(file.c:995:ll_glimpse_size()) obd_enqueue returned rc -5, returning -EIO</div><div>LustreError: 14686:0:(file.c:995:ll_glimpse_size()) obd_enqueue returned rc -5, returning -EIO</div><div>Lustre: 22218:0:(client.c:1476:ptlrpc_expire_one_request()) @@@ Request x1363662012007464 sent from lustre-OST0000-osc-ffff8110238c7400 to NID 10.9.89.21@tcp 16s ago has timed out (16s prior to deadline).</div><div> req@ffff810459ce4c00 x1363662012007464/t0 o8->lustre-OST0000_UUID@10.9.89.21@tcp:28/4 lens 368/584 e 0 to 1 dl 1300678232 ref 1 fl Rpc:N/0/0 rc 0/0</div><div>Lustre: 22218:0:(client.c:1476:ptlrpc_expire_one_request()) Skipped 182 previous similar messages</div><div>Lustre: 22219:0:(import.c:517:import_select_connection()) lustre-OST0000-osc-ffff8110238c7400: tried all connections, increasing latency to 18s</div><div>Lustre: 22219:0:(import.c:517:import_select_connection()) Skipped 203 previous similar messages</div></div><div>------------</div><div><br></div><div>an LS of the filesytem shows</div><div><br></div><div><div>drwxr-xr-x 4 amcpherson users 4096 Mar 19 10:38 amcpherson</div><div>?--------- ? ? ? ? ? compute-2-0-testwrite</div><div>?--------- ? ? ? ? ? hello</div></div><div><br></div><div>----------</div><div><br></div><div>other clients on the system are able to mount and see the files perfectly well.</div><div><br></div><div>can anyone help with what the errors above imply. </div><div><br></div><div>a simple network connectivity issue does not seem to be the case here,</div><div>yet the client attempts to re-connect to the OST, fail.</div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><br><div>
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>Professor Samuel Aparicio BM BCh PhD FRCPath<br>Nan and Lorraine Robertson Chair UBC/BC Cancer Agency<br>675 West 10th, Vancouver V5Z 1L3, Canada.<br>office: +1 604 675 8200 lab website <a href="http://molonc.bccrc.ca/">http://molonc.bccrc.ca</a><br><br><b>PLEASE SUPPORT MY FUNDRAISING FOR THE RIDE TO SEATTLE AND <br>THE WEEKEND TO END WOMENS CANCERS. YOU CAN DONATE AT THE LINKS BELOW</b><br>Ride to Seattle Fundraiser<br>Weekend to End Womens Cancers<br><br></div></div><br class="Apple-interchange-newline"><br class="Apple-interchange-newline">
</div>
<br></div>_______________________________________________<br>Lustre-discuss mailing list<br><a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><br>http://lists.lustre.org/mailman/listinfo/lustre-discuss<br></blockquote></div><br></div></body></html>