Hi list <br><br>I am encountering a problem with OST-MDS connecting. Because of RAID card hanging, our OST went down this morning and when i tried to mount the faill over node of that OST, problem occurred : <br><br>MDS only sent request to the OST which was down and didn't connect to our backup (failover) OST, so our backup solution was useless, we lost all data from that OST. It's really a disaster for me because we even lost all of our data before with the same kind of problem: OST can't connect to MDS !!!!<br>
<br>We use drbd between OSTs to synchronize data. The backup (failover node) was mounted successfully without any error but didn't have any client to recover like this: <br><br>cat /proc/fs/lustre/obdfilter/lustre-OST0006/recovery_status<br>
status: RECOVERING<br>recovery_start: 0<br>time_remaining: 0<br>connected_clients: 0/1<br>delayed_clients: 0/1<br>completed_clients: 0/1<br>replayed_requests: 0<b>/??</b><br>queued_requests: 0<br>next_transno: 30064771073<br>
<br>In MDS's message log, we only saw the connection to our dead OST: <br><br>Nov 18 22:44:03 MDS1 kernel: Lustre: Request x1314965674069373 sent from lustre-OST0006-osc to NID 192.168.1.66@tcp 56s ago has timed out (limit 56s).<br>
......<br><br>The output of<b> </b><i><b>lctl dl</b> </i>command from MDS<br><br>lctl dl<br> 0 UP mgs MGS MGS 25<br> 1 UP mgc MGC192.168.1.78@tcp 0681a267-849f-350c-5b2c-6869c794550f 5<br> 2 UP mdt MDS MDS_uuid 3<br> 3 UP lov lustre-mdtlov lustre-mdtlov_UUID 4<br>
4 UP mds lustre-MDT0000 lustre-MDT0000_UUID 15<br> 5 UP osc lustre-OST0001-osc lustre-mdtlov_UUID 5<br> 6 UP osc lustre-OST0003-osc lustre-mdtlov_UUID 5<br> 7 IN osc lustre-OST0006-osc lustre-mdtlov_UUID 5<br> 8 UP osc lustre-OST0004-osc lustre-mdtlov_UUID 5<br>
9 UP osc lustre-OST0005-osc lustre-mdtlov_UUID 5<br><br>I did activated OST6 ( lctl --device 7 activate ) but it couldn't help<br><br><br><br>Could anyone tell me how to route MDS to connect to our backup OST ( with ip address 192.168.1.67 , for example ) ? , to bring our OST up ?<br>
<br>Any help would be really appreciated ! <br><br>Hope that i can receive your answers or suggestions as soon as possible <br><br>Best Regards <br><br><br>