<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META content="text/html; charset=gb2312" http-equiv=Content-Type>
<META name=GENERATOR content="MSHTML 8.00.6001.18852">
<STYLE>@font-face {
        font-family: ;
}
@font-face {
        font-family: Verdana;
}
@font-face {
        font-family: @;
}
@page Section1 {size: 595.3pt 841.9pt; margin: 72.0pt 90.0pt 72.0pt 90.0pt; layout-grid: 15.6pt; }
P.MsoNormal {
        TEXT-JUSTIFY: inter-ideograph; TEXT-ALIGN: justify; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; FONT-SIZE: 10.5pt
}
LI.MsoNormal {
        TEXT-JUSTIFY: inter-ideograph; TEXT-ALIGN: justify; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; FONT-SIZE: 10.5pt
}
DIV.MsoNormal {
        TEXT-JUSTIFY: inter-ideograph; TEXT-ALIGN: justify; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; FONT-SIZE: 10.5pt
}
A:link {
        COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
        COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
        COLOR: purple; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
        COLOR: purple; TEXT-DECORATION: underline
}
SPAN.EmailStyle17 {
        FONT-STYLE: normal; FONT-FAMILY: Verdana; COLOR: windowtext; FONT-WEIGHT: normal; TEXT-DECORATION: none; mso-style-type: personal-compose
}
DIV.Section1 {
        page: Section1
}
UNKNOWN {
        FONT-SIZE: 10pt
}
BLOCKQUOTE {
        MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px; MARGIN-LEFT: 2em
}
OL {
        MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
UL {
        MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
</STYLE>
</HEAD>
<BODY style="MARGIN: 10px; FONT-FAMILY: verdana; FONT-SIZE: 10pt">
<DIV><FONT color=#000080 face=Verdana>Hi, dearlist</FONT></DIV>
<DIV><FONT color=#000080></FONT>&nbsp;</DIV>
<DIV><FONT color=#000080>We have done the steps from&nbsp;1 to 5, but we can 
still only see 2/7 osc devices on the MDS, but we can see 7 osc devices on a 
mounted client. Then we run e2fsck on the osts, However, we get the same 
result.</FONT></DIV>
<DIV><FONT color=#000080></FONT>&nbsp;</DIV>
<DIV><FONT color=#000080>And we had the problem, after we do the step 1 to 
4&nbsp; and umount the filesystem from ldiskfs,&nbsp;then&nbsp;run the step 5, 
we got the logs:</FONT></DIV>
<DIV><FONT color=#000080>According to the logs, we have no idea why there are 63 
clients and where the MDS get the clients information with we removing 
</FONT><FONT color=#000000>CONFIGS/* and linking down.</FONT></DIV>
<DIV><FONT color=#000080 face=Verdana></FONT>&nbsp;</DIV>
<DIV><FONT color=#000080 face=Verdana>
<DIV>Nov&nbsp;12&nbsp;09:02:37&nbsp;beshome01&nbsp;kernel:&nbsp;Lustre:&nbsp;2474:0:(mds_fs.c:493:mds_init_server_data())&nbsp;RECOVERY:&nbsp;service&nbsp;besfs2-MDT0000,&nbsp;63&nbsp;recoverable&nbsp;clients,&nbsp;last_transno&nbsp;118077355</DIV>
<DIV>Nov&nbsp;12&nbsp;09:02:37&nbsp;beshome01&nbsp;kernel:&nbsp;Lustre:&nbsp;MDT&nbsp;besfs2-MDT0000&nbsp;now&nbsp;serving&nbsp;dev&nbsp;(besfs2-MDT0000/5ceb6ad6-e810-9fae-4862-8ed0913bf7e7),&nbsp;but&nbsp;will&nbsp;be&nbsp;in&nbsp;recovery&nbsp;for&nbsp;at&nbsp;least&nbsp;5:00,&nbsp;or&nbsp;until&nbsp;63&nbsp;clients&nbsp;reconnect.&nbsp;During&nbsp;this&nbsp;time&nbsp;new&nbsp;clients&nbsp;will&nbsp;not&nbsp;be&nbsp;allowed&nbsp;to&nbsp;connect.&nbsp;Recovery&nbsp;progress&nbsp;can&nbsp;be&nbsp;monitored&nbsp;by&nbsp;watching&nbsp;/proc/fs/lustre/mds/besfs2-MDT0000/recovery_status.</DIV></FONT></DIV>
<DIV><FONT color=#c0c0c0 face=Verdana>2009-11-12 </FONT></DIV><FONT 
color=#000080 face=Verdana>
<HR style="WIDTH: 100px" align=left color=#b5c4df SIZE=1>
</FONT>
<DIV><FONT color=#c0c0c0 face=Verdana><SPAN>huangql</SPAN> </FONT></DIV>
<HR color=#b5c4df SIZE=1>

<DIV><FONT face=Verdana><STRONG>\u02e3</STRONG> Andreas Dilger </FONT></DIV>
<DIV><FONT face=Verdana><STRONG>\u02b1\u48fa</STRONG> 2009-11-12&nbsp; 06:19:53 
</FONT></DIV>
<DIV><FONT face=Verdana><STRONG>\u057c\u02e3</STRONG> Lu Wang </FONT></DIV>
<DIV><FONT face=Verdana><STRONG>\u0363</STRONG> lustre-discuss </FONT></DIV>
<DIV><FONT face=Verdana><STRONG>\u28fa</STRONG> Re: [Lustre-discuss] osc lost on 
MDS server </FONT></DIV>
<DIV><FONT face=Verdana></FONT> </DIV>
<DIV><FONT face=Verdana>
<DIV>On&nbsp;2009-11-11,&nbsp;at&nbsp;05:59,&nbsp;Lu&nbsp;Wang&nbsp;wrote:</DIV>
<DIV>&gt;&nbsp;Dear&nbsp;&nbsp;list,</DIV>
<DIV>&gt;&nbsp; 
Our&nbsp;MDS&nbsp;losts&nbsp;5/7&nbsp;osc&nbsp;devices&nbsp;after&nbsp;a&nbsp;reconfiguration:</DIV>
<DIV>&gt;&nbsp; 1.umount&nbsp;all&nbsp;osts</DIV>
<DIV>&gt;&nbsp; 
2.tunfs.lustre&nbsp;--writeconf&nbsp;--mgs&nbsp;--mdt&nbsp;/dev/sda1</DIV>
<DIV>&gt;&nbsp; 
3.mount&nbsp;-t&nbsp;ldiskfs&nbsp;mdtdevice&nbsp;mountpoint</DIV>
<DIV>&gt;&nbsp; 4.rm&nbsp;CONFIGS/*</DIV>
<DIV>&gt;&nbsp; 5.mount&nbsp;-t&nbsp;lustre&nbsp;mdtdevice&nbsp;mountpoint</DIV>
<DIV></DIV>
<DIV>Where&nbsp;is&nbsp;it&nbsp;documented&nbsp;to&nbsp;delete&nbsp;all&nbsp;of&nbsp;the&nbsp;files&nbsp;in&nbsp;CONFIGS?</DIV>
<DIV>This&nbsp;deletes&nbsp;the&nbsp;action&nbsp;of&nbsp;step&nbsp;#2&nbsp;above,&nbsp;and&nbsp;isn't&nbsp;a&nbsp;good&nbsp;idea.</DIV>
<DIV>Presumably&nbsp;there&nbsp;was&nbsp;also&nbsp;a&nbsp;step&nbsp;4b&nbsp;to&nbsp;unmount&nbsp;the&nbsp;filesystem</DIV>
<DIV>from&nbsp;type&nbsp;lfdiskfs?</DIV>
<DIV></DIV>
<DIV>Cheers,&nbsp;Andreas</DIV>
<DIV>--</DIV>
<DIV>Andreas&nbsp;Dilger</DIV>
<DIV>Sr.&nbsp;Staff&nbsp;Engineer,&nbsp;Lustre&nbsp;Group</DIV>
<DIV>Sun&nbsp;Microsystems&nbsp;of&nbsp;Canada,&nbsp;Inc.</DIV>
<DIV></DIV>
<DIV>_______________________________________________</DIV>
<DIV>Lustre-discuss&nbsp;mailing&nbsp;list</DIV>
<DIV>Lustre-discuss@lists.lustre.org</DIV>
<DIV>http://lists.lustre.org/mailman/listinfo/lustre-discuss</DIV>
<DIV></DIV></FONT></DIV></BODY></HTML>