<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D">Yes, both mgs and mdt modules are present<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D">Module Size Used by<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D">osp 341968 27<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D">mdd 408582 17<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D">lod 508629 17<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D">mdt 818340 18<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D">lfsck 735096 20 lod,mdd,mdt<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D">mgs 351348 1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D">mgc 94061 2 mgs<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D">osd_zfs 363587 31<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1F497D">lquota 363475 77 mdt,osd_zfs<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><a name="_____replyseparator"></a><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Feng Zhang [mailto:prod.feng@gmail.com]
<br>
<b>Sent:</b> Tuesday, June 19, 2018 8:13 AM<br>
<b>To:</b> Hebenstreit, Michael <michael.hebenstreit@intel.com><br>
<b>Cc:</b> lustre-discuss <lustre-discuss@lists.lustre.org><br>
<b>Subject:</b> Re: [lustre-discuss] request for help - ZFS based Lustre, MDT disk not mounting<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Is lustre module loaded already in kernel and started?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Tue, Jun 19, 2018 at 10:07 AM, Hebenstreit, Michael <<a href="mailto:michael.hebenstreit@intel.com" target="_blank">michael.hebenstreit@intel.com</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal">Mount commands hangs, no error messages in kernel log, tried already rebooting (twice) - any ideas?<br>
<br>
Thanks<br>
Michael<br>
<br>
root 4137 0.0 0.0 123520 1048 pts/0 S+ 07:56 0:00 mount -t lustre mgsmdt/mdt /lfs/lfs11/mdt<br>
root 4138 0.0 0.0 81728 3272 pts/0 S+ 07:56 0:00 /sbin/mount.lustre mgsmdt/mdt /lfs/lfs11/mdt -o rw<br>
<br>
[root@elfs11m1 ~]# dmesg | grep -i MDT<br>
[ 107.238438] LustreError: 137-5: lfs11-MDT0000_UUID: not available for connect from
<a href="mailto:36.101.16.38@tcp">36.101.16.38@tcp</a> (no target). If you are running an HA pair check that the target is mounted on the other server.<br>
[ 107.656990] Lustre: lfs11-MDT0000: Not available for connect from <a href="mailto:36.101.16.39@tcp">
36.101.16.39@tcp</a> (not set up)<br>
<br>
ZFS does not report any issues, mgs (on the same zpool) mounted without issues<br>
<br>
[root@elfs11m1 ~]# zfs list<br>
NAME USED AVAIL REFER MOUNTPOINT<br>
mgsmdt 149G 18.9T 40.8K /mgsmdt<br>
mgsmdt/mdt 147G 18.9T 147G /mgsmdt/mdt<br>
mgsmdt/mgs 4.48M 18.9T 4.48M /mgsmdt/mgs<br>
[root@elfs11m1 ~]# zpool status<br>
pool: mgsmdt<br>
state: ONLINE<br>
status: Some supported features are not enabled on the pool. The pool can<br>
still be used, but some features are unavailable.<br>
action: Enable all features using 'zpool upgrade'. Once this is done,<br>
the pool may no longer be accessible by software that does not support<br>
the features. See zpool-features(5) for details.<br>
scan: scrub repaired 0B in 2h14m with 0 errors on Thu May 31 13:36:58 2018<br>
config:<br>
<br>
NAME STATE READ WRITE CKSUM<br>
mgsmdt ONLINE 0 0 0<br>
raidz2-0 ONLINE 0 0 0<br>
sdb ONLINE 0 0 0<br>
sdc ONLINE 0 0 0<br>
sdd ONLINE 0 0 0<br>
sde ONLINE 0 0 0<br>
sdf ONLINE 0 0 0<br>
sdg ONLINE 0 0 0<br>
sdh ONLINE 0 0 0<br>
sdi ONLINE 0 0 0<br>
sdj ONLINE 0 0 0<br>
sdk ONLINE 0 0 0<br>
sdl ONLINE 0 0 0<br>
sdm ONLINE 0 0 0<br>
sdn ONLINE 0 0 0<br>
sdo ONLINE 0 0 0<br>
sdp ONLINE 0 0 0<br>
sdq ONLINE 0 0 0<br>
sdr ONLINE 0 0 0<br>
sds ONLINE 0 0 0<br>
sdt ONLINE 0 0 0<br>
sdu ONLINE 0 0 0<br>
sdv ONLINE 0 0 0<br>
sdw ONLINE 0 0 0<br>
sdx ONLINE 0 0 0<br>
sdy ONLINE 0 0 0<br>
<br>
errors: No known data errors<br>
<br>
<br>
<br>
------------------------------------------------------------------------<br>
Michael Hebenstreit Senior Cluster Architect<br>
Intel Corporation, MS: RR1-105/H14 Core and Visual Compute Group (DCE)<br>
4100 Sara Road Tel.: +1 505-794-3144 <br>
Rio Rancho, NM 87124<br>
UNITED STATES E-mail: <a href="mailto:michael.hebenstreit@intel.com">
michael.hebenstreit@intel.com</a><br>
<br>
<br>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">-- <o:p></o:p></p>
<div>
<p class="MsoNormal">Best,<br>
<br>
Feng<o:p></o:p></p>
</div>
</div>
</div>
</body>
</html>