<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Exchange Server">
<!-- converted from rtf -->
<style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left: #800000 2px solid; } --></style>
</head>
<body>
<font face="Calibri" size="2"><span style="font-size:11pt;">
<div>That is starting to make sense.. Let me summarize so I have got it right</div>
<div> </div>
<div>Current</div>
<div>mkfs.lustre --fsname=temp --mgs --mdt --index=0 /dev/mapper/mpathcp1 - On MDS/MGS</div>
<div>mkfs.lustre --ost --fsname=client1 --reformat --index=0 --mgsnode=10.177.33.10@tcp0 /dev/zvol/LSD1Pool/LusterVola0 - ON OST</div>
<div> </div>
<div>New</div>
<div>mkfs.lustre --fsname=<font color="red"><span style="background-color:yellow;">client1</span></font> --mgs --mdt --index=0 /dev/mapper/mpathcp1 - On MDS/MGS</div>
<div>mkfs.lustre --ost --fsname=client1 --reformat --index=0 --mgsnode=10.177.33.10@tcp0 /dev/zvol/LSD1Pool/LusterVola0 - ON OST</div>
<div> </div>
<div>So the only change is the fsname that I had used while creating the MDT should be same as the fsname when creating OST .. In this case it is <span style="background-color:yellow;">"client1"</span></div>
<div> </div>
<div>Does that sound correct Rick and Joe ?</div>
<div> </div>
<div>-----Original Message-----<br>
From: Mohr Jr, Richard Frank (Rick Mohr) [<a href="mailto:rmohr@utk.edu">mailto:rmohr@utk.edu</a>]
<br>
Sent: Thursday, January 08, 2015 10:59 AM<br>
To: Gupta, Amit<br>
Cc: Mervini, Joseph A; lustre discuss<br>
Subject: Re: [Lustre-discuss] [EXTERNAL] Re: Newbie - Unable to mount the OST on the Client</div>
<div> </div>
<div>Amit,</div>
<div> </div>
<div>Are you by any chance specifying a unique value for --fsname for each of the MDT/OSTs? If so, keep in mind that fsname needs to be the same when you format all the MDT/OST devices and that the fsname doesn't have anything to do with the mount point for
the MDT/OSTs.</div>
<div> </div>
<div>--Rick</div>
<div> </div>
<div> </div>
<div> </div>
<div>On Jan 8, 2015, at 11:52 AM, "Gupta, Amit" <<a href="mailto:amit.gupta@optum.com">amit.gupta@optum.com</a>></div>
<div> wrote:</div>
<div> </div>
<div>> Joe, I agree and I have it configured the same way as you described.. Both the MGS and MDS are on the same node. Adding the output ..</div>
<div>> </div>
<div>> What am I missing here ?. Thanks</div>
<div>> </div>
<div>> </div>
<div>> Here’s what I had used on the MDS/MGS node to configure the lustre fs</div>
<div>> </div>
<div>> mkfs.lustre --fsname=temp --mgs --mdt --index=0 /dev/mapper/mpathcp1</div>
<div>> </div>
<div>> df- k output on MGS/MDS</div>
<div>> /dev/mapper/mpathcp1 201286044 4273344 183232496 3% /mdt</div>
<div>> </div>
<div>> </div>
<div>> [root@mgs/mds ~]# cat /proc/fs/lustre/mgs/MGS/live/*</div>
<div>> fsname: client1</div>
<div>> flags: 0x20 gen: 5</div>
<div>> client1-OST0000</div>
<div>> </div>
<div>> Secure RPC Config Rules:</div>
<div>> </div>
<div>> imperative_recovery_state:</div>
<div>> state: full</div>
<div>> nonir_clients: 0</div>
<div>> nidtbl_version: 4</div>
<div>> notify_duration_total: 0.000000</div>
<div>> notify_duation_max: 0.000000</div>
<div>> notify_count: 2</div>
<div>> fsname: params</div>
<div>> flags: 0x21 gen: 1</div>
<div>> </div>
<div>> Secure RPC Config Rules:</div>
<div>> </div>
<div>> imperative_recovery_state:</div>
<div>> state: full</div>
<div>> nonir_clients: 0</div>
<div>> nidtbl_version: 2</div>
<div>> notify_duration_total: 0.000000</div>
<div>> notify_duation_max: 0.000000</div>
<div>> notify_count: 0</div>
<div>> fsname: temp</div>
<div>> flags: 0x20 gen: 7</div>
<div>> temp-MDT0000</div>
<div>> </div>
<div>> Secure RPC Config Rules:</div>
<div>> </div>
<div>> imperative_recovery_state:</div>
<div>> state: full</div>
<div>> nonir_clients: 0</div>
<div>> nidtbl_version: 4</div>
<div>> notify_duration_total: 0.000000</div>
<div>> notify_duation_max: 0.000000</div>
<div>> notify_count: 1</div>
<div>> </div>
<div>> </div>
<div>> [root@mgs/mds] debugfs -c -R 'ls -l CONFIGS' /dev/mapper/mpathcp1 </div>
<div>> debugfs 1.42.12.wc1 (15-Sep-2014)</div>
<div>> /dev/mapper/mpathcp1: catastrophic mode - not reading inode or group bitmaps -</div>
<div>> 32769 40755 (2) 0 0 4096 6-Jan-2015 13:09 .</div>
<div>> 2 40755 (2) 0 0 4096 6-Jan-2015 13:10 ..</div>
<div>> 12 100644 (1) 0 0 12288 6-Jan-2015 13:10 mountdata</div>
<div>> 81 100644 (1) 0 0 0 6-Jan-2015 13:10 params-client</div>
<div>> 82 100644 (1) 0 0 0 6-Jan-2015 13:10 params</div>
<div>> 83 100644 (1) 0 0 11200 6-Jan-2015 13:10 temp-client</div>
<div>> 84 100644 (1) 0 0 9792 6-Jan-2015 13:10 temp-MDT0000</div>
<div>> 104 100644 (1) 0 0 10600 6-Jan-2015 13:12 client2-client</div>
<div>> 105 100644 (1) 0 0 8880 6-Jan-2015 13:12 client2-OST0000</div>
<div>> 107 100644 (1) 0 0 10600 6-Jan-2015 23:38 client1-client</div>
<div>> 108 100644 (1) 0 0 8880 6-Jan-2015 23:38 client1-OST0000</div>
<div>> </div>
<div>> </div>
<div>> From: Mervini, Joseph A [<a href="mailto:jamervi@sandia.gov">mailto:jamervi@sandia.gov</a>]</div>
<div>> Sent: Thursday, January 08, 2015 10:43 AM</div>
<div>> To: Gupta, Amit</div>
<div>> Cc: <font face="Gulim">한종우</font>; lustre discuss</div>
<div>> Subject: Re: [EXTERNAL] Re: [Lustre-discuss] Newbie - Unable to mount </div>
<div>> the OST on the Client</div>
<div>> </div>
<div>> In lustre you MUST have a MGS _AND_ MDS node and an associated MDT (file system) running on the MDS. Typically the MDS and MGS are configured on the same node.</div>
<div>> </div>
<div>> If you don't have this, lustre won't work.</div>
<div>> ====</div>
<div>> </div>
<div>> Joe Mervini</div>
<div>> Sandia National Laboratories</div>
<div>> High Performance Computing</div>
<div>> 505.844.6770</div>
<div>> <a href="mailto:jamervi@sandia.gov">jamervi@sandia.gov</a></div>
<div>> </div>
<div>> </div>
<div>> </div>
<div>> On Jan 8, 2015, at 7:23 AM, Gupta, Amit <<a href="mailto:amit.gupta@optum.com">amit.gupta@optum.com</a>> wrote:</div>
<div>> </div>
<div>> </div>
<div>> Jongwoo,</div>
<div>> </div>
<div>> This is the mount command that is being used on the client machine </div>
<div>> [root@Client ~]# mount -t lustre <a href="mailto:10.177.33.10@tcp:/client1">10.177.33.10@tcp:/client1</a> /mnt/lustre</div>
<div>> </div>
<div>> Here 10.177.33.10 is the MGS Server and “client1” is the filesystem </div>
<div>> name for the OST</div>
<div>> </div>
<div>> On the OSS, here is this filesystem mounted as</div>
<div>> </div>
<div>> /dev/zd912 1069706420 483556 1013552180 1% /client1</div>
<div>> The commands used on OST to mount and format “client1” were</div>
<div>> </div>
<div>> mkfs.lustre --ost --fsname=client1 --reformat --index=0 </div>
<div>> <a href="mailto:--mgsnode=10.177.33.10@tcp0">--mgsnode=10.177.33.10@tcp0</a> /dev/zvol/LSD1Pool/LusterVola0 mount -t </div>
<div>> lustre /dev/zvol/LSD1Pool/LusterVola0 /client1</div>
<div>> </div>
<div>> </div>
<div>> </div>
<div>> From: <font face="Gulim">한종우</font> [<a href="mailto:jw.han@apexcns.com">mailto:jw.han@apexcns.com</a>]</div>
<div>> Sent: Wednesday, January 07, 2015 9:20 PM</div>
<div>> To: Gupta, Amit</div>
<div>> Cc: <a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a></div>
<div>> Subject: Re: [Lustre-discuss] Newbie - Unable to mount the OST on the </div>
<div>> Client</div>
<div>> </div>
<div>> Hi Gupta,</div>
<div>> </div>
<div>> What I see is</div>
<div>> </div>
<div>> • there is no MDS and/or filesystem name</div>
<div>> • mount command did not specify filesystem name, otherwise the filesystem name is "client1"</div>
<div>> try preparing MDT volume and format it with a filesystem name( on the </div>
<div>> MGS is okay) and mount the MDT, and retry lustre mount with following </div>
<div>> command</div>
<div>> </div>
<div>> [root@Client ~]# mount -t lustre <a href="mailto:10.177.33.10@tcp:/<FILESYSTEMNAME">10.177.33.10@tcp:/<FILESYSTEMNAME</a>> </div>
<div>> /mnt/lustre</div>
<div>> </div>
<div>> Regards,</div>
<div>> </div>
<div>> Jongwoo Han</div>
<div>> </div>
<div>> </div>
<div>> 2015-01-07 22:25 GMT+09:00 Gupta, Amit <<a href="mailto:amit.gupta@optum.com">amit.gupta@optum.com</a>>:</div>
<div>> Hi All ,</div>
<div>> </div>
<div>> Need some guidance on getting past this error that I get mounting the OST on the Client. This is the first time I am trying to mount it so not sure what I could be missing.. I will be glad to provide any other logs that would be helpful to determine
the root cause of this issue..</div>
<div>> </div>
<div>> Thanks</div>
<div>> </div>
<div>> There are 3 servers in the configuration running Lustre </div>
<div>> kernel-2.6.32-431.20.3.el6_lustre.x86_64</div>
<div>> </div>
<div>> 10.177.33.10 is MGS/MGT Server</div>
<div>> 10.177.33.9 is the Lustre Client</div>
<div>> 10.177.33.22 is OSS</div>
<div>> </div>
<div>> </div>
<div>> [root@Client ~]# mount -t lustre <a href="mailto:10.177.33.10@tcp:/client1">10.177.33.10@tcp:/client1</a> /mnt/lustre</div>
<div>> mount.lustre: mount <a href="mailto:10.177.33.10@tcp:/client1">10.177.33.10@tcp:/client1</a> at /mnt/lustre failed: </div>
<div>> Invalid argument This may have multiple causes.</div>
<div>> Is 'client1' the correct filesystem name?</div>
<div>> Are the mount options correct?</div>
<div>> Check the syslog for more info</div>
<div>> </div>
<div>> </div>
<div>> The OST is mounted on OSS as Client1</div>
<div>> </div>
<div>> </div>
<div>> </div>
<div>> </div>
<div>> Error from Logs</div>
<div>> </div>
<div>> Jan 7 13:10:46 client kernel: LustreError: 156-2: The client profile </div>
<div>> 'client1-client' could not be read from the MGS. Does that filesystem exist?</div>
<div>> Jan 7 13:10:46 client kernel: LustreError: </div>
<div>> 11278:0:(lov_obd.c:951:lov_cleanup()) client1-clilov-ffff8820337cec00: </div>
<div>> lov tgt 0 not cleaned! deathrow=0, lovrc=1 Jan 7 13:10:46 client </div>
<div>> kernel: Lustre: Unmounted client1-client Jan 7 13:10:46 client </div>
<div>> kernel: LustreError: 13167:0:(obd_mount.c:1342:lustre_fill_super()) </div>
<div>> Unable to mount (-22)</div>
<div>> </div>
<div>> ================================================</div>
<div>> </div>
<div>> Pinging MGS and Client from OSS</div>
<div>> =================================================</div>
<div>> </div>
<div>> [root@OSS ]# lctl ping 10.177.33.10</div>
<div>> 12345-0@lo</div>
<div>> <a href="mailto:12345-10.177.33.10@tcp">12345-10.177.33.10@tcp</a></div>
<div>> [root@OSS]# lctl ping 10.177.33.9</div>
<div>> 12345-0@lo</div>
<div>> <a href="mailto:12345-10.177.33.9@tcp">12345-10.177.33.9@tcp</a></div>
<div>> </div>
<div>> =====================</div>
<div>> OST mounted as Client1 on OSS</div>
<div>> =============================</div>
<div>> </div>
<div>> /dev/zd912 1069706420 483556 1013552180 1% /client1</div>
<div>> </div>
<div>> </div>
<div>> [root@OSS]# tunefs.lustre /dev/zd912</div>
<div>> checking for existing Lustre data: found Reading CONFIGS/mountdata</div>
<div>> </div>
<div>> Read previous values:</div>
<div>> Target: client1-OST0000</div>
<div>> Index: 0</div>
<div>> Lustre FS: client1</div>
<div>> Mount type: ldiskfs</div>
<div>> Flags: 0x2</div>
<div>> (OST )</div>
<div>> Persistent mount opts: errors=remount-ro</div>
<div>> Parameters: <a href="mailto:mgsnode=10.177.33.10@tcp">mgsnode=10.177.33.10@tcp</a></div>
<div>> </div>
<div>> </div>
<div>> Permanent disk data:</div>
<div>> Target: client1-OST0000</div>
<div>> Index: 0</div>
<div>> Lustre FS: client1</div>
<div>> Mount type: ldiskfs</div>
<div>> Flags: 0x2</div>
<div>> (OST )</div>
<div>> Persistent mount opts: errors=remount-ro</div>
<div>> Parameters: <a href="mailto:mgsnode=10.177.33.10@tcp">mgsnode=10.177.33.10@tcp</a></div>
<div>> </div>
<div>> </div>
<div>> lctl > modules</div>
<div>> add-symbol-file lustre/osp/osp.o 0xffffffffa10f5000 add-symbol-file </div>
<div>> lustre/mdd/mdd.o 0xffffffffa0b12000 add-symbol-file lustre/lod/lod.o </div>
<div>> 0xffffffffa109f000 add-symbol-file lustre/mdt/mdt.o 0xffffffffa0fe7000 </div>
<div>> add-symbol-file lustre/mgs/mgs.o 0xffffffffa08c9000 add-symbol-file </div>
<div>> lustre/lfsck/lfsck.o 0xffffffffa0f17000 add-symbol-file </div>
<div>> lustre/ost/ost.o 0xffffffffa018c000 add-symbol-file lustre/mgc/mgc.o </div>
<div>> 0xffffffffa0ef9000 add-symbol-file lustre/quota/lquota.o </div>
<div>> 0xffffffffa0dfc000 add-symbol-file lustre/llite/lustre.o </div>
<div>> 0xffffffffa0ce2000 add-symbol-file lustre/lov/lov.o 0xffffffffa0c66000 </div>
<div>> add-symbol-file lustre/mdc/mdc.o 0xffffffffa0c25000 add-symbol-file </div>
<div>> lustre/fid/fid.o 0xffffffffa0c07000 add-symbol-file lustre/lmv/lmv.o </div>
<div>> 0xffffffffa0bbc000 add-symbol-file lustre/fld/fld.o 0xffffffffa0b9d000 </div>
<div>> add-symbol-file lnet/klnds/socklnd/ksocklnd.o 0xffffffffa0b64000 </div>
<div>> add-symbol-file lustre/ptlrpc/ptlrpc.o 0xffffffffa0923000 </div>
<div>> add-symbol-file lustre/obdclass/obdclass.o 0xffffffffa06e4000 </div>
<div>> add-symbol-file lnet/lnet/lnet.o 0xffffffffa067b000 add-symbol-file </div>
<div>> libcfs/libcfs/libcfs.o 0xffffffffa05e1000 add-symbol-file </div>
<div>> ldiskfs/ldiskfs.o 0xffffffffa055d000 lctl > lustre_build_version </div>
<div>> Lustre version: 2.6.0-RC2--PRISTINE-2.6.32-431.20.3.el6_lustre.x86_64</div>
<div>> lctl version: 2.6.0-RC2--PRISTINE-2.6.32-431.20.3.el6_lustre.x86_64</div>
<div>> </div>
<div>> </div>
<div>> </div>
<div>> </div>
<div>> ]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]</div>
<div>> ]] ==================================================</div>
<div>> </div>
<div>> On MGS Server</div>
<div>> ====================================================</div>
<div>> </div>
<div>> [root@MGS ~]# lctl ping <a href="mailto:10.177.33.9@tcp">10.177.33.9@tcp</a> 12345-0@lo </div>
<div>> <a href="mailto:12345-10.177.33.9@tcp">12345-10.177.33.9@tcp</a> [root@MGS ~]# lctl ping <a href="mailto:10.177.33.22@tcp">10.177.33.22@tcp</a> </div>
<div>> 12345-0@lo <a href="mailto:12345-10.177.33.22@tcp">12345-10.177.33.22@tcp</a> [root@MGS ~]# cat </div>
<div>> /proc/fs/lustre/mgs/MGS/live/*</div>
<div>> fsname: client1</div>
<div>> flags: 0x20 gen: 5</div>
<div>> client1-OST0000</div>
<div>> </div>
<div>> Secure RPC Config Rules:</div>
<div>> </div>
<div>> imperative_recovery_state:</div>
<div>> state: full</div>
<div>> nonir_clients: 0</div>
<div>> nidtbl_version: 3</div>
<div>> notify_duration_total: 0.000000</div>
<div>> notify_duation_max: 0.000000</div>
<div>> notify_count: 1</div>
<div>> fsname: params</div>
<div>> flags: 0x21 gen: 1</div>
<div>> </div>
<div>> Secure RPC Config Rules:</div>
<div>> </div>
<div>> imperative_recovery_state:</div>
<div>> state: full</div>
<div>> nonir_clients: 0</div>
<div>> nidtbl_version: 2</div>
<div>> notify_duration_total: 0.000000</div>
<div>> notify_duation_max: 0.000000</div>
<div>> notify_count: 0</div>
<div>> fsname: temp</div>
<div>> flags: 0x20 gen: 7</div>
<div>> temp-MDT0000</div>
<div>> </div>
<div>> Secure RPC Config Rules:</div>
<div>> </div>
<div>> imperative_recovery_state:</div>
<div>> state: full</div>
<div>> nonir_clients: 0</div>
<div>> nidtbl_version: 4</div>
<div>> notify_duration_total: 0.000000</div>
<div>> notify_duation_max: 0.000000</div>
<div>> notify_count: 1</div>
<div>> </div>
<div>> </div>
<div>> lctl > lustre_build_version</div>
<div>> Lustre version: 2.6.0-RC2--PRISTINE-2.6.32-431.20.3.el6_lustre.x86_64</div>
<div>> lctl version: 2.6.0-RC2--PRISTINE-2.6.32-431.20.3.el6_lustre.x86_64</div>
<div>> lctl > modules</div>
<div>> add-symbol-file lustre/osp/osp.o 0xffffffffa10bc000 add-symbol-file </div>
<div>> lustre/mdd/mdd.o 0xffffffffa1057000 add-symbol-file lustre/lod/lod.o </div>
<div>> 0xffffffffa0fed000 add-symbol-file lustre/mdt/mdt.o 0xffffffffa0f0d000 </div>
<div>> add-symbol-file lustre/lfsck/lfsck.o 0xffffffffa0e97000 </div>
<div>> add-symbol-file lustre/mgs/mgs.o 0xffffffffa0e3c000 add-symbol-file </div>
<div>> lustre/mgc/mgc.o 0xffffffffa0e10000 add-symbol-file </div>
<div>> lustre/quota/lquota.o 0xffffffffa0d13000 add-symbol-file </div>
<div>> ldiskfs/ldiskfs.o 0xffffffffa0c8f000 add-symbol-file </div>
<div>> lustre/llite/lustre.o 0xffffffffa0b75000 add-symbol-file </div>
<div>> lustre/lov/lov.o 0xffffffffa0af9000 add-symbol-file lustre/mdc/mdc.o </div>
<div>> 0xffffffffa0ab8000 add-symbol-file lustre/fid/fid.o 0xffffffffa0a9a000 </div>
<div>> add-symbol-file lustre/lmv/lmv.o 0xffffffffa0a4f000 add-symbol-file </div>
<div>> lustre/fld/fld.o 0xffffffffa0a38000 add-symbol-file </div>
<div>> lnet/klnds/socklnd/ksocklnd.o 0xffffffffa09ff000 add-symbol-file </div>
<div>> lustre/ptlrpc/ptlrpc.o 0xffffffffa07be000 add-symbol-file </div>
<div>> lustre/obdclass/obdclass.o 0xffffffffa057f000 add-symbol-file </div>
<div>> lnet/lnet/lnet.o 0xffffffffa0516000 add-symbol-file </div>
<div>> libcfs/libcfs/libcfs.o 0xffffffffa047c000</div>
<div>> </div>
<div>> </div>
<div>> </div>
<div>> ]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]]</div>
<div>> ]]]]]]]]]]</div>
<div>> </div>
<div>> ====================================================</div>
<div>> Trying to Mount OST on the Client</div>
<div>> =====================================================</div>
<div>> </div>
<div>> [root@Client ~]# mount -t lustre <a href="mailto:10.177.33.10@tcp:/client1">10.177.33.10@tcp:/client1</a> /mnt/lustre</div>
<div>> mount.lustre: mount <a href="mailto:10.177.33.10@tcp:/client1">10.177.33.10@tcp:/client1</a> at /mnt/lustre failed: </div>
<div>> Invalid argument This may have multiple causes.</div>
<div>> Is 'client1' the correct filesystem name?</div>
<div>> Are the mount options correct?</div>
<div>> Check the syslog for more info.</div>
<div>> </div>
<div>> [root@client ~]# lctl ping <a href="mailto:10.177.33.10@tcp">10.177.33.10@tcp</a> 12345-0@lo </div>
<div>> <a href="mailto:12345-10.177.33.10@tcp">12345-10.177.33.10@tcp</a> [root@client ~]# lctl ping <a href="mailto:10.177.33.22@tcp">10.177.33.22@tcp</a> </div>
<div>> 12345-0@lo <a href="mailto:12345-10.177.33.22@tcp">12345-10.177.33.22@tcp</a></div>
<div>> </div>
<div>> </div>
<div>> [root@client ~]# lctl</div>
<div>> lctl > lustre_build_version</div>
<div>> Lustre version: 2.6.0-RC2--PRISTINE-2.6.32-431.20.3.el6.x86_64</div>
<div>> lctl version: 2.6.0-RC2--PRISTINE-2.6.32-431.20.3.el6.x86_64</div>
<div>> lctl > modules</div>
<div>> add-symbol-file lustre/osc/osc.o 0xffffffffa1212000</div>
<div>> add-symbol-file lustre/mgc/mgc.o 0xffffffffa11f4000</div>
<div>> add-symbol-file lustre/llite/lustre.o 0xffffffffa10da000</div>
<div>> add-symbol-file lustre/lov/lov.o 0xffffffffa105e000</div>
<div>> add-symbol-file lustre/mdc/mdc.o 0xffffffffa101d000</div>
<div>> add-symbol-file lustre/fid/fid.o 0xffffffffa100f000</div>
<div>> add-symbol-file lustre/lmv/lmv.o 0xffffffffa0fc4000</div>
<div>> add-symbol-file lustre/fld/fld.o 0xffffffffa0fb3000</div>
<div>> add-symbol-file lustre/ptlrpc/ptlrpc.o 0xffffffffa0e0b000</div>
<div>> add-symbol-file lustre/obdclass/obdclass.o 0xffffffffa0bff000</div>
<div>> add-symbol-file lnet/klnds/socklnd/ksocklnd.o 0xffffffffa08f8000</div>
<div>> add-symbol-file lnet/lnet/lnet.o 0xffffffffa04db000</div>
<div>> add-symbol-file libcfs/libcfs/libcfs.o 0xffffffffa0441000</div>
<div>> </div>
<div>> This e-mail, including attachments, may include confidential and/or</div>
<div>> proprietary information, and may be used only by the person or entity</div>
<div>> to which it is addressed. If the reader of this e-mail is not the intended</div>
<div>> recipient or his or her authorized agent, the reader is hereby notified</div>
<div>> that any dissemination, distribution or copying of this e-mail is</div>
<div>> prohibited. If you have received this e-mail in error, please notify the</div>
<div>> sender by replying to this message and delete this e-mail immediately.</div>
<div>> </div>
<div>> </div>
<div>> _______________________________________________</div>
<div>> Lustre-discuss mailing list</div>
<div>> <a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a></div>
<div>> <a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a></div>
<div>> </div>
<div>> </div>
<div>> </div>
<div>> </div>
<div>> --</div>
<div>> Jongwoo Han</div>
<div>> Principal consultant</div>
<div>> <a href="mailto:jw.han@apexcns.com">jw.han@apexcns.com</a></div>
<div>> Tel: +82- 2-3413-1704</div>
<div>> Mobile:+82-505-227-6108</div>
<div>> Fax: : +82- 2-544-7962</div>
<div>> </div>
<div>> This e-mail, including attachments, may include confidential and/or</div>
<div>> proprietary information, and may be used only by the person or entity</div>
<div>> to which it is addressed. If the reader of this e-mail is not the intended</div>
<div>> recipient or his or her authorized agent, the reader is hereby notified</div>
<div>> that any dissemination, distribution or copying of this e-mail is</div>
<div>> prohibited. If you have received this e-mail in error, please notify the</div>
<div>> sender by replying to this message and delete this e-mail immediately.</div>
<div>> </div>
<div>> _______________________________________________</div>
<div>> Lustre-discuss mailing list</div>
<div>> <a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a></div>
<div>> <a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a></div>
<div>> </div>
<div>> </div>
<div>> This e-mail, including attachments, may include confidential and/or</div>
<div>> proprietary information, and may be used only by the person or entity</div>
<div>> to which it is addressed. If the reader of this e-mail is not the intended</div>
<div>> recipient or his or her authorized agent, the reader is hereby notified</div>
<div>> that any dissemination, distribution or copying of this e-mail is</div>
<div>> prohibited. If you have received this e-mail in error, please notify the</div>
<div>> sender by replying to this message and delete this e-mail immediately.</div>
<div>> </div>
<div>> _______________________________________________</div>
<div>> Lustre-discuss mailing list</div>
<div>> <a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a></div>
<div>> <a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a></div>
<div> </div>
<div> </div>
<div> </div>
<div> </div>
</span></font>
<p><br>
This e-mail, including attachments, may include confidential and/or<br>
proprietary information, and may be used only by the person or entity<br>
to which it is addressed. If the reader of this e-mail is not the intended<br>
recipient or his or her authorized agent, the reader is hereby notified<br>
that any dissemination, distribution or copying of this e-mail is<br>
prohibited. If you have received this e-mail in error, please notify the<br>
sender by replying to this message and delete this e-mail immediately.</p></body>
</html>