<div dir="ltr">yep! you're right...<br><br><div class="gmail_quote">On Mon, Feb 21, 2011 at 11:19 PM, Albert Everett <span dir="ltr"><<a href="mailto:aeeverett@ualr.edu">aeeverett@ualr.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
Here's all we needed. Yours is probably similar.<br>
<br>
# cat /etc/sysconfig/network-scripts/ifcfg-ib0<br>
DEVICE=ib0<br>
IPADDR=192.168.2.1<br>
NETMASK=255.255.255.0<br>
BOOTPROTO=static<br>
ONBOOT=yes<div><div></div><div class="h5"><br>
<br>
On Feb 21, 2011, at 1:17 PM, Arya Mazaheri wrote:<br>
<br>
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
problem solved. I was trying to set the IP of ib0 by this command:<br>
ifconfig ib0 192.168.1.1 netmask 255.255.255.0 up<br>
<br>
but, it leads to the kernel panic. So I tried to set the IP address by adding to network-scripts. So, it works now...<br>
I really don't know why setting IP with ifconfig doesn't work. So weird...<br>
<br>
<br>
On Mon, Feb 21, 2011 at 7:31 PM, Albert Everett <<a href="mailto:aeeverett@ualr.edu" target="_blank">aeeverett@ualr.edu</a>> wrote:<br>
What's output of<br>
<br>
# ifconfig ib0<br>
<br>
Albert<br>
<br>
<br>
On Feb 21, 2011, at 6:27 AM, Arya Mazaheri wrote:<br>
<br>
Hi there,<br>
I have configured and ran lustre 2.0 with tcp (OSS and MDS on on the same server) without problem. Now I am trying to run lustre with infiniband support. but whenever I mount the mdt storage on server, the process ends with following error:<br>
kernel panic - not syncing: fatal exception<br>
<br>
my /etc/modprobe.conf is:<br>
options lnet networks="o2ib0(ib0)"<br>
<br>
last lines of dmesg:<br>
----------------------------------------------------<br>
kjournald starting. Commit interval 5 seconds<br>
LDISKFS-fs warning: maximal mount count reached, running e2fsck is recommended<br>
LDISKFS FS on sda2, internal journal<br>
LDISKFS-fs: recovery complete.<br>
LDISKFS-fs: mounted filesystem with ordered data mode.<br>
kjournald starting. Commit interval 5 seconds<br>
LDISKFS-fs warning: maximal mount count reached, running e2fsck is recommended<br>
LDISKFS FS on sda2, internal journal<br>
LDISKFS-fs: mounted filesystem with ordered data mode.<br>
LustreError: 6041:0:(o2iblnd.c:2501:kiblnd_startup()) Can't query IPoIB interface ib0: it's down<br>
LustreError: 6041:0:(o2iblnd.c:2501:kiblnd_startup()) Skipped 1 previous similar message<br>
eth0: no IPv6 routers present<br>
LustreError: 105-4: Error -100 starting up LNI o2ib<br>
LustreError: Skipped 1 previous similar message<br>
LustreError: 6041:0:(events.c:731:ptlrpc_init_portals()) network initialisation failed<br>
LustreError: 158-c: Can't load module 'mgs'<br>
LustreError: 6035:0:(genops.c:286:class_newdev()) OBD: unknown type: mgs<br>
LustreError: 6035:0:(obd_config.c:300:class_attach()) Cannot create device MGS of type mgs : -19<br>
LustreError: 6035:0:(obd_mount.c:502:lustre_start_simple()) MGS attach error -19<br>
LustreError: 15e-a: Failed to start MGS 'MGS' (-19). Is the 'mgs' module loaded?<br>
LustreError: 6035:0:(obd_mount.c:1492:server_put_super()) no obd lustre-MDTffff<br>
LustreError: 6035:0:(obd_mount.c:137:server_deregister_mount()) lustre-MDTffff not registered<br>
Lustre: server umount lustre-MDTffff complete<br>
LustreError: 6035:0:(obd_mount.c:2136:lustre_fill_super()) Unable to mount (-19)<br>
kjournald starting. Commit interval 5 seconds<br>
LDISKFS-fs warning: maximal mount count reached, running e2fsck is recommended<br>
LDISKFS FS on sdb1, internal journal<br>
LDISKFS-fs: mounted filesystem with ordered data mode.<br>
kjournald starting. Commit interval 5 seconds<br>
LDISKFS-fs warning: maximal mount count reached, running e2fsck is recommended<br>
LDISKFS FS on sdb1, internal journal<br>
LDISKFS-fs: mounted filesystem with ordered data mode.<br>
LDISKFS-fs: file extents enabled<br>
LDISKFS-fs: mballoc enabled<br>
LustreError: 6117:0:(events.c:731:ptlrpc_init_portals()) network initialisation failed<br>
LDISKFS-fs: mballoc: 0 blocks 0 reqs (0 success)<br>
LDISKFS-fs: mballoc: 0 extents scanned, 0 goal hits, 0 2^N hits, 0 breaks, 0 lost<br>
LDISKFS-fs: mballoc: 0 generated and it took 0<br>
LDISKFS-fs: mballoc: 0 preallocated, 0 discarded<br>
kjournald starting. Commit interval 5 seconds<br>
LDISKFS-fs warning: maximal mount count reached, running e2fsck is recommended<br>
LDISKFS FS on sdb2, internal journal<br>
LDISKFS-fs: mounted filesystem with ordered data mode.<br>
kjournald starting. Commit interval 5 seconds<br>
LDISKFS-fs warning: maximal mount count reached, running e2fsck is recommended<br>
LDISKFS FS on sdb2, internal journal<br>
LDISKFS-fs: mounted filesystem with ordered data mode.<br>
LDISKFS-fs: file extents enabled<br>
LDISKFS-fs: mballoc enabled<br>
LustreError: 6193:0:(events.c:731:ptlrpc_init_portals()) network initialisation failed<br>
LDISKFS-fs: mballoc: 0 blocks 0 reqs (0 success)<br>
LDISKFS-fs: mballoc: 0 extents scanned, 0 goal hits, 0 2^N hits, 0 breaks, 0 lost<br>
LDISKFS-fs: mballoc: 0 generated and it took 0<br>
LDISKFS-fs: mballoc: 0 preallocated, 0 discarded<br>
kjournald starting. Commit interval 5 seconds<br>
LDISKFS-fs warning: maximal mount count reached, running e2fsck is recommended<br>
LDISKFS FS on sdb3, internal journal<br>
LDISKFS-fs: mounted filesystem with ordered data mode.<br>
kjournald starting. Commit interval 5 seconds<br>
LDISKFS-fs warning: maximal mount count reached, running e2fsck is recommended<br>
LDISKFS FS on sdb3, internal journal<br>
LDISKFS-fs: mounted filesystem with ordered data mode.<br>
LDISKFS-fs: file extents enabled<br>
LDISKFS-fs: mballoc enabled<br>
LustreError: 6269:0:(o2iblnd.c:2501:kiblnd_startup()) Can't query IPoIB interface ib0: it's down<br>
LustreError: 6269:0:(o2iblnd.c:2501:kiblnd_startup()) Skipped 2 previous similar messages<br>
LustreError: 105-4: Error -100 starting up LNI o2ib<br>
LustreError: Skipped 2 previous similar messages<br>
LustreError: 6269:0:(events.c:731:ptlrpc_init_portals()) network initialisation failed<br>
LustreError: 158-c: Can't load module 'mgc'<br>
LustreError: Skipped 2 previous similar messages<br>
LustreError: 6263:0:(genops.c:286:class_newdev()) OBD: unknown type: mgc<br>
LustreError: 6263:0:(genops.c:286:class_newdev()) Skipped 2 previous similar messages<br>
LustreError: 6263:0:(obd_config.c:300:class_attach()) Cannot create device MGC0@lo of type mgc : -19<br>
LustreError: 6263:0:(obd_config.c:300:class_attach()) Skipped 2 previous similar messages<br>
LustreError: 6263:0:(obd_mount.c:502:lustre_start_simple()) MGC0@lo attach error -19<br>
LustreError: 6263:0:(obd_mount.c:502:lustre_start_simple()) Skipped 2 previous similar messages<br>
LustreError: 6263:0:(obd_mount.c:1492:server_put_super()) no obd lustre-OST0002<br>
LustreError: 6263:0:(obd_mount.c:1492:server_put_super()) Skipped 2 previous similar messages<br>
LustreError: 6263:0:(obd_mount.c:137:server_deregister_mount()) lustre-OST0002 not registered<br>
LustreError: 6263:0:(obd_mount.c:137:server_deregister_mount()) Skipped 2 previous similar messages<br>
LDISKFS-fs: mballoc: 0 blocks 0 reqs (0 success)<br>
LDISKFS-fs: mballoc: 0 extents scanned, 0 goal hits, 0 2^N hits, 0 breaks, 0 lost<br>
LDISKFS-fs: mballoc: 0 generated and it took 0<br>
LDISKFS-fs: mballoc: 0 preallocated, 0 discarded<br>
Lustre: server umount lustre-OST0002 complete<br>
Lustre: Skipped 2 previous similar messages<br>
LustreError: 6263:0:(obd_mount.c:2136:lustre_fill_super()) Unable to mount (-19)<br>
LustreError: 6263:0:(obd_mount.c:2136:lustre_fill_super()) Skipped 2 previous similar messages<br>
kjournald starting. Commit interval 5 seconds<br>
LDISKFS-fs warning: maximal mount count reached, running e2fsck is recommended<br>
LDISKFS FS on sdb4, internal journal<br>
LDISKFS-fs: mounted filesystem with ordered data mode.<br>
kjournald starting. Commit interval 5 seconds<br>
LDISKFS-fs warning: maximal mount count reached, running e2fsck is recommended<br>
LDISKFS FS on sdb4, internal journal<br>
LDISKFS-fs: mounted filesystem with ordered data mode.<br>
LDISKFS-fs: file extents enabled<br>
LDISKFS-fs: mballoc enabled<br>
LustreError: 6345:0:(events.c:731:ptlrpc_init_portals()) network initialisation failed<br>
LDISKFS-fs: mballoc: 0 blocks 0 reqs (0 success)<br>
LDISKFS-fs: mballoc: 0 extents scanned, 0 goal hits, 0 2^N hits, 0 breaks, 0 lost<br>
LDISKFS-fs: mballoc: 0 generated and it took 0<br>
LDISKFS-fs: mballoc: 0 preallocated, 0 discarded<br>
------------------------------------------------------------------------------------<br>
<br>
Any ideas?<br>
<br>
_______________________________________________<br>
Lustre-discuss mailing list<br>
<a href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
<br>
<br>
</blockquote>
<br>
</div></div></blockquote></div><br></div>