[Lustre-discuss] Kernel panics while mounting OSTs

[Isaac Huang]

On Wed, Mar 25, 2009 at 04:47:21PM -0700, Adam Gandelman wrote:
> Hi list-
> ......
> On all nodes: Linux 2.6.18-92.1.10.el5_lustre.1.6.6smp #1 SMP Tue Aug 26 
> 12:05:09 EDT 2008 i686 i686 i386 GNU/Linux
> 
> BUG: soft lockup - CPU#0 stuck for 10s [socknal_cd00:2785]

It smells to me like an aftermath of a previous error, like a LASSERT
failure inside a spinlock. Could you look at the syslogs (assuming
that kernel printks are logged) before the soft lockup happened for
something fishy? That'd give some context.

Thanks,
Isaac

> esi: c048bd14   edi: d303403c   ebp: d3034000   esp: d1279df8
> ds: 007b        es: 007b        ss:0068
> Process socknal_cd00 (pid:2776, ti=d1278000 task=df195550 task.ti=d1278000)
> Stack:  c063858a d5b74d44 83010183 d3034000 d5b74d40 d3947180 e0d8fc20 
> d1255400
>         00000000 00000000 00000000 00000005 00000005 0000000e 00000001 
> 00000000
>         d1269240 00000000 d1269240 e0d86854 00000000 d1279f00 d1279f00 
> 00001388
> Call Trace:
> [<e0d8fc20>] ksocknal_read_callback+0x100/0x270 [ksocklnd]
> [<e0d86854>] ksocknal_create_conn+0x19a4/0x1f90 [ksocklnd]
> [<e0b66b31>] libcfs_sock_write+0xb1/0x3a0 [libcfs]
> [<c0483471>] __posix_lock_file_conf+0x431/0x48e
> [<e0e2c641>] lnet_connect+0xb1/0x150 [lnet]
> [<e0d89ee4>] ksocknal_connect+0x124/0x540 [ksocklnd]
> [<e0d8f792>] ksocknal_connd+0x2a2/0x400 [ksocklnd]
> [<c044b863>] audit_syscall_exit+0x2cc/0x2e2
> [<c043631d>] autoremove_wake_function+0x0/0x2d
> [<e0d8f4f0>] ksocknal_connd+0x0/0x400 [ksocklnd]
> [<c0405c0f>] kernel_thread_helper+0x7/0x10
> ========================
> 
> Code: 74 17 50 52 68 4d 85 63 c0 e8 f6 eb f3 ff 0f 0b 1a 00 ff 84 63 c0 
> 82 c4 0c 8b 06 39 d8 74 17 50 53 68 8a 85 63 c0 e8 d9 eb f3 ff <0f> 0b 
> 1f 00 ff 84 63 c0 83 c4 0c 89 7b 04 89 1f 89 77 04 89 3
> 
> EIP: [<c04e7d9d>] __list_add+0x39/0x52 SS:ESP 0068:d1279df8
> <0>Kernel panic - not syncing: Fatal exception in interrupt