[Lustre-discuss] samba+lustre

[Papp Tamas]

On Wed, Apr 23, 2008 at 03:05:58PM -0600, Andreas Dilger wrote:
> On Apr 22, 2008  17:39 +0200, Papp Tam???s wrote:
> > I have still samba problems.
> > 
> > After a while I see D processes, and all samba share get stucked.
> > 
> > In the syslog I see:
> > 
> > Apr 22 15:02:39 samba kernel: Call Trace:
> > Apr 22 15:02:39 samba kernel:  <IRQ> [<ffffffff8020e007>] 
> > __alloc_pages+0x2b8/0x2d1
> > Apr 22 15:02:39 samba kernel:  [<ffffffff80215554>] cache_grow+0x136/0x343
> > Apr 22 15:02:39 samba kernel:  [<ffffffff8025676e>] 
> > cache_alloc_refill+0x18f/0x1e0
> > Apr 22 15:02:39 samba kernel:  [<ffffffff802b47e8>] __kmalloc+0x8a/0x94
> > Apr 22 15:02:39 samba kernel:  [<ffffffff8022bef6>] __alloc_skb+0x5c/0x123
> > Apr 22 15:02:39 samba kernel:  [<ffffffff88016945>] 
> > :forcedeth:nv_alloc_rx+0x5f/0x183
> > Apr 22 15:02:39 samba kernel:  [<ffffffff88016e72>] 
> > :forcedeth:nv_nic_irq+0x96/0x1bc
> 
> This is a thread stuck in memory allocation due to network IRQ handling.
> Are you running out of memory on the node?  Are you running the Samba
> server on a client which is also running an OST?

This machine is only a client with samba, it's not an OST, cluster node.

> > Apr 22 15:02:39 samba kernel: Node 0 HighMem per-cpu: empty
> > Apr 22 15:02:39 samba kernel: Free pages:        5396kB (0kB HighMem)
> > Apr 22 15:02:39 samba kernel: Active:11863 inactive:214810 dirty:96874 
> > writeback:76 unstable:0 free:1349 slab:23053 mapped:2414 pagetables:1675
> > Apr 22 15:02:39 samba kernel: Node 0 DMA free:3992kB min:48kB low:60kB 
> > high:72kB active:2380kB inactive:5132kB present:12356kB pages_scanned:32 
> > all_unreclaimable? no
> > Apr 22 15:02:39 samba kernel: lowmem_reserve[]: 0 993 993 993
> > Apr 22 15:02:39 samba kernel: Node 0 DMA32 free:1404kB min:4004kB 
> > low:5004kB high:6004kB active:45072kB inactive:854108kB 
> > present:1017200kB pages_scanned:0 all_unreclaimable? no
> > Apr 22 15:02:39 samba kernel: lowmem_reserve[]: 0 0 0 0
> > Apr 22 15:02:39 samba kernel: Node 0 Normal free:0kB min:0kB low:0kB 
> > high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 
> > all_unreclaimable? no
> > Apr 22 15:02:39 samba kernel: lowmem_reserve[]: 0 0 0 0
> > Apr 22 15:02:39 samba kernel: Node 0 HighMem free:0kB min:128kB 
> > low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 
> > all_unreclaimable? no
> 
> Hmm, it appears there is no free memory for normal or highmem allocation.


> 
> > Apr 22 15:02:39 samba kernel: lowmem_reserve[]: 0 0 0 0
> > Apr 22 15:02:39 samba kernel: Node 0 DMA: 0*4kB 1*8kB 1*16kB 0*32kB 
> > 0*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3992kB
> > Apr 22 15:02:39 samba kernel: Node 0 DMA32: 1*4kB 1*8kB 1*16kB 1*32kB 
> > 1*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1404kB
> > Apr 22 15:02:39 samba kernel: Node 0 Normal: empty
> > Apr 22 15:02:39 samba kernel: Node 0 HighMem: empty
> > Apr 22 15:02:39 samba kernel: Swap cache: add 22, delete 22, find 0/0, 
> > race 0+0
> > Apr 22 15:02:39 samba kernel: Free swap  = 1959832kB
> > Apr 22 15:02:39 samba kernel: Total swap = 1959920kB
> > Apr 22 15:02:39 samba kernel: Free swap:       1959832kB
> > Apr 22 15:02:39 samba kernel: 261920 pages of RAM

With free and top I didn't see out of memory, but I check it again.

The most strange thing about this, that this is an opteron with
'server main board', but if I move the HDD to a desktop box with AX2
processor, it looks like, it'working.


Does this mean is there something wrong about drivers?


Thank you,

tamas