[Lustre-discuss] Performance drop (1.6.5 vs 1.6.4.3, OFED 1.2)?

[Andreas Dilger]

On Jul 02, 2008  10:18 +0200, Andrei Maslennikov wrote:
> One single thread writing over Infiniband (with RHEL4-supplied OFED 1.2++).
> 
> lmdd of=/lustre/testX bs=1M time=20 fsync=1
> 
> Lustre 1.6.4.3 -  AMD 2210 (4 cores) - 396 MB/sec (official kernel)
> Lustre 1.6.5   -  AMD 2210  (4 cores) - 169 MB/sec (official kernel)
> Lustre 1.6.5   -  AMD 2210  (4 cores) - 165 MB/sec (patchless client)
> 
> Lustre 1.6.4.3 - AMD 2354 (8 cores) - 725 MB/sec
> Lustre 1.6.5   - AMD 2354 (8 cores) - 246 MB/sec

Can you try disabling checksumming on the client:

	lctl set_param osc.*.checksums=0

Cheers, Andreas
--
Andreas Dilger
Sr. Staff Engineer, Lustre Group
Sun Microsystems of Canada, Inc.