<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
Hi,<div><br class="webkit-block-placeholder"></div><div>What Kernel version you are using for your production Lustre? Is it pre-patched 2.6.9-55.0.9.EL_lustre.1.6.3smp ?</div><div>We had very similar problem with bnx2 driver on old kernel 2.6.9. Upgrading kernel to latest version helped. The bnx2 issue is mentioned in the kernel's release notes.</div><div><br class="webkit-block-placeholder"></div><div>Best regards,</div><div><br class="webkit-block-placeholder"></div><div>Wojciech</div><div><div><div>On 7 Nov 2007, at 15:19, Matt wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite">I think you guys are spot on, this client is running on a Dell 1950.<br><br>I'm in the process of rebuilding the box with the Centos 5 kernel along with the source so I can patch it with lustre to build my own kernel and obviously build the bnx2 driver. <br><br>I would obviously rather just use the lustre rpm's like I have been doing, but was unable to build the bnx2 driver against the lustre kernel source. I'm guessing because it's not complete.<br><br>If anyone knows any different then please say so. <br><br>Cheers,<br><br>Matt<br><br><div><span class="gmail_quote">On 07/11/2007, <b class="gmail_sendername">Balagopal Pillai</b> <<a href="mailto:pillai@mathstat.dal.ca">pillai@mathstat.dal.ca</a>> wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"> Hi,<br><br> Looks like the broadcom driver issue to me too. I had the<br>similar problem with kernel panic<br>for the Lustre kernel on Dell pe1950 with Centos 4.5 and updating the<br>bnx2 driver solved the issue. <br>Also the interface has the tendency to drop frames. Increasing the rx<br>ring parameters with ethtool<br>fixes that problem.<br><br><br>Regards<br>Balagopal<br><br>Bernd Schubert wrote:<br>> Hi Matt,<br>><br>> On Wednesday 07 November 2007 12:50:32 Matt wrote: <br>><br>>> Hi folks,<br>>><br>>> Built servers with Centos 5, and installed the lustre rhel5_x86 rpms<br>>> successfully, modified grub and booted in to the new kernel.<br>>><br>>> Configured a mgs/mdt two OSTs and a client. <br>>><br>>> Now when running iozone from the client I always receive a kernel panic in<br>>> the lines of:<br>>><br>>> Call trace: <IRQ> [<ffffffff88149e4b>] : bnx2:bnx2_start_xmt+0x49/0x4d8 <br>>> Code: 49 8b 85 e8 00 00 00<br>>> RIP [<ffffffff88146e91>] : bnx2:bnx2_poll+0xf7/0xb75 RSP <......><br>>> CR2: 0.....<br>>> <0> Kernel Panic - not syncing : Fatal Exception <br>>><br>>> I have attached a screenshot.<br>>><br>>> When I bounce the client and remount I can access the lustre fs fine, seems<br>>> to be purely a client issue.<br>>><br>>> Any ideas? <br>>><br>><br>> looks very much like a bug in the broadcom nx2 driver. I would send it to<br>> linux-netdev. And as a first try I would check whats happens when you disable<br>> MSI for this driver.<br> ><br>> Cheers,<br>> Bernd<br>><br>><br>><br>><br><br>_______________________________________________<br>Lustre-discuss mailing list<br><a href="mailto:Lustre-discuss@clusterfs.com">Lustre-discuss@clusterfs.com </a><br><a href="https://mail.clusterfs.com/mailman/listinfo/lustre-discuss">https://mail.clusterfs.com/mailman/listinfo/lustre-discuss</a><br></blockquote></div><br><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">_______________________________________________</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">Lustre-discuss mailing list</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><a href="mailto:Lustre-discuss@clusterfs.com">Lustre-discuss@clusterfs.com</a></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><a href="https://mail.clusterfs.com/mailman/listinfo/lustre-discuss">https://mail.clusterfs.com/mailman/listinfo/lustre-discuss</a></div> </blockquote></div><br><div> <span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0; "><div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Lucida Grande" size="3" style="font: 11.0px Lucida Grande">Mr Wojciech Turek</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 11px/normal Lucida Grande; min-height: 13px; ">Assistant System Manager</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Lucida Grande" size="3" style="font: 11.0px Lucida Grande">University of Cambridge</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Lucida Grande" size="3" style="font: 11.0px Lucida Grande">High Performance Computing service </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font class="Apple-style-span" face="'Lucida Grande'" size="3"><span class="Apple-style-span" style="font-size: 11px;">email: <a href="mailto:wjt27@cam.ac.uk">wjt27@cam.ac.uk</a></span></font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Lucida Grande" size="3" style="font: 11.0px Lucida Grande">tel. +441223763517</font></div></div><div><br class="webkit-block-placeholder"></div></span><br class="Apple-interchange-newline"></span></span> </div><br></div></body></html>