[lustre-discuss] Lustre poor performance

[Mohr Jr, Richard Frank (Rick Mohr)]

> On Aug 22, 2017, at 7:14 PM, Riccardo Veraldi <Riccardo.Veraldi at cnaf.infn.it> wrote:
> 
> On 8/22/17 9:22 AM, Mannthey, Keith wrote:
>> Younot expected.
>> 
> yes they are automatically used on my Mellanox and the script ko2iblnd-probe seems like not working properly.

The ko2iblnd-probe script looks in /sys/class/infiniband for device names starting with “hfi” or “qib”.  If it detects those, it decides that the “profile” it should use is “opa” so then it basically invokes the ko2iblnd-opa modprobe line.  But the script has no logic to detect other types of card (i.e. - mellanox), so in those cases, no ko2iblnd options are used and you end up with the default module parameters being used.

If you want to use the script, you will need to modify ko2iblnd-probe to add a new case for your brand of HCA and then add an appropriate ko2iblnd-<profile> line to ko2iblnd.conf.

Or just do what I did and comment out all the lines in ko2iblnd.conf and add your own lines.

--
Rick Mohr
Senior HPC System Administrator
National Institute for Computational Sciences
http://www.nics.tennessee.edu