[Lustre-discuss] Lustre over o2ib issue
Nirmal Seenu
nirmal at fnal.gov
Wed Mar 16 12:10:05 PDT 2011
If you are using DDR and QDR or any 2 different cards cards in the same machine there is no guarantee that the same IB cards get assigned to ib0 and ib.
To fix that problem you need to comment out the following 3 lines /etc/init.d/openibd:
#for i in `grep "^driver: " /etc/sysconfig/hwconf | sed -e 's/driver: //' | grep -w "ib_mthca\\\|ib_ipath\\\|mlx4_core\\\|cxgb3\\\|iw_nes"`; do
# load_modules $i
#done
and include the following lines instead(we wanted the DDR card to be ib0 and the QDR card to be ib1):
load_modules ib_mthca
/bin/sleep 10
load_modules mlx4_core
and you will need to restart openibd once again (we included it in rc.local) to make sure that the same IB cards are assigned to the devices ib0 and ib1.
Nirmal
More information about the lustre-discuss
mailing list