Hi,
I'm trying to find the correct settings for OFED kernel parameter for the
cluster. Each node has 32G RAM, installed Red Hat Enterprise Linux
Server release 6.4 (Santiago) , OFED 2.1.192, OpenMPI 1.6.5 and
Mellanox Technologies MT27500 Family [ConnectX-3] with 56G actived.
lsmod showed these modules were loaded
mlx5_ib 103294 0
mlx5_core 85297 1 mlx5_ib
mlx4_en 117925 0
mlx4_ib 164865 1
mlx4_core 258183 2 mlx4_en,mlx4_ib
And I made these settings for /etc/depmod.d/mlx4_en.conf
options mlx4_core log_num_mtt=23 log_mtts_per_seg=1
Checked log_mtts_per_seg and log_num_mtt used by kernel with
these commands
cat /sys/module/mlx4_core/parameters/log_mtts_per_seg
0
cat /sys/module/mlx4_core/parameters/log_num_mtt
24
It looked like the log_mtts_per_seg and log_num_mtt were set by
certain conf file instead by mlx4_en.conf
My questions are
1. Why does it need to load both of mlx4 and mlx5 for 56G IB?
2. Which conf file controls the OFED 2.1.192 kernel paramters for
Mellanox 56G ConnectX-3?
3. Any special settings for Mellanox 56G IB with OFED 2.1.192?
Thank you for your time
and appreciate your kindly help
Regards
Jerry
