Check out my first novel, midnight's simulacra!
Mellanox: Difference between revisions
From dankwiki
(Created page with "ConnectX is <tt>mlx4</tt> (Ethernet/Infiniband), while Connect-IB is <tt>mlx5</tt> (Infiniband only).") |
No edit summary |
||
| (4 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
ConnectX is <tt>mlx4</tt> ([[Ethernet]]/ | ConnectX is <tt>mlx4</tt> ([[Ethernet]]/[[InfiniBand]]) for ConnectX-3, or <tt>mlx5</tt> for ConnectX-4 and above. | ||
Connect-IB is <tt>mlx5</tt> (Infiniband only). | |||
==Setting Ethernet mode in the firmware== | |||
The default link protocol for at least ConnectX-4 is Infiniband. Changing this requires <tt>mlxconfig</tt> from the MLNX_OFED package's <tt>mft</tt> deb. <tt>mlxconfig</tt> requires <tt>mft</tt> to be running (which requires the <tt>mst_pci</tt> kernel module); <tt>/dev/mst</tt> will be populated once this has happened. This device is in Infiniband mode: | |||
<pre> | |||
[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 query | grep LINK_TYPE | |||
LINK_TYPE_P1 IB(1) | |||
[strangelet](0) $ | |||
</pre> | |||
...and here we change it to Ethernet (type 2): | |||
<pre> | |||
[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 set LINK_TYPE_P1=2 | |||
Device #1: | |||
---------- | |||
Device type: ConnectX4 | |||
Name: N/A | |||
Description: N/A | |||
Device: /dev/mst/mt4115_pciconf0 | |||
Configurations: Next Boot New | |||
LINK_TYPE_P1 IB(1) ETH(2) | |||
Apply new Configuration? (y/n) [n] : y | |||
Applying... Done! | |||
-I- Please reboot machine to load new configurations. | |||
[strangelet](0) $ | |||
</pre> | |||
==See also== | |||
* [https://www.mellanox.com/support/firmware/firmware-downloads Firmware download] page. Firmware version can be acquired with <tt>ethtool -i IFACE</tt>. | |||
Latest revision as of 07:53, 14 March 2023
ConnectX is mlx4 (Ethernet/InfiniBand) for ConnectX-3, or mlx5 for ConnectX-4 and above.
Connect-IB is mlx5 (Infiniband only).
Setting Ethernet mode in the firmware
The default link protocol for at least ConnectX-4 is Infiniband. Changing this requires mlxconfig from the MLNX_OFED package's mft deb. mlxconfig requires mft to be running (which requires the mst_pci kernel module); /dev/mst will be populated once this has happened. This device is in Infiniband mode:
[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 query | grep LINK_TYPE
LINK_TYPE_P1 IB(1)
[strangelet](0) $
...and here we change it to Ethernet (type 2):
[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 set LINK_TYPE_P1=2
Device #1:
----------
Device type: ConnectX4
Name: N/A
Description: N/A
Device: /dev/mst/mt4115_pciconf0
Configurations: Next Boot New
LINK_TYPE_P1 IB(1) ETH(2)
Apply new Configuration? (y/n) [n] : y
Applying... Done!
-I- Please reboot machine to load new configurations.
[strangelet](0) $
See also
- Firmware download page. Firmware version can be acquired with ethtool -i IFACE.
