Check out my first novel, midnight's simulacra!

Mellanox: Difference between revisions

From dankwiki
(Created page with "ConnectX is <tt>mlx4</tt> (Ethernet/Infiniband), while Connect-IB is <tt>mlx5</tt> (Infiniband only).")
 
No edit summary
 
(4 intermediate revisions by the same user not shown)
Line 1: Line 1:
ConnectX is <tt>mlx4</tt> ([[Ethernet]]/Infiniband), while Connect-IB is <tt>mlx5</tt> (Infiniband only).
ConnectX is <tt>mlx4</tt> ([[Ethernet]]/[[InfiniBand]]) for ConnectX-3, or <tt>mlx5</tt> for ConnectX-4 and above.
 
Connect-IB is <tt>mlx5</tt> (Infiniband only).
 
==Setting Ethernet mode in the firmware==
The default link protocol for at least ConnectX-4 is Infiniband. Changing this requires <tt>mlxconfig</tt> from the MLNX_OFED package's <tt>mft</tt> deb. <tt>mlxconfig</tt> requires <tt>mft</tt> to be running (which requires the <tt>mst_pci</tt> kernel module); <tt>/dev/mst</tt> will be populated once this has happened. This device is in Infiniband mode:
 
<pre>
[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 query | grep LINK_TYPE
        LINK_TYPE_P1                                IB(1)         
[strangelet](0) $
</pre>
 
...and here we change it to Ethernet (type 2):
 
<pre>
[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 set LINK_TYPE_P1=2
 
Device #1:
----------
 
Device type:    ConnectX4     
Name:          N/A           
Description:    N/A           
Device:        /dev/mst/mt4115_pciconf0
 
Configurations:                                      Next Boot      New
        LINK_TYPE_P1                                IB(1)          ETH(2)         
 
Apply new Configuration? (y/n) [n] : y
Applying... Done!
-I- Please reboot machine to load new configurations.
[strangelet](0) $
</pre>
 
==See also==
* [https://www.mellanox.com/support/firmware/firmware-downloads Firmware download] page. Firmware version can be acquired with <tt>ethtool -i IFACE</tt>.

Latest revision as of 07:53, 14 March 2023

ConnectX is mlx4 (Ethernet/InfiniBand) for ConnectX-3, or mlx5 for ConnectX-4 and above.

Connect-IB is mlx5 (Infiniband only).

Setting Ethernet mode in the firmware

The default link protocol for at least ConnectX-4 is Infiniband. Changing this requires mlxconfig from the MLNX_OFED package's mft deb. mlxconfig requires mft to be running (which requires the mst_pci kernel module); /dev/mst will be populated once this has happened. This device is in Infiniband mode:

[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 query | grep LINK_TYPE
         LINK_TYPE_P1                                IB(1)           
[strangelet](0) $ 

...and here we change it to Ethernet (type 2):

[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 set LINK_TYPE_P1=2 

Device #1:
----------

Device type:    ConnectX4       
Name:           N/A             
Description:    N/A             
Device:         /dev/mst/mt4115_pciconf0

Configurations:                                      Next Boot       New
         LINK_TYPE_P1                                IB(1)           ETH(2)          

 Apply new Configuration? (y/n) [n] : y
Applying... Done!
-I- Please reboot machine to load new configurations.
[strangelet](0) $ 

See also