Check out my first novel, midnight's simulacra!

Mellanox: Difference between revisions

From dankwiki
No edit summary
No edit summary
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
ConnectX is <tt>mlx4</tt> ([[Ethernet]]/[[Infiniband]]) for ConnectX-3, or <tt>mlx5</tt> for ConnectX-4 and above.
ConnectX is <tt>mlx4</tt> ([[Ethernet]]/[[InfiniBand]]) for ConnectX-3, or <tt>mlx5</tt> for ConnectX-4 and above.


Connect-IB is <tt>mlx5</tt> (Infiniband only).
Connect-IB is <tt>mlx5</tt> (Infiniband only).
Line 9: Line 9:
[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 query | grep LINK_TYPE
[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 query | grep LINK_TYPE
         LINK_TYPE_P1                                IB(1)           
         LINK_TYPE_P1                                IB(1)           
[strangelet](0) $
</pre>
...and here we change it to Ethernet (type 2):
<pre>
[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 set LINK_TYPE_P1=2
Device #1:
----------
Device type:    ConnectX4     
Name:          N/A           
Description:    N/A           
Device:        /dev/mst/mt4115_pciconf0
Configurations:                                      Next Boot      New
        LINK_TYPE_P1                                IB(1)          ETH(2)         
Apply new Configuration? (y/n) [n] : y
Applying... Done!
-I- Please reboot machine to load new configurations.
[strangelet](0) $  
[strangelet](0) $  
</pre>
</pre>

Latest revision as of 07:53, 14 March 2023

ConnectX is mlx4 (Ethernet/InfiniBand) for ConnectX-3, or mlx5 for ConnectX-4 and above.

Connect-IB is mlx5 (Infiniband only).

Setting Ethernet mode in the firmware

The default link protocol for at least ConnectX-4 is Infiniband. Changing this requires mlxconfig from the MLNX_OFED package's mft deb. mlxconfig requires mft to be running (which requires the mst_pci kernel module); /dev/mst will be populated once this has happened. This device is in Infiniband mode:

[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 query | grep LINK_TYPE
         LINK_TYPE_P1                                IB(1)           
[strangelet](0) $ 

...and here we change it to Ethernet (type 2):

[strangelet](0) $ sudo mlxconfig -d /dev/mst/mt4115_pciconf0 set LINK_TYPE_P1=2 

Device #1:
----------

Device type:    ConnectX4       
Name:           N/A             
Description:    N/A             
Device:         /dev/mst/mt4115_pciconf0

Configurations:                                      Next Boot       New
         LINK_TYPE_P1                                IB(1)           ETH(2)          

 Apply new Configuration? (y/n) [n] : y
Applying... Done!
-I- Please reboot machine to load new configurations.
[strangelet](0) $ 

See also