Description

Peer server reboot brings the interface down attached to QFX

Symptoms

When the remote end server/system reboots, QFX5K platform ports with SFP-T 1G inserted may go into a hung state and remain in that state even after the reboot is complete. This may affect traffic after the remote end system comes online and resumes traffic transmission. SFP-T 1G Ports was going down on qfx5100 due to auto negotiation was  being enabled by default.

 

Solution

Work around:

 

Disable auto-negotiation from the Broadcom shell after remote device reboots. 

From vty shell,

Show dcbcm ifd all --> this command will give  the bcm port numbers for all the interface.

Now to enter into the bcm shell:
From vty shell,
set dcbcm diag  --> this command to enter into the bcm shell.

After this :
port <port_name> AN=0 --> to disable

Note: This workaround needs to be applied every time the server reboots.
** The cli knob to disable auto-negotiation may result in unpredictable behaviour. Hence, VTY workaround is suggested.
 

or we can use below workaround;

 

From vty shell

 

set cmqfx xcvr remove pic <picslot> port <portnum>
set cmqfx xcvr insert pic <picslot> port <portnum>

 

Modification History

2024-03-04 : DRAFT