Description

This article describes HSL2 links and focuses on the following syslog message and how to address it:

 

<163>1 2024-02-08T19:01:32.563Z DEVICE - - - - fpc0 Cmerror Op Set: IXCHIP(0): CRC Errors:IXCHIP(0):0 on hsl2 rx channel id 0

Symptoms

IX is a WAN connectivity chip. IX connects to XM chip in a Trinity complex via HSL2 links. 

 

HSL2: The PFE’s ASICs communicate with each other and with the fabric chips at the physical layer via HSL2 (High Speed Link version 2) links. 

 

When issues are detected in the HSL2 links between the PFE's ASICs, an alarm similar to the following will be active and messages similar to the following are reported:

 

root@DEVICE> show chassis alarms no-forwarding

1 alarms currently active

Alarm time        Class Description

2024-02-08 19:01:32 UTC Major FPC 0 Major Errors - IX Error code: 0x2f0001

 

 

<163>1 2024-02-08T19:01:32.563Z DEVICE - - - - fpc0 Cmerror Op Set: IXCHIP(0): CRC Errors:IXCHIP(0):0 on hsl2 rx channel id 0

<163>1 2024-02-08T19:01:32.565Z DEVICE - - - - fpc0 CMT cmlc_cmt_platform_handle_msgQ: process asicwedge queue error 0

<28>1 2024-02-08T19:01:32.655Z DEVICE alarmd 15497 - - Alarm set: FPC color=RED, class=CHASSIS, reason=FPC 0 Major Errors - IX Error code: 0x2f0001

<28>1 2024-02-08T19:01:32.655Z DEVICE craftd 12624 - - Major alarm set, FPC 0 Major Errors - IX Error code: 0x2f0001

 

Solution

The most common reason of failure is CRC errors. Cyclic redundancy check is one of the most popular methods of error detection for digital signals.

 

However, the errors could be increasing. To verify if the errors are increasing, login to the PFE shell and obtain the HSL2 statistics of the FPC (the output below was shortened):

 

 

DEVICE> start shell pfe network fpc0

NGMPC0(DEVICE vty) show hsl2 statistics

HSL2 Errors:

------------

                        CRC Errors (last)

                       -----------------

IXCHIP(0) channel statistics:

 IXCHIP(0)-chan-rx-0 <= XMCHIP(0)-chan-tx-111       7 (0)

  

  

If it is a single time event, the numbers will most likely stay static. Clear the alarm (if any) with the command:

 

Router# clear chassis fpc errors fpc-slot 0 error-code 0x2f0001

 

 

After running the above command, if the alarm comes back then restart the FPC (during a maintenance window) to clear the transient error condition.

If the errors are continuous, collect the following show command output, and contact your technical support representative to investigate the issue further.

 

show log messages

show log chassisd | no-more

show chassis hardware

show chassis fabric fpcs

show chassis fabric map

show chassis fabric summary

show chassis fabric plane

show chassis fabric plane-location

start shell pfe network fpc{#}

show syslog messages

show nvram

show hsl2 statistics detail

exit

 

 

 

Modification History

2024-02-23 : Article Created