Description

This article explains about the "PECHIP_CMERROR_HMCIF_LINK4_INT_REG_RTR_FAIL (0x210097)" syslog message observed and action taken to clear it.

Symptoms

You will observe the below error logs and FPC major error with multiple interface going down.

 

root@router-re0> show chassis alarms

1 alarms currently active

Alarm time        Class Description

2024-07-23 11:13:53 PDT Major FPC 0 Major Errors

 

Jul 23 11:13:53.518 router-re0 alarmd[20889]: Alarm set: FPC id=150995048, color=RED, class=CHASSIS, reason=FPC 0 Major Errors

Jul 23 11:13:53.518 router-re0 craftd[20890]: Receive FX craftd set alarm message: color: 1 class: 100 object: 104 slot: 0 silent: 0 short_reason=FPC 0 Major Errors long_reason=FPC 0 Major Errors id=150995048 reason=150994944

Jul 23 11:13:53.518 router-re0 craftd[20890]: Major alarm set, FPC 0 Major Errors

 

Jul 23 11:13:48.650 router-re0 fpc0 Error: /fpc/0/pfe/0/cm/0/PE_Chip/0/PECHIP_CMERROR_HMCIF_LINK4_INT_REG_RTR_FAIL (0x210097), scope: pfe, category: memory, severity: fatal, module: PE Chip, type: Description for PECHIP_CMERROR_HMCIF_LINK4_INT_REG_RTR_FAIL

Jul 23 11:13:48.650 router-re0 fpc0 Performing action disable-pfe for error /fpc/0/pfe/0/cm/0/PE_Chip/0/PECHIP_CMERROR_HMCIF_LINK4_INT_REG_RTR_FAIL (0x210097) in module: PE Chip with scope: pfe category: memory level: fatal

Jul 23 11:13:48.650 router-re0 fpc0 ISSUING ifd-down for et-0/0/37 (155) on pfe-0

Jul 23 11:13:48.744 router-re0 fpc0 ISSUING ifd-down for et-0/0/41 (156) on pfe-0

Jul 23 11:13:48.839 router-re0 fpc0 ISSUING ifd-down for et-0/0/43 (157) on pfe-0

Jul 23 11:13:48.934 router-re0 fpc0 ISSUING ifd-down for et-0/0/47 (158) on pfe-0

Jul 23 11:13:49.029 router-re0 fpc0 pechip_set_pfe_disabled:976: PECHIP[0]: PFE Marked Disabled !!!

Jul 23 11:13:49.029 router-re0 fpc0 pechip_set_pfe_disabled:983: PECHIP[0]: Deregisterd TOE PIO Vectors !!!

Jul 23 11:13:49.029 router-re0 fpc0 JPRDS_FDB:ERR:jprds_fdb_set_pfe_disabled(),8876: pfe 0 marked disabled

Jul 23 11:13:49.029 router-re0 fpc0 Cmerror Op Set: PE Chip::FATAL ERROR!! from pe0[0]: HMCIF: Link4: Retry Error (URI: /fpc/0/pfe/0/cm/0/PE_Chip/0/PECHIP_CMERROR_HMCIF_LINK4_INT_REG_RTR_FAIL)

Jul 23 11:13:49.029 router-re0 fpc0 Error: /fpc/0/pfe/0/cm/0/PE_Chip/0/PECHIP_CMERROR_HMCIF_LINK5_INT_REG_HMC_ERR_FATAL (0x2105cd), scope: pfe, category: memory, severity: fatal, module: PE Chip, type: Description for PECHIP_CMERROR_HMCIF_LINK5_INT_REG_HMC_ERR_FATAL

Jul 23 11:13:49.030 router-re0 fpc0 Performing action disable-pfe for error /fpc/0/pfe/0/cm/0/PE_Chip/0/PECHIP_CMERROR_HMCIF_LINK5_INT_REG_HMC_ERR_FATAL (0x2105cd) in module: PE Chip with scope: pfe category: memory level: fatal

Solution

This problem is caused by a HMC error on PECHIP.

This will result in a disabled PFE and shut down the interface on the affected PFE to avoid the impact being spread across other PFEs.

 

Reboot the Line Card to clear the error.

If the errors persist even after FPC reboot, a hardware replacement is recommended. 

Modification History

2024-07-29 : Article Created