Description

The error messages "CMERROR_MQ_CPQ_RLDRAM_1_BIT_FAIL and CMERROR_MQ_CPQ_INT_REG_ECC_2BIT_ERROR" indicate memory-related issues within a device, specifically involving ECC (Error-Correcting Code) memory. This article outlines common causes and recommended solutions for addressing these errors.

Symptoms

> show chassis alarms no-forwarding
2 alarms currently active
Alarm time        Class Description
2024-02-03 09:53:55 PDT Major FPC 2 Major Errors
2024-02-03 09:53:40 PDT Minor FPC 2 Minor Errors

FPC 2      REV 26  750-028467  ABCD123      MPC 3D 16x 10GE

Log messages:
Feb 3 09:53:40.296  fpc2 MQCHIP(3) CPQ RLDRAM single bit ECC error, bank 3 addr 0xc3018 
Feb 3 09:53:40.395  fpc2 MQCHIP(3) CPQ RLDRAM double bit ECC error, bank 2 addr 0x43056 
Feb 3 09:53:40.494  fpc2 MQCHIP(3) CPQ RLDRAM ECC error summary, bank 3 addr 0xc3018 
Feb 3 09:53:40.590  fpc2 MQCHIP(3) MALLOC Q-Reference Count underflow (DRAM mode) 
Feb 3 09:53:40.629  chassisd[8824]: CHASSISD_FPC_ASIC_ERROR: <FPC 5> ASIC Error detected errorno 0x0003000a (null)
Feb 3 09:53:40.629  alarmd[9318]: Alarm set: FPC id=167773544, color=YELLOW, class=CHASSIS, reason=FPC 5 Minor Errors
Feb 3 09:53:40.629  craftd[8828]: Minor alarm set, FPC 5 Minor Errors
Feb 3 09:53:40.685  fpc2 MQCHIP(3) WO Packet error 
Feb 3 09:53:41.337  fpc2 Error: /fpc/2/pfe/0/cm/0/MQ_Chip(3)/3/CMERROR_MQ_DDRIF_CHKSUM_ERR_MINOR (0x3000a), scope: pfe, category: functional, severity: minor, module: MQ Chip(3), type: DDRIF: Checksum error 
Feb 3 09:53:53.950  fpc2 Performing action cmalarm for error /fpc/2/pfe/0/cm/0/MQ_Chip(3)/3/CMERROR_MQ_CPQ_INT_REG_ECC_2BIT_ERROR (0x3000d) in module: MQ Chip(3) with scope: pfe category: functional level: major 
Feb 3 09:53:54.135  fpc2 Performing action disable-pfe for error /fpc/2/pfe/0/cm/0/MQ_Chip(3)/3/CMERROR_MQ_CPQ_INT_REG_ECC_2BIT_ERROR (0x3000d) in module: MQ Chip(3) with scope: pfe category: functional level: major 
Feb 3 09:53:55.378  fpc2 PFE[3] Liveness Timeout:0 
Feb 3 09:53:55.541  alarmd[9318]: Alarm set: FPC id=150996328, color=RED, class=CHASSIS, reason=FPC 2 Major Errors
Feb 3 09:53:55.541  craftd[8828]: Major alarm set, FPC 2 Major Errors

Solution

Solution:

 Common Causes:

1. Memory Faults:
   One-bit or two-bit errors in ECC memory suggest significant faults that cannot be corrected, indicating potential failure of the memory module.

2. Overheating:  
   High temperatures can lead to memory errors. If the device is overheating, it may cause ECC errors.

3. Power Supply Issues: 
   Inconsistent or insufficient power can affect the stability of the memory, leading to errors.

4. Aging Hardware:  
   Over time, hardware components can degrade, increasing the likelihood of errors.

5. Improper Installation: 
   If memory modules are not seated correctly, communication issues and errors may occur.

6. Environmental Factors:  
   External factors, such as electromagnetic interference, can impact the reliability of memory components.

 

Troubleshooting Steps

If you encounter these errors, follow these steps:

1. Review System Logs: 
   Analyze system logs for additional errors or warnings that may provide more context about the issue.
>log messages
>Chassisd logs
>start shell pfe network fpc<>
#show syslog messages
#show nvram

2. Perform Soft Reboot:  
   You can execute a soft reboot of the FPC  and check if the FPC stabilizes afterwards.

3. Check FPC State: 
   If the FPC is in a "Present" or "Offline" state, physically reseat the FPC and monitor its performance.

4. Replace FPC if Necessary:  
   If the issue recurs after reseating, consider replacing the FPC to resolve persistent errors.

Modification History

2024-10-27 : Article Created