Description

The "MQSS(1): MQSS(1): DSTAT: DBGMON_CLIENT_USEMETER:" can be seen in the logs messages repeatedly if we have HCOS enabled and the packets get stuck in the pfe memory.

However, if the device is in standalone mode and we still have these errors, these might be bad hardware.

Jan 09 09:06:00  Router1: %PFE-3: fpc0 MQSS(1): MALLOC: Underflow error during reference count read - Overflow 0, Underflow 1, HMCIF 0, Address 0x48
Jan 09 09:06:00  Router1 : %PFE-3: fpc0 ppe_error_interrupt(5486): EA[1:0]_PPE 73 Errors lmem data error 0x00000d91
Jan 09 09:06:01  Router1 : %PFE-3: fpc0 Cmerror Op Set: MQSS(1): MQSS(1): DSTAT: DBGMON_CLIENT_USEMETER: Unexpected usemeter values - drop0_usemeter 6, drop1_usemeter 12, malloc_usemeter0 12, malloc_usemeter1 12, cpq_usemeter0 0, cpq_usemeter1 0  (URI: /fpc/0/pfe/0/cm/0/MQSS(1)/1/MQS


 

 

Symptoms

The following logs are continuously appearing on the device, if the device is in standalone mode and we still have these errors, these might be bad hardware.
 

Router1@> show chassis alarms no-forwarding
1 alarms currently active
Alarm time        Class Description
2024-01-09 17:20:15 UTC Minor FPC 0 Minor Errors

Jan 09 09:06:00  Router1 : %PFE-3: fpc0 MQSS(1): MALLOC: Underflow error during reference count read - Overflow 0, Underflow 1, HMCIF 0, Address 0x48
Jan 09 09:06:00  Router1 : %PFE-3: fpc0 ppe_error_interrupt(5486): EA[1:0]_PPE 73 Errors lmem data error 0x00000d91
Jan 09 09:06:01  Router1 : %PFE-3: fpc0 Cmerror Op Set: MQSS(1): MQSS(1): DSTAT: DBGMON_CLIENT_USEMETER: Unexpected usemeter values - drop0_usemeter 6, drop1_usemeter 12, malloc_usemeter0 12, malloc_usemeter1 12, cpq_usemeter0 0, cpq_usemeter1 0  (URI: /fpc/0/pfe/0/cm/0/MQSS(1)/1/MQS

 

Solution

Workaround

If the syslog messages mentioned are detected on the device configured with HCOS and handling traffic, please refer to the steps outlined in KB-KB74943 [juniper.net].

If these logs appear on a standalone device, it could be indicating a hardware failure (transient or permanent) issue.
We need to verify the syslog messages which have appeared just before under line the issue to understand as below logs and created RMA for FPC.

Jan 09 09:06:00 Router1 : %PFE-3: fpc0 MQSS(1): MALLOC: Underflow error during reference count read - Overflow 0, Underflow 1, HMCIF 0, Address 0x48
Jan 09 09:06:00 Router1 : %PFE-3: fpc0 ppe_error_interrupt(5486): EA[1:0]_PPE 73 Errors lmem data error 0x00000d91

Before RMA, please take the following actions:

  1. Offline/online the FPC.

  2. If the issue persists, reseat the FPC.

  3. If syslog messages continue to appear, it may be necessary to replace the FPC using the RMA process.

Modification History

2024-03-14 : Article Created