This article describes a scenario where a PFE reset occurred due to low memory.
Symptoms
"Low Memory Conditions" before the incident:
Mar 5 00:31:05 userdevice jsysmond[25327]: JSYSMOND_LOW_MEM_RECOVERED: System recovered from low memory condition
Mar 5 00:36:35 userdevice jsysmond[25327]: JSYSMOND_LOW_MEM_RECOVERED: System recovered from low memory condition
Mar 5 04:31:18 userdevice jsysmond[25327]: JSYSMOND_LOW_MEM_RECOVERED: System recovered from low memory condition
Mar 5 06:57:18 userdevice jsysmond[25327]: JSYSMOND_LOW_MEM_RECOVERED: System recovered from low memory condition
The PFE crashed and generated logs indicating a heap memory leak:
Mar 5 08:10:12 userdevice chassisd[25120]: CHASSISD_IPC_CONNECTION_DROPPED: Dropped IPC connection for FPC 0
Mar 5 08:10:12 userdevice chassisd[25120]: CHASSISD_IFDEV_DETACH_FPC: ifdev_detach_fpc(0)
Mar 5 08:10:17 userdevice chassisd[25120]: CHASSISD_SNMP_TRAP7: SNMP trap generated: FRU insertion (jnxFruContentsIndex 2, jnxFruL1Index 1, jnxFruL2Index 1, jnxFruL3Index 0, jnxFruName Power Supply 0 @ 0/0/*, jnxFruType 7, jnxFruSlot 0)
Mar 5 08:10:17 userdevice chassisd[25120]: CHASSISD_SNMP_TRAP7: SNMP trap generated: FRU insertion (jnxFruContentsIndex 2, jnxFruL1Index 1, jnxFruL2Index 2, jnxFruL3Index 0, jnxFruName Power Supply 1 @ 0/1/*, jnxFruType 7, jnxFruSlot 1)
Mar 5 08:10:17 userdevice dc-pfe[23611]: HEAP malloc(0) detected!
Mar 5 08:10:17 userdevice fpc0 HEAP malloc(0) detected!
Mar 5 08:10:25 userdevice dc-pfe[23611]: Frame 0: sp = 0x1a35c734, pc = 0x2442129
Mar 5 08:10:25 userdevice dc-pfe[23611]: Frame 1: sp = 0x1a35c778, pc = 0x2443be3
Mar 5 08:10:25 userdevice dc-pfe[23611]: Frame 2: sp = 0x1a35c78c, pc = 0x2495c14
Mar 5 08:10:25 userdevice dc-pfe[23611]: Frame 3: sp = 0x1a35c9ac, pc = 0x246b676
Mar 5 08:10:25 userdevice dc-pfe[23611]: Frame 4: sp = 0x1a35c9c8, pc = 0x24a5476
root@userdevice > show chassis fpc detail
Slot 0 information:
State Online
Total CPU DRAM 3653 MB
FIPS Capable False
Start time 2026-03-05 08:10:13 CST
Uptime 1 hour, 19 minutes, 52 seconds
Last reboot reason Router rebooted after a normal shutdown.
PEM 0 and PEM 1 generated alarms:
Mar 5 08:10:17 userdevice alarmd[25125]: Alarm set: PS SFXPC id=150995019, color=YELLOW, class=CHASSIS, reason=FPC 0 PEM 0 is not powered
Mar 5 08:10:17 userdevice craftd[25264]: Receive FX craftd set alarm message: color: 2 class: 100 object: 75 slot: 0 silent: 0 short_reason=FPC 0 PEM 0 No Power long_reason=FPC 0 PEM 0 is not powered id=150995019 reason=150994944
Mar 5 08:10:17 userdevice alarmd[25125]: Alarm set: PS SFXPC id=167772491, color=YELLOW, class=CHASSIS, reason=FPC 0 PEM 1 is not powered
Mar 5 08:10:17 userdevicecraftd[25264]: Minor alarm set, FPC 0 PEM 0 is not powered
Mar 5 08:10:17 userdevice craftd[25264]: Receive FX craftd set alarm message: color: 2 class: 100 object: 75 slot: 1 silent: 0 short_reason=FPC 0 PEM 1 No Power long_reason=FPC 0 PEM 1 is not powered id=167772491 reason=167772160
Mar 5 08:10:35 userdevice alarmd[25125]: Alarm cleared: PS SFXPC id=150995019, color=YELLOW, class=CHASSIS, reason=FPC 0 PEM 0 is not powered
Mar 5 08:10:35 userdevice craftd[25264]: Receive FX craftd clear alarm message: color: Minor class: 100 slot: 0
Mar 5 08:10:35 userdevice craftd[25264]: Minor alarm cleared, FPC 0 PEM 0 is not powered
Mar 5 08:10:35 userdevice craftd[25264]: Receive FX craftd clear alarm message: color: Minor class: 100 slot: 1
Mar 5 08:10:35 userdevice craftd[25264]: Minor alarm cleared, FPC 0 PEM 1 is not powered
Mar 5 08:10:35 userdevice alarmd[25125]: Alarm cleared: PS SFXPC id=167772491, color=YELLOW, class=CHASSIS, reason=FPC 0 PEM 1 is not powered