Description

This article explains the meaning of the 'PIC not power up' alarm on FPCs and the steps to resolve the issue.

Symptoms

Active Alarm: 

user@host> show chassis alarms
1 alarms currently active
Alarm time               Class  Description
2019-08-16 03:16:40 EST  Minor  FPC 1, PIC not power up

Error Logs: 

Aug 16 03:16:40   alarmd[3346]: Alarm set: FPC color=YELLOW, class=CHASSIS, reason=FPC 2, PIC not power up
Aug 16 03:16:40   craftd[2926]: Minor alarm set, FPC 2, PIC not power up
Aug 16 03:16:44   chassisd[2922]: CHASSISD_SNMP_TRAP7: SNMP trap generated: FRU removal (jnxFruContentsIndex 8, 
     jnxFruL1Index 3, jnxFruL2Index 1, jnxFruL3Index 0, jnxFruName PIC:  @ 2/0/*, jnxFruType 11, jnxFruSlot 2)

Solution

This issue could be:

  1. A transient issue with PIC
  2. Hardware issue with PIC
  3. Hardware issue with FPC

Detailed Logs: 

Aug 16 03:21:28  fpc2 CM_SNGFPC: cmsngfpc_pic_state_check failed with PIC power, FPC 2 PIC 0
Aug 16 03:21:28  fpc2 CM_SNGFPC: cmsngfpc_pic_state_check failed with PIC power, FPC 2 PIC 0
Aug 16 03:21:28  fpc2 CM_SNGFPC: cmsngfpc_pic_state_check failed with PIC power, FPC 2 PIC 0
Aug 16 03:21:31  fpc2 CM_SNGFPC: cmsngfpc_pic_state_check failed with PIC power, FPC 2 PIC 0
Aug 16 03:21:31  fpc2 CM_SNGFPC: cmsngfpc_pic_state_check failed with PIC power, FPC 2 PIC 0
Aug 16 03:21:31  fpc2 CM_SNGFPC: cmsngfpc_pic_state_check failed with PIC power, FPC 2 PIC 0
Aug 16 03:21:34  alarmd[3346]: Alarm set: FPC color=YELLOW, class=CHASSIS, reason=FPC 2, PIC not power up
Aug 16 03:21:34  craftd[2926]:  Minor alarm set, FPC 2, PIC not power up
Aug 16 03:21:34  fpc2 CM_SNGFPC: cmsngfpc_pic_state_check failed with PIC power, FPC 2 PIC 0
Aug 16 03:21:34  fpc2 CM_SNGFPC: cmsngfpc_pic_state_check failed with PIC power, FPC 2 PIC 0
Aug 16 03:21:34  fpc2 CM_SNGFPC: cmsngfpc_pic_state_check failed with PIC power, FPC 2 PIC 0
Aug 16 03:21:34  fpc2 CM_SNGFPC: cmsngfpc_pic_state_check failed with power, disable pic 0
Aug 16 03:21:34  fpc2 CM_SNGFPC: cmsngfpc_pic_state_check failed with power, disable pic 0

The above logs indicate that the PIC 0 on FPC 2 has failed to come up. Thus the software is disabling the PIC.

Check PIC state: 

user@host> show chassis pic fpc-slot 2 pic-slot 0
FPC slot 1, PIC slot 1 information:
State                            Offline

Soft-online PIC: 

user@host> request chassis pic fpc-slot 2 pic-slot 0 online

Check if the alarm clears: 

user@host> show chassis alarms

If the alarm clears, the issue is resolved. If the alarm still exists, there could be a hardware issue with the PIC. If the PIC not built-in, arrange for a spare PIC of the same type to perform swap test in PIC 0 slot of FPC slot 2. If the spare also fails to come up, it could be an issue with the FPC.

If the spare comes up in FPC and does not return any alarm, the issue is with the original PIC in slot 0.

For hardware replacement of FPC/PIC, contact JTAC :

Collect the following logs for JTAC analysis:

>show log chassisd
>show log messages
>show chassis hardware
>show chassis fpc pic-status