Description

This article describes the solution for "SIB X Not online" minor alarm seen with QFX10008/16 Switches

Symptoms

Below Minor "SIB X Not Online" alarm on the QFX10008/16 device

 

jtac@qfx10008> show chassis alarms 
1 alarms currently active 
Alarm time Class Description 
2023-06-28 05:09:08 UTC Minor SIB 0 Not Online

Solution

-Check if the corresponding SIB was turned off using the CLI command, if so power on the SIB and check the status

[edit chassis]
 sib {
   power-off {
      slot 0;
   }
 }

 

-If not check for SIB offline reason from the logs, the SIB may have error with multiple FPCs as below in the logs, because of it the SIB could have been placed into power off mode by Junos.

 
Jun 28 05:09:02 jtac-re0 fpc0 cmqfx: Link errors detected for PFE 5 SIB 0 Plane 0 
Jun 28 05:09:02 jtac-re0 fpc0 fpc0 dcpfe: cmqfx: Link errors detected for PFE 5 SIB 0 Plane 0
Jun 28 05:09:02 jtac-re0 fpc0 fpc0 dcpfe: cmqfx: Link errors detected for PFE 5 SIB 0 Plane 1
Jun 28 05:09:02 jtac-re0 fpc0 cmqfx: Link errors detected for PFE 5 SIB 0 Plane 1 
Jun 28 05:09:02 jtac-re0 fpc1 Cmerror Op Set: PE Chip: PE0[0]: EPW: crc error (URI: /fpc/1/pfe/0/cm/0/PE_Chip/0/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR) 
Jun 28 05:09:02 jtac-re0 fpc1 pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 1, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc1 Cmerror Op Set: PE Chip: PE1[1]: EPW: crc error (URI: /fpc/1/pfe/0/cm/0/PE_Chip/1/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR) 
Jun 28 05:09:02 jtac-re0 fpc1 pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 2, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc1 Cmerror Op Set: PE Chip: PE2[2]: EPW: crc error (URI: /fpc/1/pfe/0/cm/0/PE_Chip/2/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR) 
Jun 28 05:09:02 jtac-re0 fpc1 pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 3, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc1 Cmerror Op Set: PE Chip: PE3[3]: EPW: crc error (URI: /fpc/1/pfe/0/cm/0/PE_Chip/3/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR) 
Jun 28 05:09:02 jtac-re0 fpc1 pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 4, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc1 Cmerror Op Set: PE Chip: PE4[4]: EPW: crc error (URI: /fpc/1/pfe/0/cm/0/PE_Chip/4/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR) 
Jun 28 05:09:02 jtac-re0 fpc1 pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 5, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc1 Cmerror Op Set: PE Chip: PE5[5]: EPW: crc error (URI: /fpc/1/pfe/0/cm/0/PE_Chip/5/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR) 
Jun 28 05:09:02 jtac-re0 fpc1 fpc1 dcpfe: pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 2, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc1 fpc1 dcpfe: Cmerror Op Set: PE Chip: PE2[2]: EPW: crc error#012 (URI: /fpc/1/pfe/0/cm/0/PE_Chip/2/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR)
Jun 28 05:09:02 jtac-re0 fpc1 fpc1 dcpfe: pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 3, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc1 fpc1 dcpfe: Cmerror Op Set: PE Chip: PE3[3]: EPW: crc error#012 (URI: /fpc/1/pfe/0/cm/0/PE_Chip/3/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR)
Jun 28 05:09:02 jtac-re0 fpc1 fpc1 dcpfe: pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 4, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc1 fpc1 dcpfe: Cmerror Op Set: PE Chip: PE4[4]: EPW: crc error#012 (URI: /fpc/1/pfe/0/cm/0/PE_Chip/4/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR)
Jun 28 05:09:02 jtac-re0 fpc1 fpc1 dcpfe: pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 5, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc1 fpc1 dcpfe: Cmerror Op Set: PE Chip: PE5[5]: EPW: crc error#012 (URI: /fpc/1/pfe/0/cm/0/PE_Chip/5/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR)
Jun 28 05:09:02 jtac-re0 fpc3 Cmerror Op Set: PE Chip: PE0[0]: EPW: crc error (URI: /fpc/3/pfe/0/cm/0/PE_Chip/0/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR) 
Jun 28 05:09:02 jtac-re0 fpc3 pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 1, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc3 Cmerror Op Set: PE Chip: PE1[1]: EPW: crc error (URI: /fpc/3/pfe/0/cm/0/PE_Chip/1/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR) 
Jun 28 05:09:02 jtac-re0 fpc3 pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 2, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc3 Cmerror Op Set: PE Chip: PE2[2]: EPW: crc error (URI: /fpc/3/pfe/0/cm/0/PE_Chip/2/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR) 
Jun 28 05:09:02 jtac-re0 fpc3 pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 3, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc3 Cmerror Op Set: PE Chip: PE3[3]: EPW: crc error (URI: /fpc/3/pfe/0/cm/0/PE_Chip/3/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR) 
Jun 28 05:09:02 jtac-re0 fpc3 pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 5, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc3 Cmerror Op Set: PE Chip: PE5[5]: EPW: crc error (URI: /fpc/3/pfe/0/cm/0/PE_Chip/5/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR) 
Jun 28 05:09:02 jtac-re0 fpc3 fpc3 dcpfe: pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 1, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc3 fpc3 dcpfe: Cmerror Op Set: PE Chip: PE1[1]: EPW: crc error#012 (URI: /fpc/3/pfe/0/cm/0/PE_Chip/1/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR)
Jun 28 05:09:02 jtac-re0 fpc3 fpc3 dcpfe: pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 2, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc3 fpc3 dcpfe: Cmerror Op Set: PE Chip: PE2[2]: EPW: crc error#012 (URI: /fpc/3/pfe/0/cm/0/PE_Chip/2/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR)
Jun 28 05:09:02 jtac-re0 fpc3 fpc3 dcpfe: pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 3, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc3 fpc3 dcpfe: Cmerror Op Set: PE Chip: PE3[3]: EPW: crc error#012 (URI: /fpc/3/pfe/0/cm/0/PE_Chip/3/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR)
Jun 28 05:09:02 jtac-re0 fpc3 fpc3 dcpfe: pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 5, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc3 fpc3 dcpfe: Cmerror Op Set: PE Chip: PE5[5]: EPW: crc error#012 (URI: /fpc/3/pfe/0/cm/0/PE_Chip/5/PECHIP_CMERROR_EPW_MISC_INT_EVENTS_CRC_ERR)
Jun 28 05:09:02 jtac-re0 fpc2 pechip_cmerror_set_error:3188: Level: Major, cmerror_code: 0x2101aa (id=426), recover_err: 0 chip_id: 0, current count: 0, threshold: 16, (counter: 0), fh_msg: 0x0
Jun 28 05:09:02 jtac-re0 fpc2 INTR: throttle 60sec PECHIP[0]:pe.epw.misc_int.status:l2l_chk_err(0): (Count:1)crc_err(0): (Count:1)eope_err(0): (Count:1)
Jun 28 05:09:02 jtac-re0 fpc2 INTR: throttle 60sec PECHIP[0]:pe.egp.intr.status:pkt_trapcode(0): (Count:1)epw_err(0): (Count:1)
Jun 28 05:09:02 jtac-re0 fpc2 INTR: throttle 60sec PECHIP[0]:pe.edf.intr.status:trapcode_l2plen_ofl(0): (Count:1)trapcode_l3plen_ofl(0): (Count:1)trapcode_l3_plen_chk_fail(0): (Count:1)
Jun 28 05:09:02 jtac-re0 fpc2 INTR: throttle 60sec PECHIP[0]:pe.edf.mem_protect.interrupts.status:detected_cnt_updtfifo_nxtptr(0): (Count:1)
Jun 28 05:09:02 jtac-re0 fpc2 INTR: throttle 330sec PECHIP[0]:pe.dt.intr.status:dgsn_timeout(0): (Count:1)complete_dgsn_skip(0): (Count:2)partial_dgsn_skip(0): (Count:1)fab_cell_drop(0): (Count:2)
Jun 28 05:09:02 jtac-re0 spmb0 pfchip_rrau_ccl_collect_error_stats : SIB0_PF_0, Error ccl err cnt rrau 0 sc:0
Jun 28 05:09:02 jtac-re0 fpc2 INTR: throttle 330sec PECHIP[0]:pe.fabrord[0].intr.status:timeout(0): (Count:2)
Jun 28 05:09:03 jtac-re0 chassisd[8813]: CHASSISD_SNMP_TRAP10: SNMP trap generated: FRU power off (jnxFruContentsIndex 15, jnxFruL1Index 1, jnxFruL2Index 0, jnxFruL3Index 0, jnxFruName SIB 0, jnxFruType 9, jnxFruSlot 0, jnxFruOfflineReason 4, jnxFruLastPowerOff 440612897, jnxFruLastPowerOn 26466)

 

-As the SIB is having link errors with almost all FPCs, We need to replace this faulty SIB

Modification History

2023-07-23: Initial Version

2025-11-09: Font modification