This case describes an issue where all the interfaces went down on mx2010 chassis. No issues were observed on physical links.

• MX2010 Current version : 21.2R3-S6.11
• All links went down.
• Device is only accessible via console.
• All fabrics were in present state.

re0>> show chassis sfb

Slot State Uptime

0 Present

1 Present

2 Present

3 Present

4 Present

5 Present

6 Present

7 Present

Log messages:
 

[May 31 13:13:52.845 LOG: Err] <163>CCL: ccl_validate_asic_inst: Failed to find asic with Id 596

[May 31 13:13:52.845 LOG: Err] <163>CMTY_FM_HSL2: CCL thresh setting failed for failed plane[6], pb[6], pfe[0] ccl_id[596], ccl_inst[14], ccl_sch[0], agg_thresh[100], rate_thresh[5]

[May 31 13:13:52.845 LOG: Err] <163>CCL: ccl_validate_asic_inst: Failed to find asic with Id 596

[May 31 13:13:52.845 LOG: Err] <163>CMTY_FM_HSL2: CCL thresh setting failed for failed plane[6], pb[6], pfe[1] ccl_id[596], ccl_inst[14], ccl_sch[2], agg_thresh[100], rate_thresh[5]

[May 31 13:13:52.845 LOG: Err] <163>CCL: ccl_validate_asic_inst: Failed to find asic with Id 596

[May 31 13:13:52.845 LOG: Err] <163>CMTY_FM_HSL2: CCL thresh setting failed for failed plane[6], pb[6], pfe[2] ccl_id[596], ccl_inst[14], ccl_sch[4], agg_thresh[100], rate_thresh[5]

[May 31 13:13:52.845 LOG: Err] <163>CCL: ccl_validate_asic_inst: Failed to find asic with Id 596

[May 31 13:13:52.845 LOG: Err] <163>CMTY_FM_HSL2: CCL thresh setting failed for failed plane[6], pb[6], pfe[3] ccl_id[596], ccl_inst[14], ccl_sch[6], agg_thresh[100], rate_thresh[5]

During investigation we found that spmb0 was crashed and this led SFBs to stay in present state.

Investigation pointed out that for interfaces to stay up, the SFBs must be online.

For Recovery:

• Perform RE switchover and replace faulty RE/CB module.