Description

Dec 13 02:57:20.298 hostname fpc2 Cmerror Op Clear: PE Chip: PE2[2]: RT: Clear Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 02:57:20.300 hostname fpc2 Cmerror Op Clear: PE Chip: PE2[2]: RT: Clear Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 02:57:20.300 hostname fpc2 Cmerror Op Clear: PE Chip: PE2[2]: RT: Clear Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 04:16:39.136 hostname fpc2 Error: /fpc/2/pfe/0/cm/0/PE_Chip/2/PECHIP_CMERROR_RT_CORRECT0_FSET_REG_CORRECTED_LMEM (0x2100ba), scope: pfe, category: functional, severity: minor, module: PE Chip, type: Description for PECHIP_CMERROR_RT_CORRECT0_FSET_REG_CORRECTED_LMEM 
Dec 13 04:16:39.142 hostname fpc2 Cmerror Op Set: PE Chip: PE2[2]: RT:correct0_protect_intr: 0x1: Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 04:16:40.171 hostname fpc2 Error: /fpc/2/pfe/0/cm/0/PE_Chip/2/PECHIP_CMERROR_RT_CORRECT0_FSET_REG_CORRECTED_LMEM (0x2100ba), scope: pfe, category: functional, severity: minor, module: PE Chip, type: Description for PECHIP_CMERROR_RT_CORRECT0_FSET_REG_CORRECTED_LMEM 
Dec 13 04:16:40.186 hostname fpc2 Cmerror Op Set: PE Chip: PE2[2]: RT:correct0_protect_intr: 0x1: Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 04:16:41.256 hostname fpc2 Error: /fpc/2/pfe/0/cm/0/PE_Chip/2/PECHIP_CMERROR_RT_CORRECT0_FSET_REG_CORRECTED_LMEM (0x2100ba), scope: pfe, category: functional, severity: minor, module: PE Chip, type: Description for PECHIP_CMERROR_RT_CORRECT0_FSET_REG_CORRECTED_LMEM 
Dec 13 04:16:41.270 hostname fpc2 Cmerror Op Set: PE Chip: PE2[2]: RT:correct0_protect_intr: 0x1: Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 04:16:42.351 hostname fpc2 Error: /fpc/2/pfe/0/cm/0/PE_Chip/2/PECHIP_CMERROR_RT_CORRECT0_FSET_REG_CORRECTED_LMEM (0x2100ba), scope: pfe, category: functional, severity: minor, module: PE Chip, type: Description for PECHIP_CMERROR_RT_CORRECT0_FSET_REG_CORRECTED_LMEM 
Dec 13 04:16:42.360 hostname fpc2 Cmerror Op Set: PE Chip: PE2[2]: RT:correct0_protect_intr: 0x1: Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 04:16:43.419 hostname fpc2 Error: /fpc/2/pfe/0/cm/0/PE_Chip/2/PECHIP_CMERROR_RT_CORRECT0_FSET_REG_CORRECTED_LMEM (0x2100ba), scope: pfe, category: functional, severity: minor, module: PE Chip, type: Description for PECHIP_CMERROR_RT_CORRECT0_FSET_REG_CORRECTED_LMEM 
Dec 13 04:16:43.431 hostname fpc2 Cmerror Op Set: PE Chip: PE2[2]: RT:correct0_protect_intr: 0x1: Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 04:32:47.827 hostname fpc2 Cmerror Op Clear: PE Chip: PE2[2]: RT: Clear Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 04:32:47.851 hostname fpc2 Cmerror Op Clear: PE Chip: PE2[2]: RT: Clear Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 04:32:47.852 hostname fpc2 Cmerror Op Clear: PE Chip: PE2[2]: RT: Clear Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 04:32:47.852 hostname fpc2 Cmerror Op Clear: PE Chip: PE2[2]: RT: Clear Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Dec 13 04:32:47.852 hostname fpc2 Cmerror Op Clear: PE Chip: PE2[2]: RT: Clear Fatal LMEM Error. 1 bit for each GN slice MEM:lmem , MEMTYPE: 2,ADDR : [h2e00000, h2c00000,h2a00000, h2800000],  
Jan 2 04:17:32.145 hostname fpc2 Error: /fpc/2/pfe/0/cm/0/PE_Chip/3/PECHIP_CMERROR_IRM_PAR_PROTECT_FSET_REG_DETECTED_FBM1 (0x210048), scope: pfe, category: functional, severity: fatal, module: PE Chip, type: Description for PECHIP_CMERROR_IRM_PAR_PROTECT_FSET_REG_DETECTED_FBM1
Jan 2 04:17:33.036 hostname fpc2 Cmerror Op Set: PE Chip::FATAL ERROR!! from PE3[3]: IRM: par_prot detected_fbm1 error  
Jan 2 04:18:52.107 hostname fpc2 Cmerror Op Clear: PE Chip::FATAL ERROR!! from PE3[3]: IRM: par_prot clear detected_fbm1 error

Symptoms

PTX10008, LC1101 card, port down, errors above

Midplane     REV 31  750-054097  Midplane 8

FPC 2      REV 42  750-051357     LC1101 - 30C / 30Q / 96X

 CPU           BUILTIN   BUILTIN      FPC CPU

 PIC 0          BUILTIN   BUILTIN      30x100GE/30x40GE/96x10GE

Solution

These are fatal memory LMEM errors errors in the PE chips. Because these errors can affect traffic, they are marked as fatal and the PFE that has these errors is marked as disabled (all ports relating to this PFE will be down).

To clear the alarm, restart the FPC via the CLI:

 

request chassis fpc slot 2 offline

Wait a few minutes

request chassis fpc slot 2 online

 

Before this is done, please capture this info to know about the PFEs status:

 

> show chassis fpc errors

> request pfe execute command "show pechip 0" target fpc2

> request pfe execute command "show pechip 1" target fpc2

> request pfe execute command "show pechip 2" target fpc2

> request pfe execute command "show pechip 3" target fpc2

> request pfe execute command "show show cmerror module brief" target fpc2

 

If the issue persists, open a JTAC case

Modification History

2024-01-04 : Article Created