Description

Major alarm will be raised if GE_SWITCH_MAC_ERRORS is seen on MCP7E 3D card in MX Series routers.

Symptoms

Below logs will be seen:

%PFE-5: fpc10 Error: /fpc/10/pfe/0/cm/0/GE_Switch/0/GE_SWITCH_MAC_ERRORS[8] (0x180008), scope: board, category: switch, severity: major, module: GE Switch, type: GE Switch MAC Errors for Port (8:CB0)
%PFE-5: fpc10 Performing action get-state for error /fpc/10/pfe/0/cm/0/GE_Switch/0/GE_SWITCH_MAC_ERRORS[8] (0x180008) in module: GE Switch with scope: board category: switch level: major
%PFE-5: fpc10 Performing action cmalarm for error /fpc/10/pfe/0/cm/0/GE_Switch/0/GE_SWITCH_MAC_ERRORS[8] (0x180008) in module: GE Switch with scope: board category: switch level: major
eventd[6956]: %SYSLOG-6-EVENTD_ESCRIPT_EXECUTION: Trying to execute the script 'MPC_event_script_18_2.py' from '/var/db/scripts/event/'
%PFE-5: fpc10 Performing action disable-pfe for error /fpc/10/pfe/0/cm/0/GE_Switch/0/GE_SWITCH_MAC_ERRORS[8] (0x180008) in module: GE Switch with scope: board category: switch level: major
%PFE-6: fpc10 No module data for module id: 38
 %PFE-3: fpc10 Cmerror Op Sub Set: GE Switch: MAC TX Errors (25) Exceeded Raise Threshold (3) for Port (8:CB0)
%PFE-3: fpc10 Cmerror Op Sub Set: GE Switch: MAC Late Collisions (25) Exceeded Raise Threshold (3) for Port (8:CB0)
alarmd[7465]: %DAEMON-4: Alarm set: FPC color=RED, class=CHASSIS, reason=FPC 10 Major Errors
craftd[6999]: %DAEMON-4: Major alarm set, FPC 10 Major Errors

Solution

These log messages indicate that there are MAC TX Errors and MAC Late Collisions on the internal switch of MPC card connecting to the CB at that instance.

There is a Gigabit-Ethernet Switch inside the FPC, which has a role to connect all internal components(PFE/RE/MIC/etc.) together to make them exchange data with each other. GE Switch is monitored periodically for Errors. If the Error count crosses threshold, it will result in MAJOR CMERROR, which indicate a transient hardware issue.

These errors/alarms can be cleared by rebooting the FPC in a Maintenance Window.

If the issue persists even after the FPC restart, please contact JTAC for further troubleshooting as it could be a hardware issue with the FPC and a replacement might be required. 

Modification History

2023-07-13: Updated audience visibility