This article explains the issue on ACX series routers with PFE reporting below error :

ACX_NH::acx_nh_mpls_tunnel_uninstall(),1317:acx_nh_mpls_tunnel_uninstall: BCM L3 Egress destroy object failed for (-10:Operation still running), BCM NH Obj: 0x186b2
 

On ACX series routers, in a scaled environment with link protection/FRR, frequent LDP route flaps/NH flaps or route churn due to some activity may lead to the "Operation still running" messages. These route flaps lead to the creation of duplicate route entries in the hardware ASIC and due to which memory is consumed in the hardware ASIC.

When this happens, below log messages are seen :

2023-09-29T06:24:48 - - - - feb0 ACX_NH::acx_nh_mpls_tunnel_uninstall(),1317:acx_nh_mpls_tunnel_uninstall: BCM L3 Egress destroy object failed for (-10:Operation still running), BCM NH Obj: 0x186b2

Also the above log might be preceded by "acx_nh_tag_hw_install: BCM L3 Egress create object failed for NH 13423 (-6:Table full)" messages in the log messages.

These messages indicate that internal hardware ASIC is out of memory to hold required next-hop entries.

This issue might be seen if the following conditions are met:

* In a Scaled Setup in all ACX platforms
* Interface flapping
* LDP/RSVP/MPLS route flaps

It may Impact traffic processing through the PFE .

Restarting the FEB by below command will help to clear the memory:-

             >>> Request chassis feb 0 restart

10/07/2023: Initial Draft