What does "rt_msg_handler,688: route process failed" mean?

The following errors are displayed in the  /var/log/messages

2018-08-23T05:06:39-04:00 SW01A node0.fpc0.pic2 - - RT-HAL,rt_entry_stats_msg_reply,4464: rt_halp_vectors->rt_get_prefix_stats failed for TO_THIS_ROUTE
2018-08-23T05:06:39-04:00 SW01A node0.fpc0.pic2 - - RT-HAL,rt_msg_handler,688: route process failed

What does "rt_msg_handler,688: route process failed" mean?

These messages are generated when the routes are out-of-sync between RE (Routing Engine) and PFE (Packet Forwarding Engine).   It is generally seen if the data-plane is under a high CPU condition, but it can happen under any such circumstance which may induce delay in communication between RE and PFE.

FTO failure messages will happen first.  To confirm the issue further, check the following:

1. In the output of " show usp fto stats " , look for increase in counter "FTO_DESTROY_FAIL".
2. In the output of " show usp fto ", look for FTO with "00000000".

If you do see the FTO messages in addition to the "rt_msg_handler,688: route process failed" , then SRX device requires a reboot to fix this issue.  To reboot the device, enter the following command:

> request system reboot