Chassis cluster control plane backup node RGs state entered into disabled state
Feb 7 02:43:54 control link UP/DOWN fabric link UP/UP ---------------------------------- First UP means physical link is UP, second down state means control link monitor down, this usually caused by the heartbeat missed on control link, routing engine high CPU is the most possibly cause
Feb 7 02:43:54 control link status changed from UP->DOWN
Feb 7 02:43:54 no change to fabric link status (UP)
Feb 7 02:43:54 Control link recovery qualified : true
Feb 7 02:43:54 Processing control UP->DOWN
Feb 7 02:43:54 Signalled /usr/sbin/chassisd (pid 1910) with signal: 28
Feb 7 02:43:54 marking the remote node1 as lost
Feb 7 02:43:54 LED changed from Amber to Red, reason is Peer node: node1 is not present
Feb 7 02:43:54 setting sysctl for ha led color(Red)
Feb 7 02:43:54 Control link only failure detected current RG-0 state: secondary
Feb 7 02:43:54 Inelligibility check primary is node1, this node's state secondary
Feb 7 02:43:54 Notified PFE, node moving to Ineligible state -------------------------------------- This state change is by chassis cluster state transition design, when control link down, the RG0 secondary node RG state will changed to disabled.
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_HA_CONTROL_LINK_DOWN: HA control link monitor status is marked down
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 0 transitioned from 'secondary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 1 transitioned from 'secondary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 2 transitioned from 'secondary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 3 transitioned from 'secondary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 4 transitioned from 'secondary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 5 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 6 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 7 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 8 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 9 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 10 transitioned from 'secondary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 11 transitioned from 'secondary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 12 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 13 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 14 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 15 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 16 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 17 transitioned from 'secondary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 18 transitioned from 'secondary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 19 transitioned from 'secondary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 20 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 21 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 22 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 23 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 24 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 25 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 26 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 27 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 28 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 29 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 30 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 31 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 32 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 33 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 34 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 35 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 36 transitioned from 'primary' to 'ineligible' state due to Control link failure
Feb 7 02:43:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 37 transitioned from 'secondary' to 'ineligible' state due to Control link failure
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 0 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 1 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 2 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 3 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 4 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 5 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 6 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 7 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 8 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 9 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 10 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 11 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 12 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 13 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 14 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 15 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 16 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 17 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 18 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 19 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 20 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 21 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 22 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 23 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 24 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 25 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 26 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 27 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 28 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 29 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 30 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 31 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 32 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 33 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 34 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 35 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 36 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Feb 7 02:46:54 Test-SRX jsrpd[1972]: JSRPD_RG_STATE_CHANGE: Redundancy-group 37 transitioned from 'ineligible' to 'disabled' state due to Ineligible timer expired
Manually reboot the secondary node or enable the control link recovery feature will fix the backup node state.
https://www.juniper.net/documentation/us/en/software/junos/cli-reference/topics/ref/statement/chassis-edit-control-link-recovery.html
Enable control link recovery to be done automatically by the system.
If the control link fails, the secondary node enters to ineligible and then to disabled state. If the control link recovers with in three consecutive responses, the device auto reboots irrespective of the state (ineligible or disable) of the node. You can reboot automatically using the control-link-recovery configuration option.
After the control link recovers, the system checks whether it receives at least three consecutive heartbeats on the control link. This is to ensure that the control link is not flapping and is perfectly healthy. Once this criterion is met, the system issues an automatic reboot on the node that was disabled when the control link failed. When the disabled node reboots, the node rejoins the cluster. There is no need for any manual intervention.