Description

This article explains the flapping behaviour of ICCP link for the Multi-Chassis Link aggregation Group (MC-LAG) when configured through an irb interface.

Sample Configuration:

  irb {
        unit 4094 {
            description "MC-LAG peers between switches";
            family inet {
                address 192.168.0.1/30 {
                    arp 192.168.0.2 l2-interface ae0.0 mac cc:e1:94:30:80:a0;
                }
            }

protocols {
    iccp {
        local-ip-addr 192.168.0.1;
        peer 192.168.0.2 {
            session-establishment-hold-time 50;
            redundancy-group-id-list 1;
            liveness-detection {
                minimum-receive-interval 1000;
                transmit-interval {
                    minimum-interval 1000;
                }
            }
        }
    }

 

Symptoms

Below logs appear at the time of the flap:

May 15 08:47:41.112 2023 switch-AB lacpd[2163]: %DAEMON-5-LACPD_TIMEOUT: xe-0/0/23: lacp current while timer expired current Receive State: CURRENT
May 15 08:47:41.128 2023 switch-AB /kernel: %KERN-4: lag_bundlestate_ifd_change: bundle ae0: bundle IFD minimum bandwidth or minimum links not met, Bandwidth (Current : Required) 0 : 10000000000 Number of links (Current : Required) 0 : 1
May 15 08:47:41.124 2023 switch-AB lacpd[2163]: %DAEMON-5-LACP_INTF_DOWN: ae0: Interface marked down due to lacp timeout on member xe-0/0/22
May 15 08:47:41.247 2023 switch-AB mib2d[2168]: %DAEMON-4-SNMP_TRAP_LINK_DOWN: ifIndex 566, ifAdminStatus up(1), ifOperStatus down(2), ifName ae0
May 15 08:47:41.332 2023 switch-AB mib2d[2168]: %DAEMON-4-SNMP_TRAP_LINK_DOWN: ifIndex 515, ifAdminStatus up(1), ifOperStatus down(2), ifName irb.0
May 15 08:47:41.332 2023 switch-AB mib2d[2168]: %DAEMON-4-SNMP_TRAP_LINK_DOWN: ifIndex 582, ifAdminStatus up(1), ifOperStatus down(2), ifName irb.4094

Solution

Configure the ICCP liveness-detection interval (the Bidirectional Forwarding Detection (BFD) timer) to be at least 8 seconds if you have configured ICCP connectivity through an IRB interface.


A liveness-detection interval of 8 seconds or more allows for graceful Routing Engine switchover (GRES) to work seamlessly. By default, ICCP liveness detection uses multihop BFD, which runs in centralized mode.

Example:

protocols {
    iccp {
        local-ip-addr 192.168.0.1;
        peer 192.168.0.2 {
            session-establishment-hold-time 50;
            redundancy-group-id-list 1;
            liveness-detection {
                minimum-receive-interval 1000;
                transmit-interval {
                    minimum-interval 1000;    --------> The time is in milliseconds. We need to change this to 8000(8 sec) or above value.

Note: This recommendation does not apply if you configured ICCP connectivity through a dedicated physical interface. In this case, you can configure single-hop BFD.

Modification History

22 May 2023
26/06/2023: Modified switch details & content

Related Information

https://www.juniper.net/documentation/us/en/software/junos/mc-lag/index.html