Description

Two ACXs configured with an ESI LAG:

 

ACX4:

 

set interfaces ae1 flexible-vlan-tagging

set interfaces ae1 mtu 9000

set interfaces ae1 encapsulation flexible-ethernet-services

set interfaces ae1 esi 00:02:00:00:00:00:01:00:00:11

set interfaces ae1 esi all-active

set interfaces ae1 aggregated-ether-options lacp active

set interfaces ae1 aggregated-ether-options lacp system-id 02:00:00:00:00:01

set interfaces ae1 unit 21 encapsulation vlan-bridge

set interfaces ae1 unit 21 vlan-id 21

set interfaces ae1 unit 22 encapsulation vlan-bridge

set interfaces ae1 unit 22 vlan-id 22

set interfaces ae1 unit 23 encapsulation vlan-bridge

set interfaces ae1 unit 23 vlan-id 23

 

ACX8:

 

set interfaces ae1 flexible-vlan-tagging

set interfaces ae1 mtu 9000

set interfaces ae1 encapsulation flexible-ethernet-services

set interfaces ae1 esi 00:02:00:00:00:00:01:00:00:11

set interfaces ae1 esi all-active

set interfaces ae1 aggregated-ether-options lacp active

set interfaces ae1 aggregated-ether-options lacp system-id 02:00:00:00:00:01

set interfaces ae1 unit 21 encapsulation vlan-bridge

set interfaces ae1 unit 21 vlan-id 21

set interfaces ae1 unit 22 encapsulation vlan-bridge

set interfaces ae1 unit 22 vlan-id 22

set interfaces ae1 unit 23 encapsulation vlan-bridge

set interfaces ae1 unit 23 vlan-id 23

 

Are seeing higher than expected failover times. ACX8 is the DF for the ESI:

 

lab@acx7024-8> show evpn instance ri-vlan-awre extensive   

Jul 17 16:09:20

Instance: ri-vlan-awre

 Route Distinguisher: 10.0.0.8:2123

 Per-instance MAC route label: 4416

 Control word enabled

 Duplicate MAC detection threshold: 5

 Duplicate MAC detection window: 180

 MAC database status           Local Remote

  MAC advertisements:            9   12

  MAC+IP advertisements:          8   11

  Default gateway MAC advertisements:    3    0

 Number of local interfaces: 7 (7 up)

  Interface name ESI              Mode       Status   AC-Role

  .local..54   00:00:00:00:00:00:00:00:00:00 single-homed   Up     Root 

  ae1.21     00:02:00:00:00:00:01:00:00:11 all-active    Up     Root 

  ae1.22     00:02:00:00:00:00:01:00:00:11 all-active    Up     Root 

  ae1.23     00:02:00:00:00:00:01:00:00:11 all-active    Up     Root 

  et-0/0/3.21   00:00:00:00:00:00:00:00:00:00 single-homed   Up     Root 

  et-0/0/3.22   00:00:00:00:00:00:00:00:00:00 single-homed   Up     Root 

  et-0/0/3.23   00:00:00:00:00:00:00:00:00:00 single-homed   Up     Root 

 Number of IRB interfaces: 3 (3 up)

  Interface name VLAN  VNI  Status L3 context

  irb.21     21       Up   master              

  irb.22     22       Up   master              

  irb.23     23       Up   master              

 Number of protect interfaces: 0

 Number of bridge domains: 3

  VLAN Domain-ID Intfs/up  IRB-intf Mode      MAC-sync v4-SG-sync v6-SG-sync

  21         2 2  irb.21  Extended    Enabled Enabled  Disabled  

  22         2 2  irb.22  Extended    Enabled Enabled  Disabled  

  23         2 2  irb.23  Extended    Enabled Enabled  Disabled  

 Number of neighbors: 4

  Address        MAC  MAC+IP    AD    IM    ES Leaf-label DCI-Peer Flow-label DT2U-SID      DT2M-SID

  10.0.0.1        3     3     0     3     0              NO  

  10.0.0.2        3     3     0     3     0              NO  

  10.0.0.3        3     3     0     3     0              NO  

  10.0.0.4        3     2     4     3     0              NO  

 Number of ethernet segments: 4

  ESI: 00:02:00:00:00:00:01:00:00:11

   Status: Resolved by IFL ae1.21

   Local interface: ae1.23, Status: Up/Forwarding

   Number of remote PEs connected: 1

    Remote-PE    MAC-label Aliasing-label Mode

    10.0.0.4     0     0        all-active  

   Vlan: 21

   Status: Resolved by IFL ae1.21

   Number of remote PEs connected: 1

    Remote PE    MAC label Aliasing label Mode

    10.0.0.4     17     17       all-active  

   Vlan: 22

   Status: Resolved by IFL ae1.22

   Number of remote PEs connected: 1

    Remote PE    MAC label Aliasing label Mode

    10.0.0.4     18     18       all-active  

   Vlan: 23

   Status: Resolved by IFL ae1.23

   Number of remote PEs connected: 1

    Remote PE    MAC label Aliasing label Mode

    10.0.0.4     19     19       all-active  

   DF Election Algorithm: MOD based

   Designated forwarder: 10.0.0.8

   Backup forwarder: 10.0.0.4

   Last designated forwarder update: Jul 17 15:44:46

   Advertised split horizon label: 4443

  ESI: 05:00:01:00:0e:00:00:00:15:00  

   Local interface: irb.21, Status: Up/Forwarding

  ESI: 05:00:01:00:0e:00:00:00:16:00

   Local interface: irb.22, Status: Up/Forwarding

  ESI: 05:00:01:00:0e:00:00:00:17:00

   Local interface: irb.23, Status: Up/Forwarding

 SMET Forwarding: Disabled

  

Traffic is flowing out 0/0/2 on ACX8:

 

lab@acx7024-8> show interfaces et-0/0/2 | match "Output rate" 

Jul 17 16:18:04

 Output rate  : 932440488 bps (455293 pps)

  

The laser is then disabled on the peer device to simulate a link fault. Traffic generators keeping track of loss report ~900ms of loss before the traffic moves to ACX4.

Symptoms

Slower than expected ESI lag failover

Solution

50msec convergence during CE-PE link cut is not expected without Egress Link Protection or ELP. ELP support is coming in 24.4R1-EVO

Modification History

2024-08-07 : Article Created