Non-DF PE not forwarding the packet in ESI-LAG with MPLS encapsulation.
A CE device is multihomed to two PTX10001-36MR routers, with an ESI-LAG configured between the PTX routers and the device. It has been observed that one of the PTX router specifically the one acting as the Designated Forwarder (DF) can ping the CE device while the other PTX cannot. It is also observed that the transit packet passing through the NON-DF router is not going through as well. This problem is seen when the encapsulation is MPLS, the issue is not seen with VXLAN encapsulation. Configuration for all the PTX devices is as follows: PTX1: root@ptx-1-RE0# show interfaces ae0 flexible-vlan-tagging; encapsulation flexible-ethernet-services; esi { 00:11:22:33:44:55:66:77:88:22; all-active; } aggregated-ether-options { lacp { active; system-id aa:bb:cc:dd:ee:ff; } } unit 503 { encapsulation vlan-bridge; vlan-id 503; } [edit] root@ptx-1-RE0# root@ptx-1-RE0# show routing-instances lan-503 instance-type mac-vrf; protocols { evpn { ## ## Warning: requires 'evpn-mpls' license ## encapsulation mpls; } } service-type vlan-based; interface ae0.503; route-distinguisher 1.1.1.1:503; vrf-target target:10:503; vlans { v503 { vlan-id 503; interface ae0.503; l3-interface irb.503; } } [edit] root@ptx-1-RE0# root@ptx-1-RE0# show interfaces irb gratuitous-arp-reply; unit 503 { virtual-gateway-accept-data; family inet { address 22.22.22.2/24 { preferred; virtual-gateway-address 22.22.22.1; } } virtual-gateway-v4-mac 00:01:00:00:00:01; } [edit] root@ptx-1-RE0# root@ptx-1-RE0> show mac-vrf routing database instance lan-503 Instance: lan-503 VLAN DomainId MAC address Active source Timestamp IP address 503 00:01:00:00:00:01 05:00:00:00:0a:00:00:01:f7:00 Sep 17 19:10:16 22.22.22.1 503 1a:01:dc:51:08:05 irb.503 Sep 17 20:05:04 22.22.22.2 503 2c:6b:f5:1a:68:c0 00:11:22:33:44:55:66:77:88:22 Sep 17 19:11:04 22.22.22.250 503 bc:f3:81:08:08:05 2.2.2.2 Sep 17 20:05:13 22.22.22.3 root@ptx-1-RE0> root@ptx-1-RE0> show mac-vrf forwarding mac-table MAC flags (S - static MAC, D - dynamic MAC, L - locally learned, P - Persistent static, C - Control MAC SE - statistics enabled, NM - non configured MAC, R - remote PE MAC, O - ovsdb MAC GBP - group based policy, B - Blocked MAC) Ethernet switching table : 2 entries, 2 learned Routing instance : lan-503 Vlan MAC MAC Age GBP Logical NH MAC RTR name address flags Tag interface Index property ID v503 2c:6b:f5:1a:68:c0 D - ae0.503 0 0 v503 bc:f3:81:08:08:05 DC - 9118 9118 root@ptx-1-RE0> root@ptx-1-RE0> show mac-vrf forwarding mac-ip-table MAC IP flags (S - Static, D - Dynamic, L - Local , R - Remote, Lp - Local Proxy, Rp - Remote Proxy, K - Kernel, RT - Dest Route, (N)AD - (Not) Advt to remote, RE - Re-ARP/ND, RO - Router, OV - Override, Ur - Unresolved, B - Blocked, RTS - Dest Route Skipped, RGw - Remote Gateway, GBP - Group Based Policy, RTF - Dest Route Forced, SC - Static Config, P - Probe, NLC - No Local Config, LD - Local Down) Routing instance : lan-503 Bridging domain : v503 IP MAC Flags GBP Logical Active address address Tag Interface source 22.22.22.1 00:01:00:00:00:01 S,K irb.503 22.22.22.2 1a:01:dc:51:08:05 S,K irb.503 22.22.22.250 2c:6b:f5:1a:68:c0 DLRp,K,RT,AD ae0.503 22.22.22.3 bc:f3:81:08:08:05 SR,K,RT 2.2.2.2 root@ptx-1-RE0> root@ptx-1-RE0> show arp MAC Address Address Name Interface Flags 56:04:1d:00:56:b7 11.11.11.2 11.11.11.2 et-0/0/1.0 none bc:f3:81:08:08:05 22.22.22.3 22.22.22.3 irb.503[ .local..57 ] permanent remote 2c:6b:f5:1a:68:c0 22.22.22.250 22.22.22.250 irb.503[ ae0.503 ] permanent remote Total entries: 3 root@ptx-1-RE0> root@ptx-1-RE0> show route forwarding-table destination 22.22.22.250 Routing table: default.inet Internet: Destination Type RtRef Next hop Type Index NhRef Netif 22.22.22.250/32 dest 0 2c:6b:f5:1a:68:c0 ucst 7094 1 ae0.503 root@ptx-1-RE0> ping 22.22.22.250 PING 22.22.22.250 (22.22.22.250) 56(84) bytes of data. ^C --- 22.22.22.250 ping statistics --- 4 packets transmitted, 0 received, 100% packet loss, time 3059ms root@ptx-1-RE0> ======================================================= PTX2: root@ptx-2-RE0# show interfaces ae0 flexible-vlan-tagging; encapsulation flexible-ethernet-services; esi { 00:11:22:33:44:55:66:77:88:22; all-active; } aggregated-ether-options { lacp { active; system-id aa:bb:cc:dd:ee:ff; } } unit 503 { encapsulation vlan-bridge; vlan-id 503; } [edit] root@ptx-2-RE0# root@ptx-2-RE0# show routing-instances lan-503 instance-type mac-vrf; protocols { evpn { ## ## Warning: requires 'evpn-mpls' license ## encapsulation mpls; } } service-type vlan-based; interface ae0.503; route-distinguisher 2.2.2.2:503; vrf-target target:10:503; vlans { v503 { vlan-id 503; interface ae0.503; l3-interface irb.503; } } [edit] root@ptx-2-RE0# root@ptx-2-RE0# show interfaces irb gratuitous-arp-reply; unit 503 { virtual-gateway-accept-data; family inet { address 22.22.22.3/24 { preferred; virtual-gateway-address 22.22.22.1; } } virtual-gateway-v4-mac 00:01:00:00:00:01; } [edit] root@ptx-2-RE0# root@ptx-2-RE0> show mac-vrf routing database instance lan-503 Instance: lan-503 VLAN DomainId MAC address Active source Timestamp IP address 503 00:01:00:00:00:01 05:00:00:00:0a:00:00:01:f7:00 Sep 17 19:10:03 22.22.22.1 503 1a:01:dc:51:08:05 1.1.1.1 Sep 17 20:05:05 22.22.22.2 503 2c:6b:f5:1a:68:c0 00:11:22:33:44:55:66:77:88:22 Sep 17 19:11:04 22.22.22.250 503 bc:f3:81:08:08:05 irb.503 Sep 17 20:05:12 22.22.22.3 root@ptx-2-RE0> root@ptx-2-RE0> show mac-vrf forwarding mac-table MAC flags (S - static MAC, D - dynamic MAC, L - locally learned, P - Persistent static, C - Control MAC SE - statistics enabled, NM - non configured MAC, R - remote PE MAC, O - ovsdb MAC GBP - group based policy, B - Blocked MAC) Ethernet switching table : 2 entries, 2 learned Routing instance : lan-503 Vlan MAC MAC Age GBP Logical NH MAC RTR name address flags Tag interface Index property ID v503 1a:01:dc:51:08:05 DC - 8129 8129 v503 2c:6b:f5:1a:68:c0 D - ae0.503 0 0 root@ptx-2-RE0> root@ptx-2-RE0> show mac-vrf forwarding mac-ip-table MAC IP flags (S - Static, D - Dynamic, L - Local , R - Remote, Lp - Local Proxy, Rp - Remote Proxy, K - Kernel, RT - Dest Route, (N)AD - (Not) Advt to remote, RE - Re-ARP/ND, RO - Router, OV - Override, Ur - Unresolved, B - Blocked, RTS - Dest Route Skipped, RGw - Remote Gateway, GBP - Group Based Policy, RTF - Dest Route Forced, SC - Static Config, P - Probe, NLC - No Local Config, LD - Local Down) Routing instance : lan-503 Bridging domain : v503 IP MAC Flags GBP Logical Active address address Tag Interface source 22.22.22.1 00:01:00:00:00:01 S,K irb.503 22.22.22.2 1a:01:dc:51:08:05 SR,K,RT 1.1.1.1 22.22.22.250 2c:6b:f5:1a:68:c0 DRLp,K,RT,AD ae0.503 22.22.22.3 bc:f3:81:08:08:05 S,K irb.503 root@ptx-2-RE0> root@ptx-2-RE0> show arp MAC Address Address Name Interface Flags 56:04:1d:00:56:9b 11.11.11.6 11.11.11.6 et-0/0/1.0 none 1a:01:dc:51:08:05 22.22.22.2 22.22.22.2 irb.503[ .local..57 ] permanent remote 2c:6b:f5:1a:68:c0 22.22.22.250 22.22.22.250 irb.503[ ae0.503 ] permanent remote Total entries: 3 root@ptx-2-RE0> root@ptx-2-RE0> show route forwarding-table destination 22.22.22.250 Routing table: default.inet Internet: Destination Type RtRef Next hop Type Index NhRef Netif 22.22.22.250/32 dest 0 2c:6b:f5:1a:68:c0 ucst 7097 1 ae0.503 root@ptx-2-RE0> show evpn instance lan-503 designated-forwarder Instance: lan-503 Number of ethernet segments: 2 ESI: 00:11:22:33:44:55:66:77:88:22 Designated forwarder: 2.2.2.2 ESI: 05:00:00:00:0a:00:00:01:f7:00 Designated forwarder: DF not elected yet root@ptx-2-RE0> root@ptx-2-RE0> ping 22.22.22.250 PING 22.22.22.250 (22.22.22.250) 56(84) bytes of data. 64 bytes from 22.22.22.250: icmp_seq=1 ttl=64 time=5.93 ms 64 bytes from 22.22.22.250: icmp_seq=2 ttl=64 time=4.66 ms ^C --- 22.22.22.250 ping statistics --- 2 packets transmitted, 2 received, 0% packet loss, time 1000ms rtt min/avg/max/mdev = 4.664/5.296/5.929/0.632 ms root@ptx-2-RE0>
Uprade to 24.2R1-EVO or higher releases