Description

Platform : qfx5120-48y-8c
JunOS : 22.2R3-S3.18
Impact: BGP neighbors do not come up. 
_____________________________________________________________________________________
TOPOLGY TESTED IN LAB: 
_____________________________________________________________________________________

MX204 <--> QFX5120( DUT) 

BGP config ON MX: 

set protocols bgp group eVPN-Underlay type external
set protocols bgp group eVPN-Underlay family inet unicast extended-nexthop
set protocols bgp group eVPN-Underlay family inet6 unicast
set protocols bgp group eVPN-Underlay peer-as 65002
set protocols bgp group eVPN-Underlay local-as 65001
set protocols bgp group eVPN-Underlay multipath multiple-as
set protocols bgp group eVPN-Underlay dynamic-neighbor internal-peers peer-auto-discovery family inet6 ipv6-nd
set protocols bgp group eVPN-Underlay dynamic-neighbor internal-peers peer-auto-discovery interface et-0/0/0.0
set protocols bgp group eVPN-Underlay dynamic-neighbor internal-peers peer-auto-discovery interface et-0/0/1.0

BGP config on QFX: 

set protocols bgp group eVPN-Underlay type external
set protocols bgp group eVPN-Underlay family inet unicast extended-nexthop
set protocols bgp group eVPN-Underlay family inet6 unicast
set protocols bgp group eVPN-Underlay peer-as 65001
set protocols bgp group eVPN-Underlay local-as 65002
set protocols bgp group eVPN-Underlay multipath multiple-as
set protocols bgp group eVPN-Underlay dynamic-neighbor internal-peers peer-auto-discovery family inet6 ipv6-nd
set protocols bgp group eVPN-Underlay dynamic-neighbor internal-peers peer-auto-discovery interface et-0/0/48.0

______________________________________________________________________________________

ISSUE DETAILS
______________________________________________________________________________________

 --> By default, if we change the BGP group-name on any switch, the BGP connection will reset  and then get established again.
 --> On QFX device, If we change BGP group-name from eVPN-Underlay to test , BGP session does not come up.
 
+++++++++++++++++++++++++++++
LAB OUTPUTS  DURING ISSUE STATE : 
+++++++++++++++++++++++++++++

OUTPUTS FROM QFX: 

{master:0}[edit]
labroot@jtac-qfx5120-48y-8c-r2070# replace pattern eVPN-Underlay  with test

{master:0}[edit]
labroot@jtac-qfx5120-48y-8c-r2070# show | compare 
[edit protocols bgp]

- group eVPN-Underlay {
- type external;
- family inet {
- unicast {
- extended-nexthop;
- }
- }
- family inet6 {
- unicast;
- }
- peer-as 65001;
- local-as 65002;
- multipath {
- multiple-as;
- }
- dynamic-neighbor internal-peers {
- peer-auto-discovery {
- family inet6 {
- ipv6-nd;
- }
- interface et-0/0/48.0;
- }
- }
- }
+ group test {
+ type external;
+ family inet {
+ unicast {
+ extended-nexthop;
+ }
+ }
+ family inet6 {
+ unicast;
+ }
+ peer-as 65001;
+ local-as 65002;
+ multipath {
+ multiple-as;
+ }
+ dynamic-neighbor internal-peers {
+ peer-auto-discovery {
+ family inet6 {
+ ipv6-nd;
+ }
+ interface et-0/0/48.0;
+ }
+ }
+ }


{master:0}[edit]
labroot@jtac-qfx5120-48y-8c-r2070# commit 
[edit protocols]
  'bgp'
    warning: requires 'bgp' license
configuration check succeeds
commit complete

syntax error.
labroot@jtac-qfx5120-48y-8c-r2070# run show bgp summary 

Warning: License key missing; requires 'bgp' license

Threading mode: BGP I/O
Default eBGP mode: advertise - accept, receive - accept
Groups: 1 Peers: 0 Down peers: 0
Table          Tot Paths  Act Paths Suppressed    History Damp State    Pending
inet.0               
                       0          0          0          0          0          0
inet6.0              
                       0          0          0          0          0          0

OUTPUTS FROM MX :

labroot@jtac-mx204-r2045> show bgp summary 
Threading mode: BGP I/O
Default eBGP mode: advertise - accept, receive - accept
Groups: 1 Peers: 1 Down peers: 1
Auto-discovered peers: 1
Table          Tot Paths  Act Paths Suppressed    History Damp State    Pending
inet.0               
                       0          0          0          0          0          0
inet6.0              
                       0          0          0          0          0          0
Peer                     AS      InPkt     OutPkt    OutQ   Flaps Last Up/Dwn State|#Active/Received/Accepted/Damped...
fe80::be0f:feff:feb2:9e35%et-0/0/0.0       65002          0          0       0       2           4 Active

___________________________________
The following messages are observed in MX logs: 
___________________________________
[edit]
labroot@jtac-mx204-r2045# run show log messages | match bgp | last 5 

May 23 13:07:25  jtac-mx204-r2045 rpd[34693]: BGP_EXTENDED_NH_NLRI_MISMATCH: bgp_process_ext_nh_cap: mismatch extended nexthop encoding NLRI with fe80::be0f:feff:feb2:9e35%et-0/0/0.0 (External AD IPv6-ND): peer: <>(0) us: <inet-unicast>(1) (instance master)

May 23 13:07:25  jtac-mx204-r2045 rpd[34693]: bgp_process_ext_nh_cap:404: NOTIFICATION sent to fe80::be0f:feff:feb2:9e358.917395e-316t-0/0/0.0 (External AD IPv6-ND): code 2 (Open Message Error) subcode 7 (unsupported capability)
______________________________________                                       
Collected traceoptions from MX during the issue state: 
______________________________________
May 23 13:08:13.770227 advertising LLGR receiving-speaker-only capability to neighbor fe80::be0f:feff:feb2:9e35%et-0/0/0.0 (External AD IPv6-ND)
May 23 13:08:13.771772 BGP_EXTENDED_NH_NLRI_MISMATCH: bgp_process_ext_nh_cap: mismatch extended nexthop encoding NLRI with fe80::be0f:feff:feb2:9e35%et-0/0/0.0 (External AD IPv6-ND): peer: <>(0) us: <inet-unicast>(1) (instance master)
May 23 13:08:45.776460 advertising graceful restart receiving-speaker-only capability to neighbor fe80::be0f:feff:feb2:9e35%et-0/0/0.0 (External AD IPv6-ND)
May 23 13:08:45.776487 advertising LLGR receiving-speaker-only capability to neighbor fe80::be0f:feff:feb2:9e35%et-0/0/0.0 (External AD IPv6-ND)
May 23 13:08:45.778118 BGP_EXTENDED_NH_NLRI_MISMATCH: bgp_process_ext_nh_cap: mismatch extended nexthop encoding NLRI with fe80::be0f:feff:feb2:9e35%et-0/0/0.0 (External AD IPv6-ND): peer: <>(0) us: <inet-unicast>(1) (instance master)
                                  

 

Solution

++++++++++++++++++++++
WORKAROUND / RECOVERY
++++++++++++++++++++++

1)Restart RPD session on QFX switch 

2) Commit full on QFX . 

{master:0}[edit]
labroot@jtac-qfx5120-48y-8c-r2070# commit full
[edit protocols]
 'bgp'
 warning: requires 'bgp' license
configuration check succeeds
commit complete

{master:0}[edit]
labroot@jtac-qfx5120-48y-8c-r2070# run show bgp summary

Warning: License key missing; requires 'bgp' license

Threading mode: BGP I/O
Default eBGP mode: advertise - accept, receive - accept
Groups: 1 Peers: 1 Down peers: 1
Auto-discovered peers: 1
Table Tot Paths Act Paths Suppressed History Damp State Pending
inet.0
 0 0 0 0 0 0
inet6.0
 0 0 0 0 0 0
Peer AS InPkt OutPkt OutQ Flaps Last Up/Dwn State|#Active/Received/Accepted/Damped...
fe80::6a22:8eff:fe28:782f%et-0/0/48.0 65001 1 0 0 0 2 OpenConfirm

{master:0}[edit]
labroot@jtac-qfx5120-48y-8c-r2070# run show bgp summary

Warning: License key missing; requires 'bgp' license

Threading mode: BGP I/O
Default eBGP mode: advertise - accept, receive - accept
Groups: 1 Peers: 1 Down peers: 0
Auto-discovered peers: 1
Table Tot Paths Act Paths Suppressed History Damp State Pending
inet.0
 0 0 0 0 0 0
inet6.0
 0 0 0 0 0 0
Peer AS InPkt OutPkt OutQ Flaps Last Up/Dwn State|#Active/Received/Accepted/Damped...
fe80::6a22:8eff:fe28:782f%et-0/0/48.0 65001 4 3 0 0 1 Establ
 inet.0: 0/0/0/0
 inet6.0: 0/0/0/0

Traceoptions on MX during the recovery: 

May 23 13:10:06.610266 advertising graceful restart receiving-speaker-only capability to neighbor fe80::be0f:feff:feb2:9e35%et-0/0/0.0 (External AD IPv6-ND)
May 23 13:10:06.610295 advertising LLGR receiving-speaker-only capability to neighbor fe80::be0f:feff:feb2:9e35%et-0/0/0.0 (External AD IPv6-ND)
May 23 13:10:06.817732 advertising graceful restart receiving-speaker-only capability to neighbor fe80::be0f:feff:feb2:9e35%et-0/0/0.0 (External AD IPv6-ND)
May 23 13:10:06.817755 advertising LLGR receiving-speaker-only capability to neighbor fe80::be0f:feff:feb2:9e35%et-0/0/0.0 (External AD IPv6-ND)

 

++++++++++++++++++++++
     RESOLUTION
++++++++++++++++++++++

This is a bug and would be fixed in and after version 23.2R1 .

 

 

 

Modification History

2024-06-14 : Article Created

Related Information

ref case : 2024-0516-156206