An ACX configured for hashing:
set forwarding-options hash-key family inet layer-3
set forwarding-options hash-key family inet layer-4
set forwarding-options hash-key family mpls all-labels
set forwarding-options hash-key family mpls payload ether-pseudowire
set forwarding-options hash-key family mpls payload ip layer-3-only
set forwarding-options hash-key family multiservice source-mac
set forwarding-options hash-key family multiservice destination-mac
set forwarding-options load-balance-label-capability
Is seeing an issue with traffic not traversing all 4 legs of an AE bundle. The bundle in this case is set for lacp:
set interfaces ae56 flexible-vlan-tagging
set interfaces ae56 mtu 9216
set interfaces ae56 encapsulation flexible-ethernet-services
set interfaces ae56 aggregated-ether-options lacp force-up
10,000pps traversing out ae56:
labroot@h10-43> show interfaces ae56 | match rate
Input rate : 0 bps (0 pps)
Output rate : 62025984 bps (9989 pps)
All of it goes over 0/0/8:0:
labroot@h10-43> show interfaces ae56 detail
Physical interface: ae56, Enabled, Physical link is Up
Interface index: 1006, SNMP ifIndex: 636, Generation: 597000455124
Link-level type: Flexible-Ethernet, MTU: 9216, Speed: 10Gbps, BPDU Error: None, Ethernet-Switching Error: None, MAC-REWRITE Error: None, Loopback: Disabled,
Source filtering: Disabled, Flow control: Enabled, Minimum links needed: 1, Minimum bandwidth needed: 1bps
Device flags : Present Running
Interface flags: SNMP-Traps
Current address: 68:22:8e:1d:fd:f8, Hardware address: 68:22:8e:1d:fd:f8
Last flapped : 2024-12-04 11:35:48 PST (00:02:08 ago)
Statistics last cleared: Never
Traffic statistics:
Input bytes : 31680 0 bps
Output bytes : 2797721999 61247112 bps
Input packets: 253 0 pps
Output packets: 3663777 9994 pps
Members:
Statistics Packets pps Bytes bps
et-0/0/8:0
Input : 72 0 8512 0
Output: 3260103 9994 2489292252 61247112
et-0/0/8:1
Input : 60 0 7680 0
Output: 134504 0 102686122 0
et-0/0/8:2
Output: 134478 0 102817484 0
et-0/0/8:3
Input : 61 0 7808 0
Output: 134692 0 102926141 0
The issue here is the 'force-up'. It only enables the first leg of the bundle:
labroot@h10-43> show lacp interfaces
Aggregated interface: ae56
LACP state: Role Exp Def Dist Col Syn Aggr Timeout Activity
et-0/0/8:0 FUP Actor No No Yes Yes Yes Yes Fast Passive
et-0/0/8:0 FUP Partner No Yes No No Yes Yes Fast Passive
et-0/0/8:1 Actor No Yes No No No Yes Fast Passive
et-0/0/8:1 Partner No Yes No No No Yes Fast Passive
et-0/0/8:2 Actor No Yes No No No Yes Fast Passive
et-0/0/8:2 Partner No Yes No No No Yes Fast Passive
et-0/0/8:3 Actor No Yes No No No Yes Fast Passive
et-0/0/8:3 Partner No Yes No No No Yes Fast Passive
LACP protocol: Receive State Transmit State Mux State
et-0/0/8:0 FUP Current No periodic Collecting distributing
et-0/0/8:1 Defaulted No periodic Detached
et-0/0/8:2 Defaulted No periodic Detached
et-0/0/8:3 Defaulted No periodic Detached
Which in turn means that is the only leg that will be used.
If the interface is set to just run as a dummy AE with no LACP:
Traffic is hashed. Same rate:
Input rate : 7584 bps (4 pps)
Output rate : 60697488 bps (10006 pps)
Spread evenly (varying IP Src/Dst and UDP Ports):
Link-level type: Flexible-Ethernet, MTU: 9216, Speed: 40Gbps, BPDU Error: None, Ethernet-Switching Error: None, MAC-REWRITE Error: None, Loopback: Disabled,
Last flapped : 2024-12-04 11:39:49 PST (00:01:28 ago)
Input bytes : 81344 3776 bps
Output bytes : 4249280761 60852616 bps
Input packets: 641 0 pps
Output packets: 5563808 9990 pps
Input : 169 0 20928 944
Output: 4508281 2509 3443346112 15157688
Input : 157 0 20096 944
Output: 351911 2487 268525103 15285760
Output: 351605 2486 268702902 15250880
Input : 158 0 20224 944
Output: 352011 2508 268706644 15158288