It was observed that on the EX switch, with a certain type of traffic, the ifd (ge-0/0/0) counters (physical) are incremented; but not the ifl (ge-0/0/0.0) counters (logical). The purpose of this article is to avoid duplicate escalations for this issue.
A customer has raised a case that the counters for a logical interface, ifl (e.g, ge-0/0/0.0), is not counting packets while the corresponding physical interface, ifd (e.g, ge-0/0/0) is counting the packets passing through it. This symptom was reproduced in a lab via the following configuration:
IXIA Port1--ge-0/1/0--EX4200_1--ge-0/0/0--EX4200_2--ge-0/1/0--IXIA Port2
EX4200_1 Configuration :
{master:0}[edit] root@EX4200_1# run show configuration | display set set version 9.5R3.7 set system host-name EX4200_1 set system root-authentication encrypted-password "$ABC123" set system syslog user * any emergency set system syslog file messages any notice set system syslog file messages authorization info set system syslog file interactive-commands interactive-commands any set interfaces ge-0/0/0 unit 0 family ethernet-switching port-mode trunk set interfaces ge-0/0/0 unit 0 family ethernet-switching vlan members 1000 set interfaces ge-0/1/0 ether-options link-mode full-duplex set interfaces ge-0/1/0 ether-options speed 1g set interfaces ge-0/1/0 unit 0 family ethernet-switching port-mode access set interfaces ge-0/1/0 unit 0 family ethernet-switching vlan members 1000 set protocols igmp-snooping vlan all set ethernet-switching-options dot1q-tunneling ether-type 0x9100 set ethernet-switching-options storm-control interface all set vlans vlan1000 vlan-id 1000 set vlans vlan1000 dot1q-tunneling customer-vlans 1-100 set vlans vlan1000 dot1q-tunneling customer-vlans 201-300 set poe interface all
EX4200_2 Configuration :
{master:0}[edit] root@EX4200_2# run show configuration | display set set version 9.5R3.7 set system host-name EX4200_2 set system root-authentication encrypted-password "$ABC123" set system syslog user * any emergency set system syslog file messages any notice set system syslog file messages authorization info set system syslog file interactive-commands interactive-commands any set interfaces ge-0/0/0 unit 0 family ethernet-switching port-mode trunk set interfaces ge-0/0/0 unit 0 family ethernet-switching vlan members 1000 set interfaces ge-0/1/0 ether-options link-mode full-duplex set interfaces ge-0/1/0 ether-options speed 1g set interfaces ge-0/1/0 unit 0 family ethernet-switching port-mode access set interfaces ge-0/1/0 unit 0 family ethernet-switching vlan members 1000 set protocols igmp-snooping vlan all set ethernet-switching-options dot1q-tunneling ether-type 0x9100 set ethernet-switching-options storm-control interface all set vlans vlan1000 vlan-id 1000 set vlans vlan1000 dot1q-tunneling customer-vlans 1-100 set vlans vlan1000 dot1q-tunneling customer-vlans 201-300 set poe interface all
Testing : With the above configuration, if the IXIA Port 1 initiates some IP traffic with the 802.1q tag id of 100 destined to IXIA Port 2, the IP packets will be forwarded towards IXIA Port 2 . The traffic traverses ge-0/1/0 and ge-0/0/0 of both of the EX4200 switches to reach the destination and the counters in these interfaces are expected to count these packets. However, when you look at the counters for IFLs ( ge-0/0/0.0 and ge-0/1/0.0 ), you will notice that they are not counting the packets correctly; whereas the counters for IFDs ( ge-0/0/0 and ge-0/1/0 ) are doing it correctly. The following snapshots were taken from the lab environment:
{master:0}[edit] root@EX4200_1# run show interfaces ge-0/0/0 detail Physical interface: ge-0/0/0, Enabled, Physical link is Up Interface index: 129, SNMP ifIndex: 427, Generation: 132 Link-level type: Ethernet, MTU: 1514, Speed: Auto, Duplex: Auto, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled, Flow control: Enabled, Auto-negotiation: Enabled, Remote fault: Online Device flags : Present Running Interface flags: SNMP-Traps Internal: 0x0 Link flags : None CoS queues : 8 supported, 8 maximum usable queues Hold-times : Up 0 ms, Down 0 ms Current address: 00:23:9c:0c:d4:80, Hardware address: 00:23:9c:0c:d4:80 Last flapped : 2009-11-12 12:54:09 UTC (00:13:51 ago) Statistics last cleared: 2009-11-12 12:59:39 UTC (00:08:21 ago) Traffic statistics: Input bytes : 4949820 82240 bps Output bytes : 4949820 82240 bps Input packets: 4815 10 pps Output packets: 4815 10 pps IPv6 transit statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Egress queues: 8 supported, 4 in use Queue counters: Queued packets Transmitted packets Dropped packets 0 best-effort 0 4816 0 1 assured-forw 0 0 0 5 expedited-fo 0 0 0 7 network-cont 0 0 0 Active alarms : None Active defects : None Logical interface ge-0/0/0.0 (Index 65) (SNMP ifIndex 116) (Generation 130) Flags: SNMP-Traps 0x0 Encapsulation: ENET2 Bandwidth: 0 Traffic statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Local statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Transit statistics: Input bytes : 0 0 bps Output bytes : 0 0 bps Input packets: 0 0 pps Output packets: 0 0 pps Protocol eth-switch, Generation: 146, Route table: 0 Flags: Is-Primary, Trunk-Mode {master:0}[edit] root@EX4200_1# run show interfaces ge-0/1/0 detail Physical interface: ge-0/1/0, Enabled, Physical link is Up Interface index: 153, SNMP ifIndex: 123, Generation: 156 Link-level type: Ethernet, MTU: 1514, Speed: 1000mbps, Duplex: Full-Duplex, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled, Flow control: Enabled, Auto-negotiation: Enabled, Remote fault: Online Device flags : Present Running Interface flags: SNMP-Traps Internal: 0x0 Link flags : None CoS queues : 8 supported, 8 maximum usable queues Hold-times : Up 0 ms, Down 0 ms Current address: 00:23:9c:0c:d4:98, Hardware address: 00:23:9c:0c:d4:98 Last flapped : 2009-11-12 12:36:47 UTC (00:33:07 ago) Statistics last cleared: 2009-11-12 12:59:39 UTC (00:10:15 ago) Traffic statistics: Input bytes : 6097920 81920 bps Output bytes : 6097920 81920 bps Input packets: 5955 10 pps Output packets: 5955 10 pps IPv6 transit statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Egress queues: 8 supported, 4 in use Queue counters: Queued packets Transmitted packets Dropped packets 0 best-effort 0 5960 0 1 assured-forw 0 0 0 5 expedited-fo 0 0 0 7 network-cont 0 0 0 Active alarms : None Active defects : None Logical interface ge-0/1/0.0 (Index 66) (SNMP ifIndex 118) (Generation 131) Flags: SNMP-Traps Encapsulation: ENET2 Traffic statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Local statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Transit statistics: Input bytes : 0 0 bps Output bytes : 0 0 bps Input packets: 0 0 pps Output packets: 0 0 pps Protocol eth-switch, Generation: 147, Route table: 0 Flags: None {master:0}[edit] root@EX4200_2# run show interfaces ge-0/0/0 detail Physical interface: ge-0/0/0, Enabled, Physical link is Up Interface index: 129, SNMP ifIndex: 427, Generation: 132 Link-level type: Ethernet, MTU: 1514, Speed: Auto, Duplex: Auto, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled, Flow control: Enabled, Auto-negotiation: Enabled, Remote fault: Online Device flags : Present Running Interface flags: SNMP-Traps Internal: 0x0 Link flags : None CoS queues : 8 supported, 8 maximum usable queues Hold-times : Up 0 ms, Down 0 ms Current address: 00:1f:12:30:49:80, Hardware address: 00:1f:12:30:49:80 Last flapped : 2009-11-05 22:07:25 UTC (00:13:14 ago) Statistics last cleared: 2009-11-05 22:13:04 UTC (00:07:35 ago) Traffic statistics: Input bytes : 4566376 82240 bps Output bytes : 4566376 82240 bps Input packets: 4442 10 pps Output packets: 4442 10 pps IPv6 transit statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Egress queues: 8 supported, 4 in use Queue counters: Queued packets Transmitted packets Dropped packets 0 best-effort 0 4448 0 1 assured-forw 0 0 0 5 expedited-fo 0 0 0 7 network-cont 0 0 0 Active alarms : None Active defects : None Logical interface ge-0/0/0.0 (Index 65) (SNMP ifIndex 116) (Generation 130) Flags: SNMP-Traps 0x0 Encapsulation: ENET2 Bandwidth: 0 Traffic statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Local statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Transit statistics: Input bytes : 0 0 bps Output bytes : 0 0 bps Input packets: 0 0 pps Output packets: 0 0 pps Protocol eth-switch, Generation: 146, Route table: 0 Flags: Is-Primary, Trunk-Mode {master:0}[edit] root@EX4200_2# run show interfaces ge-0/1/0 detail Physical interface: ge-0/1/0, Enabled, Physical link is Up Interface index: 177, SNMP ifIndex: 123, Generation: 180 Link-level type: Ethernet, MTU: 1514, Speed: 1000mbps, Duplex: Full-Duplex, BPDU Error: None, MAC-REWRITE Error: None, Loopback: Disabled, Source filtering: Disabled, Flow control: Enabled, Auto-negotiation: Enabled, Remote fault: Online Device flags : Present Running Interface flags: SNMP-Traps Internal: 0x0 Link flags : None CoS queues : 8 supported, 8 maximum usable queues Hold-times : Up 0 ms, Down 0 ms Current address: 00:1f:12:30:49:b0, Hardware address: 00:1f:12:30:49:b0 Last flapped : 2009-11-05 21:50:03 UTC (00:30:54 ago) Statistics last cleared: 2009-11-05 22:13:05 UTC (00:07:52 ago) Traffic statistics: Input bytes : 4732928 81920 bps Output bytes : 4732928 81920 bps Input packets: 4622 10 pps Output packets: 4622 10 pps IPv6 transit statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Egress queues: 8 supported, 4 in use Queue counters: Queued packets Transmitted packets Dropped packets 0 best-effort 0 4627 0 1 assured-forw 0 0 0 5 expedited-fo 0 0 0 7 network-cont 0 0 0 Active alarms : None Active defects : None Logical interface ge-0/1/0.0 (Index 66) (SNMP ifIndex 118) (Generation 131) Flags: SNMP-Traps Encapsulation: ENET2 Traffic statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Local statistics: Input bytes : 0 Output bytes : 0 Input packets: 0 Output packets: 0 Transit statistics: Input bytes : 0 0 bps Output bytes : 0 0 bps Input packets: 0 0 pps Output packets: 0 0 pps Protocol eth-switch, Generation: 147, Route table: 0 Flags: None
According to the Engineering team, IFL or Logical stats are incremented, only if packets are sent to the kernel for software processing. If normal IP packets are routed, they are processed within PFE and are not sent to the kernel; so they do not get counted under IFL and qinq packets are one of a kind. Control packets, such as ARP or packets destined to the IP address that is configured on the VLAN interfaces, are the ones that go to the kernel. Only these packets get counted under IFL. This is a system limitation; but alternatively, ACLs can be used to count packets/bytes on the required VLAN interfaces.