Article Detail

Description

This article provides information on how to monitor the throughput (or Incoming / Outgoing Data Rate) of the Packet Forwarding Engine.

Symptoms

High pps (packets/second value on pfe) can cause high flow utilization and thereby affect performance.

Solution

SRX Branch :

root@SRX100> show chassis hardware 
Hardware inventory:
Item             Version  Part number  Serial number     Description
Chassis                                AU3509AF0468      SRX100H
Routing Engine   REV 08   750-021773   AT3509AF0468      RE-SRX100H
FPC 0                                                    FPC
  PIC 0                                                  8x FE Base PIC
Power Supply 0  

root@SRX100> request pfe execute target fwdd command "show pfe statistics traffic" | no-more 
SENT: Ukern command: show pfe statistics traffic
GOT:
GOT: PFE Traffic statistics:
GOT:             103484914 packets input  (159 packets/sec)
GOT:              88090236 packets output (185 packets/sec)
GOT:
GOT: PFE Local Traffic statistics:
GOT:      169365 local packets input
GOT:      116077 local packets output
GOT:           0 software input control high drops
GOT:           0 software input high drops
GOT:           0 software input medium drops
GOT:           0 software input low drops
GOT:           0 software output drops
GOT:           0 hardware input drops
GOT:           0 Notification/control packet drops in ISR
GOT:
GOT: PFE Local Protocol statistics:
GOT:           0 hdlc keepalives
GOT:           0 atm oam
GOT:           0 fr lmi
GOT:           0 ppp lcp/ncp
GOT:           0 ospf hello
GOT:           0 ospf3 hello
GOT:           0 rsvp hello
GOT:           0 ldp hello
GOT:           0 bfd
GOT:           0 isis iih
GOT:           0 lacp
GOT:       32779 arp
GOT:           0 ether oam
GOT:           0 synce
GOT:           0 unknown
GOT:
GOT: PFE Hardware Discard statistics:
GOT:                     0 timeout
GOT:                     0 truncated key
GOT:                     0 bits to test
GOT:                     0 data error
GOT:                     0 stack underflow
GOT:                     0 stack overflow
GOT:              33622126 regular discard
GOT:                    11 extended/illegal nexthop discard
GOT:                     0 invalid iif
GOT:                     0 info cell drops
GOT:                     0 input drops
GOT:                     0 fabric drops
GOT:                     0 aged packets
GOT:
GOT:
GOT: PFE Input IPv4 Header Checksum Error and Output MTU Error statistics:
GOT:                     0 IPv4 header checksum error
GOT:                     0 MTU error
LOCAL: End of file

root@SRX100> monitor interface traffic  (press P on keyboard to see the pps values for every interface)
Above command can be run to check pps value for every interface and isolate the issue interface. 
(The above command is valid for HE devices also)

SRX High End :

Note : For High End devices, you have to extract the throughput from all SPCs to find out the total throughput of the device

root@SRX1400> show chassis hardware 
Hardware inventory:
Item             Version  Part number  Serial number     Description
Chassis                                AA3111AA0048      SRX 3400
Midplane         REV 10   710-015748   AADV0992          SRX 3400 Midplane
PEM 0            rev 10   740-027644   I262HK00XV10P     DC Power Supply
CB 0             REV 24   750-021914   AADW4142          SRX3k RE-12-10
  Routing Engine          BUILTIN      BUILTIN           Routing Engine
  CPP                     BUILTIN      BUILTIN           Central PFE Processor
  Mezz           REV 09   710-021035   AADV1902          SRX HD Mezzanine Card
CB 1             REV 10   750-032474   AADN1798          SRX3k CRM
FPC 0            REV 16   750-021882   AADT3605          SRX3k SFB 12GE
  PIC 0                   BUILTIN      BUILTIN           8x 1GE-TX 4x 1GE-SFP
FPC 5            REV 10   750-016077   TV3543            SRX3k SPC
  PIC 0                   BUILTIN      BUILTIN           SPU Cp-Flow
FPC 6            REV 12   750-017866   TV3618            SRX3k NPC
  PIC 0                   BUILTIN      BUILTIN           NPC PIC
Fan Tray 0       REV 06   750-021896   AACM4176          SRX 3400 Fan Tray

root@SRX1400> request pfe execute target tnp tnp-name fpc5.pic0 command "show pfe stati traf" | no-mor   
SENT: Ukern command: show pfe stati traf
GOT:
GOT: PFE Traffic statistics:
GOT:                207107 packets input  (549 packets/sec)
GOT:                 75378 packets output (589 packets/sec)
GOT:
GOT: PFE Local Traffic statistics:
GOT:      133855 local packets input
GOT:      790967 local packets output
GOT:           0 software input control high drops
GOT:           0 software input high drops
GOT:           0 software input medium drops
GOT:           0 software input low drops
GOT:           6 software output drops
GOT:           0 hardware input drops
GOT:           0 Notification/control packet drops in ISR
GOT:
GOT: PFE Local Protocol statistics:
GOT:           0 hdlc keepalives
GOT:           0 atm oam
GOT:           0 fr lmi
GOT:           0 ppp lcp/ncp
GOT:           0 ospf hello
GOT:           0 ospf3 hello
GOT:           0 rsvp hello
GOT:           0 ldp hello
GOT:           0 bfd
GOT:           0 isis iih
GOT:           0 lacp
GOT:         986 arp
GOT:           0 ether oam
GOT:           0 synce
GOT:           0 unknown
GOT:
GOT: PFE Hardware Discard statistics:
GOT:                     0 timeout
GOT:                     0 truncated key
GOT:                     0 bits to test
GOT:                     0 data error
GOT:                     0 stack underflow
GOT:                     0 stack overflow
GOT:                788840 regular discard
GOT:                     0 extended/illegal nexthop discard
GOT:                     0 invalid iif
GOT:                     0 info cell drops
GOT:                     0 input drops
GOT:                     0 fabric drops
GOT:                     0 aged packets
GOT:
GOT:
GOT: PFE Input IPv4 Header Checksum Error and Output MTU Error statistics:
GOT:                     0 IPv4 header checksum error
GOT:                     0 MTU error
LOCAL: End of file

To grab data from all SPCs on the device with one command:

root@SRX3600> show chassis hardware | match "node|SPC"        
node0:
--------------------------------------------------------------------------
FPC 7            REV 10   750-016077   VR7085            SRX3k SPC
FPC 8            REV 11   750-016077   AAAH4918          SRX3k SPC
FPC 9            REV 11   750-016077   AAAT8485          SRX3k SPC
FPC 11           REV 11   750-016077   AAAH4915          SRX3k SPC
node1:
--------------------------------------------------------------------------
FPC 7            REV 10   750-016077   AAAC3531          SRX3k SPC
FPC 8            REV 11   750-016077   AAAT8505          SRX3k SPC
FPC 9            REV 12   750-016077   AAAZ2922          SRX3k SPC
FPC 11           REV 10   750-016077   AAAC3502          SRX3k SPC

root@SRX3600> start shell

root@SRX3600% srx-cprod.sh -s flowd -c "show pfe stati traff" | grep "node\|sec"
======== Start SPU7.0, node0.fpc7.pic0, flowd ========
               495483 packets input  (4 packets/sec)
               214720 packets output (1 packets/sec)
======== End SPU7.0, node0.fpc7.pic0 ========
======== Start SPU8.0, node0.fpc8.pic0, flowd ========
                 7890 packets input  (0 packets/sec)
                    0 packets output (0 packets/sec)
======== End SPU8.0, node0.fpc8.pic0 ========
======== Start SPU9.0, node0.fpc9.pic0, flowd ========
                14423 packets input  (0 packets/sec)
                    0 packets output (0 packets/sec)
======== End SPU9.0, node0.fpc9.pic0 ========
======== Start SPU11.0, node0.fpc11.pic0, flowd ========
                 7527 packets input  (0 packets/sec)
                    0 packets output (0 packets/sec)
======== End SPU11.0, node0.fpc11.pic0 ========
======== Start SPU7.0, node1.fpc7.pic0, flowd ========
          11859881712 packets input  (110680 packets/sec)
               661774 packets output (3 packets/sec)
======== End SPU7.0, node1.fpc7.pic0 ========
======== Start SPU8.0, node1.fpc8.pic0, flowd ========
          23964328721 packets input  (223797 packets/sec)
                    0 packets output (0 packets/sec)
======== End SPU8.0, node1.fpc8.pic0 ========
======== Start SPU9.0, node1.fpc9.pic0, flowd ========
          23647376924 packets input  (220415 packets/sec)
                    0 packets output (0 packets/sec)
======== End SPU9.0, node1.fpc9.pic0 ========
======== Start SPU11.0, node1.fpc11.pic0, flowd ========
          23658058609 packets input  (220954 packets/sec)
                    0 packets output (0 packets/sec)
======== End SPU11.0, node1.fpc11.pic0 ========
root@SRX3600%

Modification History

2020-06-18: Article reviewed for accuracy; no changes required.
2023-10-06 - Added another command (monitor interface traffic) as a tshoot step.