Description

There is a Control Board (CB) Ethernet switch on a QFX10008 or QFX10016 CB. CB Ethernet switch provides connectivity between the CB to another CB and other linecards in the chassis. The information on CB Ethernet switch is useful to troubleshoot problems like linecard reboot.

Symptoms

The command, 'show chassis ethernet-switch' is not available in QFX10008 and QFX10016. This article provides a procedure to display information about the ports on the CB Ethernet switch.

Solution

  1. Determine the primary RE (Routing Engine) 
    root@QFX10008-re0> show chassis routing-engine 
Routing Engine status:
  Slot 0:
    Current state                  Backup
    Temperature                 38 degrees C / 100 degrees F
    DRAM                      3360 MB (4096 MB installed)
    Memory utilization          25 percent
    5 sec CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     0 percent
      Interrupt                  0 percent
      Idle                     100 percent
    Model                          RE-QFX10008
    Serial ID                      ACAM9982
    Start time                     2017-02-03 21:14:30 EST
    Uptime                         10 days, 21 hours, 56 minutes, 23 seconds
    Last reboot reason             0x2000:hypervisor reboot 
    Load averages:                 1 minute   5 minute  15 minute
                                       0.00       0.00       0.00
Routing Engine status:
  Slot 1:
    Current state                  Master
    Temperature                 38 degrees C / 100 degrees F
    DRAM                      3360 MB (4096 MB installed)
    Memory utilization          34 percent
    5 sec CPU utilization:
      User                       1 percent
      Background                 0 percent
      Kernel                     1 percent
      Interrupt                  0 percent
      Idle                      98 percent
    1 min CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     1 percent
      Interrupt                  1 percent
      Idle                      98 percent
    5 min CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     1 percent
      Interrupt                  1 percent
      Idle                      98 percent
    15 min CPU utilization:
      User                       0 percent
      Background                 0 percent
      Kernel                     1 percent
      Interrupt                  1 percent
      Idle                      98 percent
    Model                          RE-QFX10008
    Serial ID                      ACNX3473
    Start time                     2017-01-14 17:14:59 EST
    Uptime                         31 days, 1 hour, 56 minutes
    Last reboot reason             0x4000:VJUNOS reboot 
    Load averages:                 1 minute   5 minute  15 minute
                                       0.00       0.00       0.00
  2. Login to the shell prompt as the root user

    root@QFX10008-re0> start shell user root
  3. If the primary RE is on slot 0, enter the following command:
    vty -s 50009 spmb0

    If the primary RE is on slot 1, enter the following command:
    vty -s 50009 spmb1
  4. You are now in the console of the CB Ethernet switch. Enter the command, 'ps' to check port status: 
    BCM.0> ps
            ena/    speed/ link auto    STP                  lrn  inter   max  loop
      port  link    duplex scan neg?   state   pause  discrd ops   face frame  back
       ge0  up      1G  FD   SW  No   Forward          None   FA   GMII 16356      
       xe0  down   10G  FD   SW  No   Forward          None   FA    XFI 16356      
       xe1  down   10G  FD   SW  No   Forward          None   FA    XFI 16356      
       xe2  down   10G  FD   SW  No   Forward          None   FA    XFI 16356      
       xe3  down   10G  FD   SW  No   Forward          None   FA    XFI 16356      
       xe4  up     10G  FD   SW  No   Forward          None   FA    SFI 16356      
       xe5  up     10G  FD   SW  No   Forward          None   FA    SFI 16356      
       xe6  up     10G  FD   SW  No   Forward          None   FA    SFI 16356      
       xe7  up     10G  FD   SW  No   Forward          None   FA    SFI 16356      
       xe8  !ena   10G  FD None  No   Forward          None   FA    SFI 16356      
       xe9  up     10G  FD   SW  No   Forward          None   FA    SFI 16356      
      xe10  !ena   10G  FD None  No   Forward          None   FA    SFI 16356      
      xe11  !ena   10G  FD None  No   Forward          None   FA    SFI 16356      
      xe12  up     10G  FD   SW  No   Forward          None   FA    SFI 16356      
      xe13  !ena   10G  FD None  No   Forward          None   FA    SFI 16356      
      xe14  !ena   10G  FD None  No   Forward          None   FA    SFI 16356      
      xe15  up     10G  FD   SW  No   Forward          None   FA    SFI 16356      
      xe16  !ena   10G  FD None  No   Forward          None   FA    SFI 16356      
      xe17  !ena   10G  FD None  No   Forward          None   FA    SFI 16356      
      xe18  down   10G  FD   SW  No   Forward          None   FA    SFI 16356      
      xe19  !ena   10G  FD None  No   Forward          None   FA    SFI 16356      
      xe20  up     10G  FD   SW  No   Forward          None   FA    SFI 16356      
      xe21  up     10G  FD   SW  No   Forward          None   FA    SFI 16356      
      xe22  down   10G  FD   SW  No   Forward          None   FA    SFI 16356      
      xe23  up     10G  FD   SW  No   Forward          None   FA    SFI 16356
  5. Use the command 'show c' to look at statistics for all the ports. 
    BCM.0> show c
MC_PERQ_PKT(0).cpu0	:	  1,073,741,823      +1,073,741,823
MC_PERQ_PKT(1).cpu0	:	  1,073,741,823      +1,073,741,823
MC_PERQ_PKT(2).cpu0	:	  1,073,741,823      +1,073,741,823
MC_PERQ_PKT(3).cpu0	:	  1,073,741,823      +1,073,741,823
MC_PERQ_PKT(4).cpu0	:	  1,073,741,823      +1,073,741,823
MC_PERQ_PKT(5).cpu0	:	  1,073,741,823      +1,073,741,823
MC_PERQ_PKT(6).cpu0	:	  1,073,741,823      +1,073,741,823
MC_PERQ_PKT(7).cpu0	:	  1,073,741,823      +1,073,741,823
MC_PERQ_PKT(8).cpu0	:	  1,073,741,823      +1,073,741,823
MC_PERQ_PKT(9).cpu0	:	  1,073,741,823      +1,073,741,823
<snip>
PERQ_DROP_BYTE_U(7).xe23:	 68,719,476,735     +68,719,476,735
DROP_PKT_ING.xe23	:		 75,754 	    +75,754
DROP_BYTE_ING.xe23	:	      5,833,058 	 +5,833,058
DROP_PKT_YEL.xe23	:	  4,294,967,295      +4,294,967,295
DROP_PKT_RED.xe23	:	  4,294,967,295      +4,294,967,295
WRED_PKT_GRE.xe23	:	  4,294,967,295      +4,294,967,295
WRED_PKT_YEL.xe23	:	  4,294,967,295      +4,294,967,295
WRED_PKT_RED.xe23	:	  4,294,967,295      +4,294,967,295
  6. If the port statistics of a port is needed, use 'show c <port> ' : 
    BCM.0> show c xe4
RUC.xe4 		:	    117,363,856 	     +2,141		 23/s
R127.xe4		:	     48,793,033 	     +1,459		 16/s
R255.xe4		:	     23,133,114 	       +300		  3/s
R511.xe4		:	     30,340,058 	       +196		  4/s
R1023.xe4		:	      3,441,033 		+82
R1518.xe4		:	      8,637,429 	       +104
RPKT.xe4		:	    117,369,663 	     +2,141		 23/s
RUCA.xe4		:	    117,363,856 	     +2,141		 23/s
RPRM.xe4		:	    117,363,856 	     +2,141		 23/s
RPOK.xe4		:	    117,369,663 	     +2,141		 23/s
RBYT.xe4		:	 33,514,859,443 	   +441,285	      3,031/s
T64.xe4 		:	     24,656,319 	       +510		  7/s
T127.xe4		:	     32,494,202 	       +923		  8/s
T255.xe4		:	     30,757,683 	       +483		  6/s
T511.xe4		:	     43,172,324 	       +158		  3/s
T1023.xe4		:	      1,602,952 		+51
T1518.xe4		:	     60,876,119 		+80
TPOK.xe4		:	    193,559,599 	     +2,205		 24/s
TPKT.xe4		:	    193,559,599 	     +2,205		 24/s
TUCA.xe4		:	    193,548,225 	     +2,205		 24/s
TBYT.xe4		:	114,760,793,900 	   +386,876	      2,793/s
  7. To exit from the CB Ethernet switch console, press <ctrl-c> . Do NOT enter exit. If exit is entered, bcmctl daemon will be killed. The RE will not be able to detect any linecard t status changes.
  8. If "exit" is accidentally entered; so that bcmctl daemon is not running on the RE, use the following steps for recovery. A maintenance window is recommended:
     
    1. Make sure that GRES (graceful switchover) is configured and running. (i.e. use the command, 'show system switchover' in the backup RE to verify): 
      user@QFX10008-re0> request routing-engine login backup      
Last login: Thu Oct 20 10:17:10 on ttyu0
--- JUNOS 15.1X53-D60.4 Kernel 64-bit  JNPR-10.1-20160825.336113_builder_stable_10-331042
user@:~ # cli
user> show system switchover 
Graceful switchover: On
Configuration database: Ready
Kernel database: Ready
    2. Make sure that the RE with no bcmctl running is the backup RE. Perform "request chassis routing-engine primary switch"
    3. Reboot the RE and hypervisor (i.e. run 'request system reboot hypervisor other-routing-engine' in the primary RE)

Modification History

2021-03-24: Updated the article terminology to align with Juniper's Inclusion & Diversity initiatives.