Description

The Junos Fusion solution is composed of an Aggregation Device (AD) and multiple Satellite Devices (SD). Each SD has at least one connection to the AD. The SDs provide interfaces that send and receive network traffic. Network traffic can be forwarded over the AD within Junos Fusion.

This article provides debugging commands you can run on the AD for data collection.

Solution

Debugging commands on Aggregation Device

  1. show chassis satellite statistics
  2. show chassis satellite neighbor extensive
  3. show chassis satellite detail
  4. CLI to verify if a satellite image is corrupt.
  5. Show the history of what happened to the satellite
  6. Understanding “/var/home/ftp/”. 
  7. CLI to collect Extended Port Tx and Rx Statistics.
-------------------------------------------------------------------------
  1. show chassis satellite statistics

    labroot@AD> show chassis satellite statistics
    Serial Number: VB3715060116 Slot-ID: 202
      CSP down transition count: 2 Last transition: 1w1d 08:08:25
      Last transition down cause: Keepalive timer expired (in online)
      Reachability down transition count: 2
      Reachability change transition count: 14 Last transition: 1w1d 08:08:26
      S/W image update count: 0
      Extended Port add/delete/up/down request/response: 380/101/153/235 380/101/153/235
      Extended Port Params change request: 4
      Extended Port up/down operational state transition: 139/121
      Rx sync complete: 3
      Uplink ready rx count: 10 4
      Uplink ready tx count: 10

    CSP protocol sends all states up/down, add/delete parameters change etc. CSP down transitions can be a good place to check when troubleshooting.

    Extended Port add/delete/up/down request/response: The number of times an extended port—a network-facing port on the satellite device—has been added, deleted, placed in the up position, received a down request, or received a response.

    Extended Port Params change request: The number of times that an extended port—a network-facing port on the satellite device—has had a change request.

    Extended Port up/down operational state transition: The number of times that an extended port—a network-facing port on the satellite device—has had an operational state transition to up or down.

    Uplink ready Rx count: The number of times the uplink port—the port on the satellite device that connects to the aggregation device—has been placed in the ready-to-receive state.

    Uplink ready Tx count: The number of times the uplink port—the port on the satellite device that connects to the aggregation device—has been placed in the ready-to-transmit state.
 
  • show chassis satellite neighbor extensive

    alt
 
  • show chassis satellite

    alt
 
  • Use the CLI to verify if the satellite image corrupted:

    alt
 
  • Show history of what happened to the satellite:

    alt
 
  • Understanding “/var/home/ftp/”

    As soon as we commit configurations under satellite-management ;SDPD daemon create /var/home/ftp/
    sdpd_platform_init () code has the following calls to do that:

          sug_ftp_init();
       sug_homedir_init();

    labroot@AD> file list /var/home/ftp/ detail

    /var/home/ftp/:
    total blocks: 48
    drwxr-xr-x 2 ftp 20 512 Apr 14 19:27 junos-images/
    drwxr-xr-x 2 ftp 20 512 May 31 15:21 satellite-groups/
    drwxr-xr-x 8 ftp 20 512 May 19 11:16 satellite-images/
    drwxr-xr-x 2 ftp 20 512 Sep 21 07:07 sd_logs/
    total files: 0

    labroot@AD> file list /var/home/ftp/junos-images/ detail

    /var/home/ftp/junos-images/:
    /101/junos.tgz
    /202/junos.tgz
    /205/junos.tgz

    labroot@AD> file list /var/home/ftp/satellite-groups/ detail

    /var/home/ftp/satellite-groups/:
    total blocks: 16
    lrwxr-xr-x 1 root 20 25 May 31 15:21 g1@ -> ../satellite-images/1.0R3

    labroot@AD> request support information
    REQUEST FOR LOGS FROM ALL SATELLITE DEVICES HAS BEEN INITIATED AND
    IT WILL BE DOWNLOADED TO /var/home/ftp/sd_logs/
Note: PR 1442163 disabled logging for SDs when RSI is running on AD for security reasons.
Use "request chassis satellite file-copy local" instead to copy the files from SD to AD.

labroot@AD> file list /var/home/ftp/sd_logs/ detail
 
      /var/home/ftp/sd_logs/:
      total blocks: 31704
      -rw-r--r-- 1 ftp 20 7468825 Sep 21 07:07 sd101.tar.gz
      -rw-r--r-- 1 ftp 20 8653530 Sep 21 07:07 sd202.tar.gz
      -rw-r--r-- 1 ftp 20 128 Sep 21 07:07 sd205.tar.gz
      total files: 3
 
      labroot@AD> file list /var/home/ftp/satellite-images/ detail

      /var/home/ftp/satellite-images/:
      total blocks: 64
      drwxr-xr-x 4 ftp 20 512 May 10 05:56 1.0I20160510_0353_kkarthick/
      drwxr-xr-x 4 ftp 20 512 Apr 14 09:51 1.0R1-S2/
      drwxr-xr-x 4 ftp 20 512 May 12 12:25 1.0R1-S3/
      drwxr-xr-x 4 ftp 20 512 May 12 12:32 1.0R3/
      drwxr-xr-x 4 ftp 20 512 May 19 11:12 1.0R3-S1/
      drwxr-xr-x 4 ftp 20 512 May 19 11:16 14.2-1.0T.562/
      labroot@AD> start shell
      %
      % tar tvf sd101.tar
      drwxrwxr-x root/root 0 Sep 27 15:44 2016 /
      -rw-r--r-- root/root 2070 Sep 28 11:48 2016 file_copy.log
      -rw-r--r-- root/root 865 Sep 28 23:31 2016 file_compress.log
      -rw-r----- root/root 46783 Sep 28 23:30 2016 auth.log
      -rw-r--r-- root/root 51867 Sep 28 23:31 2016 lcmd.log
      -rw-r--r-- root/root 893 Sep 27 15:26 2016 ppman-lite.log
      -rw-r--r-- root/root 1971 Sep 28 09:58 2016 ppman.log
      -rw-rw-rw- root/root 544439 Sep 28 23:31 2016 amd_jrpc.log
      -rw-rw-rw- root/root 0 Sep 27 15:25 2016 amd.log
      -rw-r--r-- root/root 10813 Sep 27 15:26 2016 spfe.log
      -rw-r--r-- root/root 408984 Sep 27 15:27 2016 dpd.log
      -rw-r----- root/root 1480 Sep 27 15:25 2016 user.log
      -rw-r----- root/root 130914 Sep 27 15:26 2016 daemon.log
      -rw-r--r-- root/root 41 Sep 27 15:25 2016 cjob.log
      -rw-r----- root/root 5945 Sep 27 15:25 2016 debug
      -rw-r----- root/root 44637 Sep 28 23:26 2016 messages
      -rw-r----- root/root 50324 Sep 28 23:26 2016 kern.log
      -rw-r----- root/root 198785 Sep 28 23:30 2016 syslog
      -rw-r----- root/root 510 Apr 25 12:39 2016 user.log.4.gz
      -rw-r----- root/root 228824 Apr 25 12:39 2016 syslog.4.gz
      -rw-r----- root/root 48578 Apr 27 10:36 2016 syslog.3.gz
      -rw-r----- root/root 151387 Aug 1 14:09 2016 syslog.2.gz
      -rw-r----- root/root 121389 Sep 27 15:21 2016 syslog.1.gz
      -rw-r----- root/root 22629 Aug 1 14:09 2016 messages.2.gz
      -rw-r----- root/root 18897 Sep 27 15:21 2016 messages.1.gz
      -rw-r--r-- root/root 16922 Sep 27 15:21 2016 lcmd.log.1.gz
      -rw-r----- root/root 18873 Sep 27 15:07 2016 kern.log.1.gz
      -rw-r----- root/root 1313 Apr 21 21:20 2016 debug.4.gz
      -rw-r----- root/root 1312 Apr 25 12:40 2016 debug.3.gz
      -rw-r----- root/root 1315 Jul 10 09:39 2016 debug.2.gz
      -rw-r----- root/root 1306 Sep 11 10:00 2016 debug.1.gz
      -rw-r----- root/root 66854 Jul 25 14:30 2016 daemon.log.4.gz
      -rw-r----- root/root 33758 Aug 1 14:09 2016 daemon.log.3.gz
      -rw-r----- root/root 68385 Sep 11 10:12 2016 daemon.log.2.gz
      -rw-r----- root/root 13375 Sep 27 15:21 2016 daemon.log.1.gz
      -rw-r----- root/root 13536 Apr 25 12:39 2016 auth.log.4.gz
      -rw-r--r-- root/root 111 Sep 27 15:25 2016 postinstall.log
      -rw-r----- root/root 1717 Sep 27 15:25 2016 boot
      -rw-rw-r-- root/root 9216 Sep 28 11:14 2016 wtmp
  • Use the CLI to collect Extended Port Tx and Rx Statistics:

    Statistics from Cascade Port PFE

    labroot@AD> request pfe execute command "show interfaces statistics ge-202/0/49" target fpc1 | match packets/sec

    GOT: 17091 total packets input (1 packets/sec)
    GOT: 19083 total packets output (1 packets/sec)
    GOT: 17091 transit packets input (1 packets/sec)
    GOT: 19083 transit packets output (1 packets/sec)

    labroot@AD> request pfe execute command "show interfaces statistics xe-101/0/45" target fpc1 | match packets/sec

    GOT: 75779 total packets input (1 packets/sec)
    GOT: 41406 total packets output (1 packets/sec)
    GOT: 75779 transit packets input (1 packets/sec)
    GOT: 41406 transit packets output (1 packets/sec)

    Statistics from Operational mode command

    labroot@AD> show interfaces statistics xe-101/0/45 | match rate

    Input rate : 1472 bps (1 pps)
    Output rate : 752 bps (1 pps)

    labroot@AD> show interfaces statistics ge-202/0/49 | match rate

    Input rate : 960 bps (1 pps)
    Output rate : 960 bps (1 pps)

Modification History

2023-03-25: PR 1442163 disabled logging for SDs when RSI is running on AD for security reasons.

Related Information

PR1442163 - The RSI command might not work if it is executed on AD to archive logs of SDs in a Junos Fusion setup