This article provides the information to collect to assist in troubleshooting prior to opening a satellite / Junos Fusion case where the MX is the AD (Aggregate Device) and the SD (Satellite Device) is EX/QFX.
The goal of this document is to reduce the time spent on initial data collection and reduce time to resolve by providing a comprehensive list of what to collect or gather to troubleshoot a Junos Fusion issue.
show chassis hardware satellite | no-more show chassis firmware satellite | no-more show chassis environment satellite | no-more show chassis alarms satellite | no-more show chassis routing-engine satellite | no-more show chassis fan satellite | no-more show chassis temperature-thresholds satellite | no-more show chassis led satellite | no-more show chassis satellite | no-more show chassis satellite detail | no-more show chassis satellite fpc extensive | no-more show chassis satellite neighbor brief | no-more show chassis satellite extended-port detail | no-more show chassis satellite extensive | no-more show chassis satellite neighbor extensive | no-more show chassis satellite software
Note: On a Fusion system “show chassis hardware” does not show all devices participating in that Fusion setup. It only shows the hardware info from the aggregation node, and in the output there is no indication of attached satellites. To show info on the satellite devices participating in that Fusion setup, a different command is required: “show chassis hardware satellite”.
show system core-dumps satellite
request chassis satellite file-copy local <source SD>:/var/log/* <destination>/var/tmp/sd201_var_log <source> URL of source file e.g. for SD, use sd201:/ <destination> URL of destination file e.g. for AD, use /var/tmp/ Example: request chassis satellite file-copy local sd201:/var/log/* /var/tmp/sd201_var_log
Verification:
Allow root user login on AD user@AD> show configuration system services ssh root-login allow; Create directory under /var/tmp/ of AD. user@AD> file make-directory /var/tmp/sd201_var_log/ user@AD> file list detail /var/tmp |match sd201 drwxr-xr-x 2 user wheel 512 Mar 21 20:24 sd201_var_log/ user@AD> file list detail /var/tmp/sd201_var_log/ /var/tmp/sd201_var_log/: total blocks: 16 total files: 0 Collect /var/log from SD. This operation must be performed with root user privilege. root@AD> request chassis satellite file-copy local sd201:/var/log/* /var/tmp/sd201_var_log/ Password: amd.log 100% 62KB 4.1MB/s 00:00 amd_jrpc.log 100% 741KB 7.3MB/s 00:00 amd_jrpc.log.1 100% 1024KB 8.9MB/s 00:00 amd_jrpc.log.2 100% 1024KB 8.0MB/s 00:00 amd_jrpc.log.3 100% 1024KB 8.2MB/s 00:00 amd_jrpc.log.4 100% 1024KB 12.3MB/s 00:00 auth.log 100% 475KB 7.9MB/s 00:00 auth.log.1.gz 100% 95KB 7.3MB/s 00:00 auth.log.2.gz 100% 96KB 11.1MB/s 00:00 boot 100% 2358 932.4KB/s 00:00 boot~ 100% 2356 1.0MB/s 00:00 cpd.log 100% 567KB 8.0MB/s 00:00 cron.log 100% 357KB 8.3MB/s 00:00 cron.log.1.gz 100% 113KB 7.3MB/s 00:00 daemon.log 100% 624KB 10.4MB/s 00:00 daemon.log.1.gz 100% 63KB 7.1MB/s 00:00 daemon.log.2.gz 100% 62KB 9.7MB/s 00:00 daemon.log.3.gz 100% 62KB 7.1MB/s 00:00 daemon.log.4.gz 100% 61KB 7.6MB/s 00:00 debug 100% 67KB 12.9MB/s 00:00 dmesg 100% 54KB 11.8MB/s 00:00 dmesg.1 100% 55KB 8.6MB/s 00:00 dmesg.2 100% 54KB 7.5MB/s 00:00 dpd.log 100% 3059KB 9.1MB/s 00:00 file_compress.log 100% 1876 1.2MB/s 00:00 file_copy.log 100% 22KB 7.6MB/s 00:00 scp: /var/log/glusterfs: not a regular file kern.log 100% 435KB 8.0MB/s 00:00 lastlog 100% 574KB 8.6MB/s 00:00 lcmd.log 100% 292KB 7.9MB/s 00:00 lcmd.log.0 100% 4965KB 8.2MB/s 00:00 libdrv.log 100% 1187 722.3KB/s 00:00 mcelog 100% 0 0.0KB/s 00:00 messages 100% 497KB 11.4MB/s 00:00 postinstall.log 100% 95 36.1KB/s 00:00 ppman-lite.log 100% 282KB 12.7MB/s 00:00 ppman-lite.log.0 100% 4881KB 10.1MB/s 00:00 ppman.log 100% 4878KB 9.4MB/s 00:00 scp: /var/log/sa: not a regular file sanlock.log 100% 351 219.1KB/s 00:00 spfe.log 100% 173KB 9.0MB/s 00:00 sw_update.log 100% 5505 2.1MB/s 00:00 sw_update.log.0 100% 4454 2.0MB/s 00:00 sw_update.log.1 100% 4454 1.9MB/s 00:00 sw_update.log.2 100% 5544 4.1MB/s 00:00 sw_update.log.3 100% 4414 2.2MB/s 00:00 syslog 100% 931 575.3KB/s 00:00 syslog.1.gz 100% 331KB 9.3MB/s 00:00 syslog.2.gz 100% 274KB 7.6MB/s 00:00 syslog.3.gz 100% 20 6.8KB/s 00:00 user.log 100% 185KB 7.7MB/s 00:00 v44_installer.log 100% 759KB 14.6MB/s 00:00 scp: /var/log/watchdog: not a regular file wtmp 100% 31KB 7.2MB/s 00:00 All the files are copied from satellite-device sd201“/var/log/” directory to AD“/var/tmp/sd201_var_log“. user@AD> file list detail /var/tmp/sd201_var_log/ /var/tmp/sd201_var_log/: total blocks: 60288 -rw-r--r-- 1 root wheel 63978 Mar 21 20:41 amd.log -rw-r--r-- 1 root wheel 765405 Mar 21 20:41 amd_jrpc.log -rw-r--r-- 1 root wheel 1048551 Mar 21 20:41 amd_jrpc.log.1 -rw-r--r-- 1 root wheel 1048529 Mar 21 20:41 amd_jrpc.log.2 -rw-r--r-- 1 root wheel 1048525 Mar 21 20:41 amd_jrpc.log.3 -rw-r--r-- 1 root wheel 1048515 Mar 21 20:41 amd_jrpc.log.4 -rw-r----- 1 root wheel 487284 Mar 21 20:41 auth.log -rw-r----- 1 root wheel 97769 Mar 21 20:41 auth.log.1.gz -rw-r----- 1 root wheel 98714 Mar 21 20:41 auth.log.2.gz -rw-r----- 1 root wheel 2358 Mar 21 20:41 boot -rw-r--r-- 1 root wheel 2356 Mar 21 20:41 boot~ -rw-r--r-- 1 root wheel 580849 Mar 21 20:41 cpd.log -rw-r----- 1 root wheel 365989 Mar 21 20:41 cron.log -rw-r----- 1 root wheel 115359 Mar 21 20:41 cron.log.1.gz -rw-r----- 1 root wheel 639182 Mar 21 20:41 daemon.log -rw-r----- 1 root wheel 64030 Mar 21 20:41 daemon.log.1.gz -rw-r----- 1 root wheel 63920 Mar 21 20:41 daemon.log.2.gz -rw-r----- 1 root wheel 63418 Mar 21 20:41 daemon.log.3.gz -rw-r----- 1 root wheel 62619 Mar 21 20:41 daemon.log.4.gz -rw-r----- 1 root wheel 68682 Mar 21 20:41 debug -rw-r--r-- 1 root wheel 55684 Mar 21 20:41 dmesg -rw-r--r-- 1 root wheel 55831 Mar 21 20:41 dmesg.1 -rw-r--r-- 1 root wheel 55360 Mar 21 20:41 dmesg.2 -rw-r--r-- 1 root wheel 3132217 Mar 21 20:41 dpd.log -rw-r--r-- 1 root wheel 1876 Mar 21 20:41 file_compress.log -rw-r--r-- 1 root wheel 22443 Mar 21 20:41 file_copy.log -rw-r----- 1 root wheel 444974 Mar 21 20:41 kern.log -rw-r--r-- 1 root wheel 587796 Mar 21 20:41 lastlog -rw-r--r-- 1 root wheel 298665 Mar 21 20:41 lcmd.log -rw-r--r-- 1 root wheel 5084596 Mar 21 20:41 lcmd.log.0 -rw-r--r-- 1 root wheel 1187 Mar 21 20:41 libdrv.log -rw-r--r-- 1 root wheel 0 Mar 21 20:41 mcelog -rw-r----- 1 root wheel 508690 Mar 21 20:41 messages -rw-r--r-- 1 root wheel 95 Mar 21 20:41 postinstall.log -rw-r--r-- 1 root wheel 288370 Mar 21 20:41 ppman-lite.log -rw-r--r-- 1 root wheel 4998203 Mar 21 20:41 ppman-lite.log.0 -rw-r--r-- 1 root wheel 4994809 Mar 21 20:41 ppman.log -rw-r--r-- 1 root wheel 351 Mar 21 20:41 sanlock.log -rw-r--r-- 1 root wheel 177450 Mar 21 20:41 spfe.log -rw-r--r-- 1 root wheel 5505 Mar 21 20:41 sw_update.log -rw-r--r-- 1 root wheel 4454 Mar 21 20:41 sw_update.log.0 -rw-r--r-- 1 root wheel 4454 Mar 21 20:41 sw_update.log.1 -rw-r--r-- 1 root wheel 5544 Mar 21 20:41 sw_update.log.2 -rw-r--r-- 1 root wheel 4414 Mar 21 20:41 sw_update.log.3 -rw-r----- 1 root wheel 1017 Mar 21 20:41 syslog -rw-r----- 1 root wheel 338766 Mar 21 20:41 syslog.1.gz -rw-r----- 1 root wheel 280342 Mar 21 20:41 syslog.2.gz -rw-r----- 1 root wheel 20 Mar 21 20:41 syslog.3.gz -rw-r----- 1 root wheel 188943 Mar 21 20:41 user.log -rw-r--r-- 1 root wheel 777437 Mar 21 20:41 v44_installer.log -rw-r--r-- 1 root wheel 31872 Mar 21 20:41 wtmp total files: 51 Archive and compress all the files. user@AD> file archive compress source /var/tmp/sd201_var_log/* destination /var/tmp/sd201_var_log.tgz tar: Removing leading '/' from member names user@AD> file list detail /var/tmp |match sd201 drwxr-xr-x 2 user wheel 1536 Mar 21 20:41 sd201_var_log/ -rw------- 1 root wheel 3554437 Mar 21 20:42 sd201_var_log.tgz
request chassis satellite file-copy local <source SD>:/var/tmp/corefiles/* <destination> /var/tmp/ <source-SD> URL of source file e.g. For SD, use sd201:/ <destination-AD> URL of destination file e.g. For AD, use /var/tmp/
Example: request chassis satellite file-copy local sd201:/var/tmp/corefiles/* /var/tmp/Core_destination
request chassis satellite file-copy local sd201:/var/tmp/corefiles/* /var/tmp/Core_destination
This will copy core files from satellite-device 201“/corefiles” directory to AD “/var/tmp”.
Verification: Create directory under /var/tmp/ of AD. user@AD> file make-directory /var/tmp/Core_destination user@AD> file list detail /var/tmp |match Core_destination drwxr-xr-x 2 user wheel 512 Mar 21 21:25 Core_destination/ user@AD> file list detail /var/tmp/Core_destination /var/tmp/Core_destination: total blocks: 16 total files: 0 Collect core-dumps from SD. This operation must be performed with root user privilege. root@AD> request chassis satellite file-copy local sd201:/var/tmp/corefiles/* /var/tmp/Core_destination Check if any core file is copied to /var/tmp/Core_destination/ of AD. user@AD> file list detail /var/tmp/Core_destination/
show interfaces extensive *-201/*| match "Physical|flapped" | no-more
show interfaces extensive *-201/*| match "Physical|error" | no-more