Description

This KB defines points to check if the user tries to upgrade the OS of two switches, however, fail the process from Apstra.


Apstra V4.1.1

Juniper QFX5120-48Y

Actual version: 19.1R3-S2.3

New version: 21.2R3-S2.9

Symptoms

Logs shows:

2024-11-13 00:25:00,894 INFO:192.168.1.1 upgrade
2024-11-13 00:25:01,283 INFO:Successful connection check..
2024-11-13 00:25:01,284 INFO:TASK: Get platform type
2024-11-13 00:25:08,230 INFO:192.168.1.1::junos
2024-11-13 00:25:08,232 INFO:System Agent id: 
2024-11-13 00:25:08,232 INFO:TASK: Get device facts
2024-11-13 00:25:08,234 INFO:Command (timeout-120): show chassis hardware | display json
2024-11-13 00:25:08,234 INFO:command (timeout-120): uptime
2024-11-13 00:25:09,347 INFO:Command (timeout-120): show system information | display xml | match Model
2024-11-13 00:25:09,897 INFO:Command (timeout-120): show version | display json
2024-11-13 00:25:10,992 INFO:{'apstra_platform': 'junos', 'apstra_platform_version': u'19.1R3-S2.3', 'apstra_secure_sysdb': None, 'apstra_serial_number': u'AAAAAAAAAAAAAA', 'aos_agent_running': None, 'apstra_aos_operation_mode': 'notInstalled', 'apstra_model_name': u'JNP9999-CHAS', 'apstra_aos_agent_version': 'absent', 'apstra_nos_version': u'19.1R3-S2.3', 'apstra_nos_type': 'junos'}
2024-11-13 00:25:10,992 INFO:TASK: Download image
2024-11-13 00:25:10,994 INFO:New image: https://192.168.1.1/dos_images/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz
2024-11-13 00:25:10,995 INFO:Command (timeout-120): file list /var/tmp
2024-11-13 00:25:11,536 INFO:Cleanup storage to make space for NOS image download
2024-11-13 00:25:11,537 INFO:Command (timeout-120): request system storage cleanup no-confirm
2024-11-13 00:25:22,320 INFO:localre:
--------------------------------------------------------------------------

List of files to delete:

	 Size Date	   Name
   147B Nov 13 00:27 /var/log/default-log-messages.0.gz
  7512B Nov 13 00:27 /var/log/interactive-commands.0.gz
  1186B Nov 13 00:27 /var/log/messages.0.gz
    27B Nov 13 00:19 /var/log/wtmp.0.gz
2024-11-13 00:25:22,321 INFO:Command (timeout-120): show route instance operational
2024-11-13 00:25:22,852 INFO:Downloading image..
2024-11-13 00:25:22,852 INFO:Command (timeout-1200): fetch-secure -o /var/tmp/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz https://192.168.1.1/dos_images/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz && echo APSTRA_CMD_SUCCESS
2024-11-13 00:26:39,502 INFO:Command (timeout-1200): fetch-secure -o /var/tmp/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz https://192.168.1.1/dos_images/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz && echo APSTRA_CMD_SUCCESS
2024-11-13 00:27:55,061 INFO:Command (timeout-1200): fetch-secure -o /var/tmp/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz https://192.168.1.1/dos_images/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz && echo APSTRA_CMD_SUCCESS
2024-11-13 00:29:10,600 INFO:Command (timeout-1200): fetch-secure -o /var/tmp/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz https://192.168.1.1/dos_images/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz && echo APSTRA_CMD_SUCCESS
2024-11-13 00:30:26,146 INFO:Command (timeout-1200): fetch-secure -o /var/tmp/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz https://192.168.1.1/dos_images/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz && echo APSTRA_CMD_SUCCESS
2024-11-13 00:31:41,687 INFO:Command (timeout-1200): fetch-secure -o /var/tmp/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz https://192.168.1.1/dos_images/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz && echo APSTRA_CMD_SUCCESS
2024-11-13 00:32:57,244 ERROR:Failed to fetch image from source
2024-11-13 00:32:57,244 INFO:fetch-secure: https://192.168.1.1/dos_images/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz: Operation timed out
2024-11-13 00:32:57,244 INFO:Download took 454s
2024-11-13 00:32:57,246 INFO:Command (timeout-120): file list /var/tmp
2024-11-13 00:32:57,789 ERROR:Failed to download image: https://192.168.1.1/dos_images/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz
None
2024-11-13 00:32:57,790 ERROR:FAILED
2024-11-13 00:32:57,791 ERROR:Failed to download image: https://192.168.1.1/dos_images/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz
Traceback (most recent call last):
  File "/aos/system_agent/runner/aos_device_installer/run.py", line 100, in <module>
    action.run_action()
  File "/aos/system_agent/runner/actions/base_action.py", line 315, in run_action
    self.run()
  File "/aos/system_agent/runner/actions/juniper.py", line 690, in run
    self.download_image()
  File "/aos/system_agent/runner/actions/utils/base_di.py", line 195, in wrapped
    return f(self, *args, **kwargs)
  File "/aos/system_agent/runner/actions/juniper.py", line 516, in download_image
    self, 'Failed to download image: %s' % self.src)
AOSDIException: Failed to download image: https://192.168.1.1/dos_images/jinstall-host-qfx-5e-x86-64-21.2R3-S2.9-secure-signed.tgz

Solution

Above logs shows:

Apstra is able to run device facts like show version and system information , hence the connectivity is UP and running

But when download image fetch-secure was called the operation timed out.


Possible Causes:

Download never initiated

Download started but stalled due to network issues


Cause in this specific case was a Firewall which was blocking https traffic.


Modification History

2024-11-22 : Article Created