This article provides the reason for software upgrade failing for a PTX 10008 device running Junos EVO with the error "Not enough space left on version partition. Aborting Upgrade." It also details a workaround for the error.
When you run the software add command, the following error is reported and then the upgrade fails:
software add
request system software add /var/tmp/junos-evo-install-ptx-x86-64-20.4R3.4-EVO no-validate reboot Adding software images. This process can take several minutes. Please be patient... Download and Validate in Progress re0: Starting upgrade : /var/tmp/junos-evo-install-ptx-x86-64-20.4R3.4-EVO re0: Upgrade version : junos-evo-install-ptx-x86-64-20.4R3.4-EVO re0: Running pre-checks for 'junos-evo-install-ptx-x86-64-20.4R3.4-EVO' re0: Partition /data is almost full. Free space using one of the following cmds.. re0: To delete a specific SW version use "request system software delete" re0: To delete all archived SW versions use "request system software delete archived" re0: To auto-delete older SW version use "request system software add <pkg> force " re0: To clean storage use "request system storage cleanup " re0: Not enough space left on version partition. Aborting Upgrade. ERROR: Not enough space to install software. Node:re0 Image: re0:/var/tmp/junos-evo-install-ptx-x86-64-20.4R3.4-EVO Validation and download failed. Aborting upgrade.
If you check the capacity for /var/tmp , no issues are found as shown below:
/var/tmp
show system storage fpc0: -------------------------------------------------------------------------- Filesystem Size Used Avail Capacity Mounted on /dev/root 30M 30M 0 100% /run/initramfs /dev/ram1p2 4.9G 566M 4.1G 13% /soft /dev/ram1p5 93M 19M 68M 22% /data /dev/ram1p7 2.7G 106M 2.4G 5% /var /dev/loop0 379M 2.3M 353M 1% /data/var/external devtmpfs 16G 0 16G 0% /dev /tmp 16G 0 16G 0% /run/initramfs/uswitch/tmp /dev/loop1 7.6M 7.6M 0 100% /run/initramfs/uswitch/data/hashes/379723815e34a9e9921e6a803febf167da0bb33f /dev/loop2 329M 329M 0 100% /run/initramfs/uswitch/data/hashes/9426ea87c5b92afe9e6b2f1bd1d1972c865e7ea6 /dev/loop3 11M 11M 0 100% /run/initramfs/uswitch/data/hashes/357fcaa5862c636444943cd9f672d14f223378cc /dev/loop4 57M 57M 0 100% /run/initramfs/uswitch/data/hashes/87c70510c99fed18a91c748b51f57ddacc73797b /dev/loop5 31M 31M 0 100% /run/initramfs/uswitch/data/hashes/8e48a36209734fd7225b6afea6230ad209fcf18e /dev/loop6 8.2M 8.2M 0 100% /run/initramfs/uswitch/data/hashes/d8b0ea5e67fd83fea5d8c56a79fd036e08f44644 /dev/loop7 30M 30M 0 100% /run/initramfs/uswitch/data/hashes/ecee3c9b74b198f2c92f8284439b0cb3e43c4230 /dev/loop8 4.1M 4.1M 0 100% /run/initramfs/uswitch/data/hashes/4928d824c7919061328f9bf483e5af341ad4ac9d /dev/loop9 3.1M 3.1M 0 100% /run/initramfs/uswitch/data/hashes/80877b0eb7b0c9bbcbd6e0cc76563b4f8e90edfc /dev/loop10 39M 39M 0 100% /run/initramfs/uswitch/data/hashes/6d835981bc0f846eba6e1b795fad5a6342a8a037 uswitchd 3.1M 3.1M 0 100% / /dev/ram1p1 19M 2.0M 17M 11% /boot /dev/ram1p6 93M 1.6M 85M 2% /data/config /tmp 16G 24K 16G 1% /tmp tmpfs 16G 2.3M 16G 1% /run tmpfs 16G 244M 16G 2% /dev/shm tmpfs 16G 0 16G 0% /sys/fs/cgroup re0: -------------------------------------------------------------------------- Filesystem Size Used Avail Capacity Mounted on /dev/root 34M 34M 0 100% /run/initramfs /dev/sda2 32G 18G 13G 57% /soft /dev/sda5 3.0G 2.6G 185M 94% /data /dev/sda7 145G 64G 74G 47% /var /dev/loop0 15G 38M 14G 1% /data/var/external devtmpfs 32G 0 32G 0% /dev /tmp 32G 0 32G 0% /run/initramfs/uswitch/tmp /dev/loop1 476M 476M 0 100% /run/initramfs/uswitch/data/hashes/160fc0e6c8d9496b97f521878d8f283e3464b9fc /dev/loop2 28M 28M 0 100% /run/initramfs/uswitch/data/hashes/f5f85b91ac4fef9846c04bc4a9fa1214a9b8626b /dev/loop3 36M 36M 0 100% /run/initramfs/uswitch/data/hashes/3097eac3877930833b236b95b4fd24dc52fa96a3 /dev/loop4 11M 11M 0 100% /run/initramfs/uswitch/data/hashes/2db9213abd5ed9cd6c299fb1e8d77131b1d18904 /dev/loop5 43M 43M 0 100% /run/initramfs/uswitch/data/hashes/6a0c23ac134ab738088ade46325d4d6c82fe24c4 /dev/loop6 9.8M 9.8M 0 100% /run/initramfs/uswitch/data/hashes/24273bf67270d59fc836fc4ea35af7203f8c37d9 /dev/loop7 58M 58M 0 100% /run/initramfs/uswitch/data/hashes/fdb7ee36355858ea87a785d84206f8a5e47ec5f5 /dev/loop8 34M 34M 0 100% /run/initramfs/uswitch/data/hashes/e2b9b29af63d515471a88e5f4345139716fb4854 /dev/loop9 8.2M 8.2M 0 100% /run/initramfs/uswitch/data/hashes/284e0a3fa5f7c50ce78be61fdff2a21029b863e7 /dev/loop10 34M 34M 0 100% /run/initramfs/uswitch/data/hashes/a08929d566717b028eed8cfc073882556d7076e7 /dev/loop11 6.9M 6.9M 0 100% /run/initramfs/uswitch/data/hashes/096315b8eaa91fc0c7e671dcab382ced5d110d4e /dev/loop12 4.2M 4.2M 0 100% /run/initramfs/uswitch/data/hashes/ee58ddc00e749e448e814baccc0d929c746b2879 /dev/loop13 4.5M 4.5M 0 100% /run/initramfs/uswitch/data/hashes/6051f35a30e8434cb23eede57111dd09ffd76aef /dev/loop14 148M 148M 0 100% /run/initramfs/uswitch/data/hashes/086fc5b03c8b01057e8b7d5f8d0de567900d2af1 uswitchd 4.2M 4.2M 0 100% / /dev/sda1 196M 19M 178M 10% /boot /dev/sda6 984M 2.4M 915M 1% /data/config /tmp 32G 84K 32G 1% /tmp tmpfs 32G 320M 31G 1% /run tmpfs 32G 1.7G 30G 6% /dev/shm tmpfs 32G 0 32G 0% /sys/fs/cgroup tmpfs 6.3G 0 6.3G 0% /run/user/2012 tmpfs 6.3G 0 6.3G 0% /run/user/0 re1: -------------------------------------------------------------------------- Filesystem Size Used Avail Capacity Mounted on /dev/root 34M 34M 0 100% /run/initramfs /dev/sda2 32G 18G 13G 57% /soft /dev/sda5 3.0G 2.5G 282M 91% /data /dev/sda7 145G 70G 68G 51% /var /dev/loop0 15G 38M 14G 1% /data/var/external devtmpfs 32G 0 32G 0% /dev /tmp 32G 0 32G 0% /run/initramfs/uswitch/tmp /dev/loop1 476M 476M 0 100% /run/initramfs/uswitch/data/hashes/160fc0e6c8d9496b97f521878d8f283e3464b9fc /dev/loop2 28M 28M 0 100% /run/initramfs/uswitch/data/hashes/f5f85b91ac4fef9846c04bc4a9fa1214a9b8626b /dev/loop3 36M 36M 0 100% /run/initramfs/uswitch/data/hashes/3097eac3877930833b236b95b4fd24dc52fa96a3 /dev/loop4 11M 11M 0 100% /run/initramfs/uswitch/data/hashes/2db9213abd5ed9cd6c299fb1e8d77131b1d18904 /dev/loop5 43M 43M 0 100% /run/initramfs/uswitch/data/hashes/6a0c23ac134ab738088ade46325d4d6c82fe24c4 /dev/loop6 9.8M 9.8M 0 100% /run/initramfs/uswitch/data/hashes/24273bf67270d59fc836fc4ea35af7203f8c37d9 /dev/loop7 58M 58M 0 100% /run/initramfs/uswitch/data/hashes/fdb7ee36355858ea87a785d84206f8a5e47ec5f5 /dev/loop8 34M 34M 0 100% /run/initramfs/uswitch/data/hashes/e2b9b29af63d515471a88e5f4345139716fb4854 /dev/loop9 8.2M 8.2M 0 100% /run/initramfs/uswitch/data/hashes/284e0a3fa5f7c50ce78be61fdff2a21029b863e7 /dev/loop10 34M 34M 0 100% /run/initramfs/uswitch/data/hashes/a08929d566717b028eed8cfc073882556d7076e7 /dev/loop11 6.9M 6.9M 0 100% /run/initramfs/uswitch/data/hashes/096315b8eaa91fc0c7e671dcab382ced5d110d4e /dev/loop12 4.2M 4.2M 0 100% /run/initramfs/uswitch/data/hashes/ee58ddc00e749e448e814baccc0d929c746b2879 /dev/loop13 4.5M 4.5M 0 100% /run/initramfs/uswitch/data/hashes/6051f35a30e8434cb23eede57111dd09ffd76aef /dev/loop14 148M 148M 0 100% /run/initramfs/uswitch/data/hashes/086fc5b03c8b01057e8b7d5f8d0de567900d2af1 uswitchd 4.2M 4.2M 0 100% / /dev/sda1 196M 19M 178M 10% /boot /dev/sda6 984M 2.4M 915M 1% /data/config /tmp 32G 104K 32G 1% /tmp tmpfs 32G 327M 31G 2% /run tmpfs 32G 1.7G 30G 6% /dev/shm tmpfs 32G 0 32G 0% /sys/fs/cgroup
However, when you check the software list command to see the archived versions on the device, you see the following. It is just that the version partition does not have enough space.
software list
show system software list ------------------------------- node: fpc0 ------------------------------- Active boot device is primary: /dev/ram1 List of installed version(s) : '-' running version '>' next boot version after upgrade/downgrade '<' rollback boot version - junos-evo-install-ptx-x86-64-20.4R3.4-EVO - [2021-08-24 16:12:38] ------------------------------- node: re0 ------------------------------- Active boot device is primary: /dev/sda List of installed version(s) : '-' running version '>' next boot version after upgrade/downgrade '<' rollback boot version - junos-evo-install-ptx-x86-64-20.4R3.4-EVO - [2021-08-24 15:59:11] < junos-evo-install-ptx-x86-64-20.4R2.14-EVO - [2021-08-24 15:26:07] junos-evo-install-ptx-x86-64-20.4I20210812205037-EVO - [2021-08-13 12:40:52] junos-evo-install-ptx-x86-64-20.4R2-S3.7-EVO - [2021-08-17 17:42:35] junos-evo-install-ptx-x86-64-20.4I20210810122024-EVO- [2021-08-10 20:39:12] junos-evo-install-ptx-x86-64-20.4I20210810145637-EVO - [2021-08-10 23:11:04] junos-evo-install-ptx-x86-64-20.4I20210809150026-EVO - [2021-08-09 22:31:50] junos-evo-install-ptx-x86-64-20.4I20210809115421-EVO - [2021-08-09 19:32:18] junos-evo-install-ptx-x86-64-20.4I20210804135013-EVO - [2021-08-10 08:14:26] junos-evo-install-ptx-x86-64-21.3-202108021729.0-EVO - [2021-08-03 20:02:28] junos-evo-install-ptx-x86-64-20.4R2-S3-202107310101.0-EVO - [2021-08-03 20:36:20] junos-evo-install-ptx-x86-64-20.3R1-S3.12-EVO - [2021-06-07 09:27:11] junos-evo-install-ptx-x86-64-20.1R2-S3.13-EVO - [2021-07-06 14:52:31] junos-evo-install-ptx-x86-64-20.1R1-S1.7-EVO - [2021-04-27 17:34:40] ------------------------------- node: re1 ------------------------------- Active boot device is primary: /dev/sda List of installed version(s) : '-' running version '>' next boot version after upgrade/downgrade '<' rollback boot version - junos-evo-install-ptx-x86-64-20.4R3.4-EVO - [2021-08-24 15:59:11] < junos-evo-install-ptx-x86-64-20.4R2.14-EVO - [2021-08-24 15:26:07] junos-evo-install-ptx-x86-64-20.4I20210812205037-EVO - [2021-08-13 12:40:52] junos-evo-install-ptx-x86-64-20.4R2-S3.7-EVO - [2021-08-17 17:42:35] junos-evo-install-ptx-x86-64-20.4I20210810122024-EVO- [2021-08-10 20:39:12] junos-evo-install-ptx-x86-64-20.4I20210810145637-EVO- [2021-08-10 23:11:04] junos-evo-install-ptx-x86-64-20.4I20210809150026-EVO - [2021-08-09 22:31:50] junos-evo-install-ptx-x86-64-20.4I20210809115421-EVO- [2021-08-09 19:32:18] junos-evo-install-ptx-x86-64-20.4I20210804135013-EVO- [2021-08-10 08:14:26] junos-evo-install-ptx-x86-64-21.3-202108021729.0-EVO - [2021-08-03 20:02:28] junos-evo-install-ptx-x86-64-20.4R2-S3-202107310101.0-EVO - [2021-08-03 20:36:20] junos-evo-install-ptx-x86-64-20.3R1-S3.12-EVO - [2021-06-07 09:27:11] junos-evo-install-ptx-x86-64-20.1R2-S3.13-EVO - [2021-07-06 14:52:31] junos-evo-install-ptx-x86-64-20.1R1-S1.7-EVO - [2021-04-27 17:34:40]
As you see above, there are several archived versions, which are using up space in the version partition.
To remove the archived versions, run the request system software delete archived command. This command will delete all the archived versions, retaining only the current and the rollback versions.
request system software delete archived
request system software delete archived ALERT: This command will delete all archived SW versions except current and rollback. Do you want to proceed? [yes,no] (no) yes Software delete in progress... re0: Executing Software delete... re0: Removing version junos-evo-install-ptx-x86-64-20.1R1-S1.7-EVO... re0: Removing version junos-evo-install-ptx-x86-64-20.1R2-S3.13-EVO... re0: Removing version junos-evo-install-ptx-x86-64-20.3R1-S3.12-EVO... re0: Removing version junos-evo-install-ptx-x86-64-20.4R2-S3-202107310101.0-EVO... re0: Removing version junos-evo-install-ptx-x86-64-21.3-202108021729.0-EVO... re0: Removing version junos-evo-install-ptx-x86-64-20.4I20210804135013-EVO... re0: Removing version junos-evo-install-ptx-x86-64-20.4I20210809115421-EVO... re0: Removing version junos-evo-install-ptx-x86-64-20.4I20210809150026-EVO... re0: Removing version junos-evo-install-ptx-x86-64-20.4I20210810145637-EVO... re0: Removing version junos-evo-install-ptx-x86-64-20.4I20210810122024-EVO... re0: Removing version junos-evo-install-ptx-x86-64-20.4R2-S3.7-EVO... re0: Removing version junos-evo-install-ptx-x86-64-20.4I20210812205037-EVO... re1: Removing version junos-evo-install-ptx-x86-64-21.3-202108021729.0-EVO... re1: Removing version junos-evo-install-ptx-x86-64-20.4I20210809150026-EVO... re1: Removing version junos-evo-install-ptx-x86-64-20.4R2-S3-202107310101.0-EVO... re1: Removing version junos-evo-install-ptx-x86-64-20.3R1-S3.12-EVO... re1: Removing version junos-evo-install-ptx-x86-64-20.1R1-S1.7-EVO... re1: Removing version junos-evo-install-ptx-x86-64-20.4I20210810122024-EVO... Image deletion succeeded.
Attempt to run the software add command again after deleting the archived versions to upgrade the device and the upgrade should go through.
request system software add /var/tmp/junos-evo-install-ptx-x86-64-20.4R3.4-EVO no-validate reboot Adding software images. This process can take several minutes. Please be patient... Download and Validate in Progress re0: Starting upgrade : /var/tmp/junos-evo-install-ptx-x86-64-20.4R3.4-EVO re0: Upgrade version : junos-evo-install-ptx-x86-64-20.4R3.4-EVO re0: Running pre-checks for 'junos-evo-install-ptx-x86-64-20.4R3.4-EVO' re0: Pre-checks pass successfully, copying files to software area re0: Running post install commands... re0: Post install sequence was successful. re0: Skipping Validation re0: Boot version is now 'junos-evo-install-ptx-x86-64-20.4R3.4-EVO' re0: Updating all nodes... re1: Running pre-checks for 'junos-evo-install-ptx-x86-64-20.4R3.4-EVO' re1: Pre-checks pass successfully, copying files to software area re1: Running post install commands... re1: Post install sequence was successful. !re1: Boot version is now 'junos-evo-install-ptx-x86-64-20.4R3.4-EVO' re0: Other nodes have been updated successfully re0: Cluster wide installation was successful Image validation and installation succeeded. Rebooting.
If the upgrade fails even after deleting the archived versions, contact Support for further assistance.