The NG-RE has already upgrade to 24.4 daily, but when trying to upgrade to a different 24.4 daily image, it failed and complained that there has not enough space in /hostinstall.
Verified junos-vmhost-install-mx-x86-64-24.4I20240715_1528_aramadoss signed by PackageDevelopmentECP256_2024 method ECDSA256+SHA256
i40e NVM version is 9.10
Proceeding with install
Not enough free space in VirtFS /hostinstall mount <<<<<<<<<<<<<<<<
Required: 8434690962 bytes Available: 7761399808 bytes
If the issue persists even after cleanup, please install from alternate disk or USB.
ERROR: Failed to add junos-vmhost-install-mx-x86-64-24.4I20240715_1528_aramadoss.tgz
warning: Host software installation has failed.
Routing Engine 1 REV 17 750-054758 CALC6968 RE-S-2X00x6
re1> show system storage local
Filesystem Size Used Avail Capacity Mounted on
/dev/gpt/junos 10.0G 2.5G 6.6G 28% /.mount
tmpfs 45G 3.9G 41G 9% /.mount/tmp
/dev/gpt/config 446M 196K 410M 0% /.mount/config
/dev/gpt/var 14G 1.7G 11G 13% /.mount/var
/var/jails/rest-api 14G 1.7G 11G 13% /.mount/packages/mnt/junos-runtime/web-api/var
tmpfs 8.0G 472K 8.0G 0% /.mount/mfs
df -h | grep host
hostinstall 31G 22G 7.2G 76% /.mount/hostinstall
hostlcpkg 31G 22G 7.2G 76% /.mount/hostlcpkg
In vhclient host node:
root@re1-node:~# df -h
Filesystem Size Used Avail Use% Mounted on
tmpfs 10G 2.9M 10G 1% /run
devtmpfs 31G 4.0K 31G 1% /dev
/dev/sda4 2.0G 1.2G 699M 62% /.old
tmpfs 31G 84K 31G 1% /dev/shm
tmpfs 4.0M 0 4.0M 0% /sys/fs/cgroup
tmpfs 31G 0 31G 0% /.old/tmp
tmpfs 10G 0 10G 0% /var/volatile
/dev/mapper/jvg_P-jlvmvm 6.4G 4.5G 1.6G 75% /vm
/dev/mapper/jvg_P-jlvmspare 6.8M 2.0K 6.2M 1% /spare
/dev/mapper/jvg_P-jlvmjunos 32G 23G 7.3G 76% /junos
/dev/mapper/jvg_P-jlvmrootrw 3.3G 404M 2.7G 13% /.old/tdev/.union/.s
unionfs 3.3G 404M 2.7G 13% /
tmpfs 10G 4.0K 10G 1% /tmp
tmpfs 6.2G 0 6.2G 0% /run/user/0
root@jtac-mx960-r2044-re1-node:~# cd junos
-sh: cd: junos: No such file or directory
root@jtac-mx960-r2044-re1-node:~# cd /junos
root@jtac-mx960-r2044-re1-node:/junos# ls -l
total 14564248
lrwxrwxrwx 1 root root 21 Sep 2 00:52 Backup.b -> /vm/vm/junos/Backup.b
lrwxrwxrwx 1 root root 21 Sep 1 20:15 Backup.p -> /vm/vm/junos/Backup.p
drwxr-xr-x 2 root root 4096 Sep 2 00:53 Current.b
drwxr-xr-x 2 root root 4096 Sep 2 07:44 Current.p
drwxr-xr-x 3 root root 4096 Sep 6 12:05 install
lrwxrwxrwx 1 root root 77 Sep 6 11:55 jinstall-current.img -> /junos/Current.b/junos-install-mx-x86-64-24.4I-20240826_dev_common.0.0241.img
drwx------ 2 root root 16384 Jun 21 2022 lost+found
lrwxrwxrwx 1 root root 12 Sep 6 11:55 pfe -> /junos/pfe.b
drwxr-xr-x 3 root root 4096 Sep 2 00:53 pfe.b
drwxr-xr-x 3 root root 4096 Sep 1 20:17 pfe.p
-rw-r--r-- 1 root root 536870912 Mar 30 17:56 vjunos-aux-disk.img
-rw-r--r-- 1 root root 16106127360 Sep 6 12:47 vjunos-var-config.img
root@jtac-mx960-r2044-re1-node:/junos# rm vjunos-var-config.img
root@jtac-mx960-r2044-re1-node:/junos# rm vjunos-aux-disk.img
Not enough free space in VirtFS /hostinstall mount <<<<<<<<<<<<<<<<
The old NGRE uses 50G SDD, which is too small to hold two images. To upgrade to 24.x+ release, it is better to upgrade the NGRE to use 200G SDD.
As a workaround, customer has 2 choices.
Solution 1: Use USB recover image to to the upgrade.
Solution 2: Rollback to the previous JUNOS release, which occupied a less space on the RE, then try to install the new one. Example as below:
re0> request vmhost software rollback
Current root details, Device sda, Label: jrootb_P, Partition: sda4
Finding alternate root for rollback
Rollback to software on jrootp_P ...
sh /etc/install/mk-mtre-rollback.sh jrootp_P p
Mounting device in preparation for rollback...
Updating boot partition for rollback...
Rollback complete, please reboot the node for it to take effect.
Cmos Write successfull
Cmos Write successfull for Boot_retry
eth-lldp-disable.sh already present
eth-lldp-stop.sh already present
eth-link-down-on-close-enable.sh already present
mk-mtre-downgrade.sh already present
downgrade_cleanup_file_list already present
re0> request vmhost reboot
....
//// After booting online
% df -h
...
hostinstall 31G 0B 31G 0% /.mount/hostinstall <<<<<<<<<<<<<<
hostlcpkg 31G 19G 11G 64% /.mount/hostlcpkg
re1> request vmhost software add /var/tmp/junos-vmhost-install-mx-x86-64 -24.4I20240715_1528.tgz no-validate
i40e NVM version is 7.00
Copied the config and other data to the aux disk.
Transfer junos-host-upgrade.sh
Transfer Done
Transfer /packages/db/pkginst.20084/junos-vmhost-install*.tgz
Transfer /packages/db/pkginst.20084/attributes
Starting upgrade ...
Preparing for upgrade...
/junos/install/pkg-fpi/unpack/install/
tar --directory=/junos/install/pkg-fpi/unpack/install/ -xvf /junos/install/install.tgz
<...>