Description

The PTX1000 router experienced a sudden reboot, resulting in the loss of configuration settings. The last reboot reason, as identified by the "show chassis routing-engine" command, was determined to be "0x2000:hypervisor reboot." Post-reboot, the router was found to be running on an unexpected software version (16.1) instead of its previous version (20.3X75-D21.7). Additionally, inspection using the "show vmhost hardware" command revealed the absence of disk 2 under the routing engine.

**Steps Taken:**
1. Identification of Reboot Reason: Upon analyzing the router's routing engine status, it was discovered that the last reboot was triggered by a hypervisor reboot. (show chassis routing-engine)
2. Confirmation of Software Version Discrepancy: The router, initially operating on version 20.3X75-D21.7, was observed to be running on version 16.1 post-reboot. This discrepancy raised concerns about the firmware integrity. (show version)
3. Assessment of Disk Status: Examination using the "show vmhost hardware" command uncovered the absence of disk 2 under the routing engine, indicating potential hardware issues.
4. Performed the recovery of the disk with the below steps:
Manually checking the missing disk is NOT possible and even inserting the disk is also NOT possible. The only way to recover the faulty disk is by running:
request vmhost snapshot
 
 The "request vmhost snapshot" command will fail for the Routing Engine when the disk is missing. Run the following commands to try and clear the disk issue for the Routing Engine:
request vmhost snapshot recovery re<RE slot number>
request vmhost snapshot partition re<RE slot number>
request vmhost snapshot recovery partition re<RE slot number>
5. Reboot Attempt: In an effort to address the issue, a reboot of the entire chassis was initiated. However, the problem persisted despite this intervention.

Symptoms

root> show chassis routing-engine
Routing Engine status:
 Slot 0:
  Current state         Master
  Election priority       Master (default)
  Model             RE-PTX1000
  Serial ID           BUILTIN
  Uptime             1 hour, 5 minutes, 58 seconds
  Last reboot reason       0x2000:hypervisor reboot
  Load averages:         1 minute  5 minute 15 minute
                    0.19    0.18    0.16

root> show chassis hardware detail

Hardware inventory:
Item       Version Part number Serial number   Description
Chassis                DH652       PTX1000
CB 0
Routing Engine 0     BUILTIN   BUILTIN      RE-PTX1000
FPC 0      REV 28  750-065110  ACPK9325     PTX1000

root> show vmhost hardware
Compute cluster: rainier-re-cc
 Compute node: rainier-re-cn
  Hardware inventory:
  Item   Capacity  Part number       Serial number     Description
  Disk1   50.0 GB  SFSA050Gle432TO-C-LB-22A-JUN,-FwRev000060123456A3000010 SLIM SATA SSD


.

 

Solution

If the absent SSD fails to appear even following a chassis reboot, it is necessary to advance with the RMA process due to the suspected hardware malfunction.

Modification History

2024-05-20 : Article Created