Description

10G ports are not seen in the 'show interfaces terse' output of an MX5-T device when the required license is expired.

Symptoms

A MX5-T router by default supports only one MIC slot with 20 port Gigabit Ethernet MIC enabled. Separately purchased upgrade licenses permits the use of a second MIC slot and four 10-Gigabit Ethernet (10GbE) interfaces. Refer the following technical document for more on licensing:

There are scenarios where the the license is not applied on the MX5-T (while upgrading existing device or while replacing the existing device with an RMA), then the device would run on the temporary license for a grace period. Once this grace period expires, the system would fail to create even the existing 10G ports, eventually making all 10G ports non-operational. 

The following syslog message would appear in the chassid log, indicating an expired license:

root@router-name> show log chassisd | match "Aug  1"        
Aug  1 17:04:32  mrlic 102 license grace expired
Aug  1 17:04:32  mrlic is_taz_port_feature_licensed (from cache) feature 102 0
Aug  1 17:04:32  mrlic ch_taz_modify_pic_port_reserved_mask: setting port_reserved mask for 1/2 changed: 1
Aug  1 17:04:32  mrlic ch_taz_set_pic_port_offline: pic online, sending offline message: 1/2
Aug  1 17:04:32  mrlic ch_taz_pic_get_nameprefix: hwdb prefix for 752 is xe
Aug  1 17:04:32  ifdev_detach_port(xe-1/2/0)
Aug  1 17:04:32  fpc_detach_create_queue_clean: ifdname xe-1/2/0
Aug  1 17:04:32  ifd xe-1/2/0 marked as gone
Aug  1 17:04:32  mrlic ch_taz_set_pic_port_offline: ifdev detached port xe-1/2/0, 0

Once the license expires, any 10G port on the device does not show up in 'show interface terse' . Any 1G port would still continue to function normally.

root@router-name> show interfaces xe-0/0/0 
error: device xe-0/0/0 not found

root@router-name> show interfaces xe-0/0/1 
error: device xe-0/0/1 not found

The PIC would still be shown online. However, the ports will be detached from them:

root@router-name> show chassis pic pic-slot 0 fpc-slot 0 
FPC slot 0, PIC slot 0 information:
  Type                             4x 10GE XFP Builtin
  State                            Online    
  Uptime                         26 days, 10 hours, 32 minutes, 51 seconds

PIC port information:
Fiber                    Xcvr vendor       Wave-    Xcvr         JNPR
  Port Cable type        type  Xcvr vendor        part number       length   Firmware     Rev
  0    10GBASE LR        SM    US CRITICAL        XFP10GLOC192SR1   1310 nm  0.0          REV 01
  1    10GBASE LR        SM    US CRITICAL        XFP10GLOC192SR1   1310 nm  0.0          REV 01
  2    10GBASE LR        SM    US CRITICAL        XFP10GLOC192SR1   1310 nm  0.0          REV 01
  3    10GBASE LR        SM    US CRITICAL        XFP10GLOC192SR1   1310 nm  0.0          REV 01

Aug  1 17:04:33  router-name tfeb0 IFD: xe-0/0/0 delete from link monitor list, ifd_link_degrade_unregister
Aug  1 17:04:35  router-name tfeb0 mic_ifd_detach: Detaching ifd xe-0/0/0 for MIC(0/0) pic 0x59737d60
Aug  1 17:04:35  router-name tfeb0 IFD: xe-1/3/0 delete from link monitor list, ifd_link_degrade_unregister

Solution

  1. Check the output of ' show system license' . It would indicate that upgrade licenses are missing.

    root@router-name> show system license                                         
    License usage: 
    Licenses     Licenses    Licenses    Expiry
      Feature name                       used    installed      needed 
      scale-subscriber                      2           10           0    permanent
      scale-l2tp                            0         1000           0    permanent
      scale-mobile-ip                       0         1000           0    permanent
  2. Check if the device was recently upgraded and a license was not installed on it or if the device was replaced with an RMA and the RMAed device was not installed with a license.

  3. To transfer license keys to an RMA replacement device, refer to KB13500 - Transfer license keys to an RMA replacement device [juniper.net]

  4. The output of 'show system license', once the required license is installed on MX5-T, would appear as below. It should have MX5 to MX80 upgrade licenses:

    sampangirao@us-irv-fair-br1> show system license                                                       
    License usage: 
    Licenses     Licenses    Licenses    Expiry
      Feature name                       used    installed      needed 
      subscriber-accounting                 0            1           0    permanent
      subscriber-authentication             0            1           0    permanent
      subscriber-address-assignment         0            1           0    permanent
      subscriber-vlan                       0            1           0    permanent
      subscriber-ip                         0            1           0    permanent
      scale-subscriber                      2         4000           0    permanent
      scale-l2tp                            0         1000           0    permanent
      scale-mobile-ip                       0         1000           0    permanent
      mx5-to-mx10-upgrade                   0            1           0    permanent
      mx10-to-mx40-upgrade                  0            1           0    permanent
      mx40-to-mx80-upgrade                  0            1           0    permanent
  5. If the devices were not upgraded recently or replaced and still showed license expired, please collect the following information and contact your JTAC Representative:

    • var/log
    • RSI
    • > show system license