Description

Links using QSFP56-DD-400G-ZR-M in MX304 fails with the QDD-400G-ZRP-S in Cisco router. On MX304, it reports Rx Loss.

  Lane host alarms                 :
                                     Alarm                  Lane 0   Lane 1   Lane 2   Lane 3   Lane 4   Lane 5   Lane 6   Lane 7
                                     --------------------   ------   ------   ------   ------   ------   ------   ------   ------
                                     Tx Adaptive Eq Fault   clear    clear    clear    clear    clear    clear    clear    clear
                                     Tx CDR LOL             clear    clear    clear    clear    clear    clear    clear    clear
                                     Rx CDR LOL             set      clear    clear    clear    clear    clear    clear    clear

MX304# run show interfaces transport pm optics current et-0/1/14   
Physical interface: et-0/1/14, SNMP ifIndex 3799
  Current: 2024-07-15,11:45:00 - current
  Suspect Flag: False
  Reason: Not Applicable
    PM                              CURRENT   MIN       MAX       AVG      THRESHOLD        TCA-ENABLED      TCA-RAISED
                                                                           (MIN)   (MAX)    (MIN) (MAX)      (MIN) (MAX)
  Module temperature(Celsius)       57        57        57        57        0       73       No    No         No    No
  Pre-FEC BER                       1.00e-0   1.00e-0   1.00e-0   1.00e-0   0       9.00e-3  NA    No         NA    No
  Uncorrected FER                   1.00e-0   1.00e-0   1.00e-0   1.00e-0   0       0.00e-0  NA    No         NA    No
  SNR(dB)                           31.0      31.0      31.0      31.0      15.0    0        No    NA         No    NA
  Tx power(dBm)                     -9.22     -9.27     -9.20     -9.24     -16.00  0.00     No    No         No    No
  Rx total power(dBm)               -14.56    -14.57    -14.55    -14.57    -21.00  2.00     No    No         No    No
  Rx signal power(dBm)              -14.59    -14.61    -14.55    -14.59    -13.50  0.00     No    No         No    No
  Carrier frequency offset(MHz)     0.0       0.0       0.0       0.0       -3600.0 3600.0   No    No         No    No
  Chromatic dispersion(ps/nm)       0.0       0.0       0.0       0.0       0       0        NA    NA         NA    NA
  Differential group delay(ps)      0.0       0.0       0.0       0.0       0       0        NA    NA         NA    NA
  SOPMD(ps^2)                       0.0       0.0       0.0       0.0       0       0        NA    NA         NA    NA
  PDL(dB)                           0.0       0.0       0.0       0.0       0       0        NA    NA         NA    NA
  OSNR(dB)                          34.0      34.0      34.0      34.0      0       0        NA    NA         NA    NA
 
 
 
[edit interfaces et-0/1/14]
MX304# run show interfaces et-0/1/14                               
Physical interface: et-0/1/14, Enabled, Physical link is Down
  Interface index: 716, SNMP ifIndex: 3799
  Link-level type: Ethernet, MTU: 1514, MRU: 1522, Speed: 400Gbps, BPDU Error: None, Loop Detect PDU Error: None, Loopback: Disabled,
  Source filtering: Disabled, Flow control: Enabled
  Device flags   : Present Running Down
  Interface Specific flags: Internal: 0x100200
  Interface flags: Hardware-Down SNMP-Traps Internal: 0x4000
  Link flags     : None
  Wavelength     : 1560.20 nm, Frequency: 192.15 THz
  Optic-loopback : Disabled , Optic-loopbacktype : nil
  Media Code     : ZR-400-OFEC-16QAM
  Host Code      : 400GAUI-8 C2M (Annex 120E)
  CoS queues     : 8 supported, 8 maximum usable queues
  Schedulers     : 0
  Current address: b0:eb:7f:97:9a:74, Hardware address: b0:eb:7f:97:9a:74
  Last flapped   : 2024-07-15 09:20:50 AEST (02:34:27 ago)
  Input rate     : 0 bps (0 pps)
  Output rate    : 0 bps (0 pps)
  Active alarms  : LINK
  Active defects : LINK, LOCAL-FAULT <<<<<<<<<<<<<<<<<<<<<<<
  PCS statistics                      Seconds
    Bit errors                             0
    Errored blocks                         0
  Ethernet FEC Mode  :                 FEC119
    FEC Codeword size                     544
    FEC Codeword rate                   0.945
  Ethernet FEC statistics              Errors
    FEC Corrected Errors                    2
    FEC Uncorrected Errors                  0
    FEC Corrected Errors Rate               0
    FEC Uncorrected Errors Rate             0
  Optic FEC Mode  :                      OFEC
  Optic FEC statistics:         
    Corrected Errors                                     775
    Uncorrected Words                                    775
    Corrected Error rate                                   1
    Uncorrected Error rate                                 1
    Corrected Error Ratio (        775 seconds average)  1.00e+00
  PRBS Mode : Disabled                 
  Link Degrade :                     
    Link Monitoring                   :  Disable
  Interface transmit statistics: Disabled

The output from Cisco side:

Mon Jul 15 10:02:25.784 AEST

Controller State: Up

Transport Admin State: In Service

Laser State: On

Host Squelch Status: Enable

LED State: Yellow

FEC State: FEC ENABLED

Power Mode: High

Dom Data Status: Ready

Optics Status

        Optics Type:  QSFPDD 400G ZRP
        DWDM carrier Info: C BAND, MSA ITU Channel=80, Frequency=192.15THz,
        Wavelength=1560.200nm
        Loopback Host : None
        Loopback Media : None

        Alarm Status:
        -------------
        Detected Alarms:
                OSNR    <<<<<<<<<<<<<<<<<<     

        LOS/LOL/Fault Status:

        Alarm Statistics:

        -------------
        HIGH-RX-PWR = 0            LOW-RX-PWR = 0         
        HIGH-TX-PWR = 0            LOW-TX-PWR = 0         
        HIGH-LBC = 2               HIGH-DGD = 2         
        OOR-CD = 2                 OSNR = 10        
        WVL-OOL = 0                MEA  = 0         
        IMPROPER-REM = 5         
        TX-POWER-PROV-MISMATCH = 0         
        Laser Bias Current = 269.2 mA
        Actual TX Power = -10.77 dBm
        Actual TX Power(mW) = 0.08 mW
        RX Power = -11.34 dBm
        RX Power(mW) = 0.07 mW
        RX Signal Power = -14.86 dBm
        Frequency Offset = 350 MHz
        Laser Temperature = 42.28 Celsius
        Laser Age = 0 %
        DAC Rate = 1x1.25

        Performance Monitoring: Enable

        THRESHOLD VALUES
        ----------------

        Parameter                 High Alarm  Low Alarm  High Warning  Low Warning
        ------------------------  ----------  ---------  ------------  -----------
        Rx Power Threshold(dBm)         13.0      -24.0          10.0        -22.0
        Rx Power Threshold(mW)          19.9        0.0          10.0          0.0
        Tx Power Threshold(dBm)          0.0      -18.0          -2.0        -16.0
        Tx Power Threshold(mW)           1.0        0.0           0.6          0.0
        LBC Threshold(mA)               0.00       0.00          0.00         0.00
        Temp. Threshold(celsius)       80.00      -5.00         75.00        15.00
        Voltage Threshold(volt)         3.46       3.13          3.43         3.16

        LBC High Threshold = 98 %
        Configured Tx Power = -10.00 dBm
        Configured Tx Power(mW) = 0.10 mW 
        Configured CD High Threshold = 160000 ps/nm
        Configured CD lower Threshold = -160000 ps/nm
        Configured OSNR lower Threshold = 9.00 dB
        Configured DGD Higher Threshold = 80.00 ps
        Baud Rate =  60.1385459900 GBd
        Modulation Type: 16QAM
        Chromatic Dispersion -5 ps/nm
        Configured CD-MIN -26000 ps/nm  CD-MAX 26000 ps/nm
        Second Order Polarization Mode Dispersion = 115.00 ps^2
        Optical Signal to Noise Ratio = 7.10 dB
        SNR = 17.40 dB
        Polarization Dependent Loss = 1.30 dB
        Polarization Change Rate = 0.00 rad/s
        Differential Group Delay = 3.00 ps

        Temperature = 48.00 Celsius
        Voltage = 3.34 V

Transceiver Vendor Details

        Form Factor            : QSFP-DD
        Optics type            : QSFPDD 400G ZRP
        Name                   : CISCO-ACACIA
        OUI Number             : 7c.b2.5c
        Part Number            : DP04QSDD-E30-190
        Rev Number             : A
        Serial Number          : ACA2528008E
        PID                    : QDD-400G-ZRP-S
        VID                    : V01
        Firmware Version       : Major.Minor.Build
                Active         : 61.10.12
                Inactive       : 61.10.12
        Date Code(yy/mm/dd)    : 21/07/16
        Fiber Connector Type: LC
        Otn Application Code: Undefined
        Sonet Application Code: Undefined

 

Symptoms

MX304 link with QSFP56-DD-400G-ZR-M to QDD-400G-ZRP-S in cisco router failed to be up. MX304 reported Rx Loss.

Solution

It is a known inter-OP issue on this Cisco QDD-400G-ZRP-S. The trick is to change the DAC-rate on the Cisco end from the default 1x1.25 to be 1x1.50, make the link up.

 

CiscoRouter#sh run controller optics 0/1/0/10

Fri Jul 19 11:49:41.718 AEST

controller Optics0/1/0/10

description Interop to wipm-e-304

cd-min -4000

cd-max 4000

fec OFEC

dwdm-carrier 100MHz-grid frequency 1921500

modulation 16Qam

DAC-Rate 1x1.50

Modification History

2024-07-19 : Article Created