Description

This article explains how to configure your QFX5100 to detect an already installed EX4600-EM-8F expansion module (CLI).

Symptoms

QFX does not detect expansion module EX4600-EM-8F after installation. The following log messages are generated:

CHASSISD_PIC_CMD_TIMEOUT: fpc_pic_online_cmd_timeout: attempt to bring PIC 1 in FPC 0 online timed out
 

Note: EX4600-EM-8F may not work correctly on 5e Codes. Also, some commands to restart PIC 1 or PIC2 may not work. Interfaces may show physically UP on flexi-mode but not pass traffic. If so, please install a Non 5e version by performing a USB format procedure.

Solution

 

Overview

The QFX5100-24Q is a 40-Gigabit Ethernet QSFP+ switch with 24 high-density QSFP+ ports. Each QSFP+ port can operate as a native 40 Gbps port or as 4 independent 10 Gbps ports. The QFX5100-24Q switch has two bays on the port panel for optional expansion modules. The QFX5100-24Q supports two expansion modules to increase port density:

1-QFX-EM-4Q, which provides 4 additional 40-Gigabit Quad SFP+ (QSFP+) ports

2-EX4600-EM-8F, which provides 8 additional 10-Gigabit Ethernet Enhanced Small Form-Factor Pluggable (SFP+) ports.

See QFX5100 Device Hardware Overview for more information about the expansion modules.

Installation

To install and configure the QFX5100-24Q in order for it to recognize the EX4600-EM-8F expansion module, see the following documents:

Once the EX4600-EM-8F module has been installed following the above mentioned guides, we must configure the System Mode on the QFX in order for it to recognize the module, otherwise we are going to get the following outputs:

{master:0}
root@QFX5100>show chassis hardware
tem Version Part number Serial number Description
Chassis TB3714120542 QFX5100-24Q-2P
Pseudo CB 0
Routing Engine 0 BUILTIN BUILTIN QFX Routing Engine
FPC 0 REV 13 650-049942 TB3714120542 QFX5100-24Q-2P
CPU BUILTIN BUILTIN FPC CPU
PIC 0 BUILTIN BUILTIN 24x 40G-QSFP
Xcvr 0 REV 01 740-032986 QC310795 QSFP+-40G-SR4
Xcvr 1 REV 01 740-032986 QB151286 QSFP+-40G-SR4
Xcvr 22 REV 01 740-038623 MOC13046230415 QSFP+-40G-CU1M
Xcvr 23 REV 01 740-038623 MOC13046230411 QSFP+-40G-CU1M

PIC 1                                <<<< Expansion module is not showing
PIC 2                                <<<< Expansion module is not showing

master:0}
root@QFX51004> show chassis fpc pic-status
Slot 0 Online QFX5100-24Q-2P
PIC 0 Online 24x 40G-QSFP
PIC 1 Offline           <<< offline
PIC 2 Offline           <<< offline

Example:

In the following example, we will install two EX4600-EM-8F modules on FPC0 PIC1 and PIC2.

Issue the following command:

request chassis system-mode flexi-pic-mode all-members

See Configuring the System Mode

 

We will get the following output:


{master:0}
root@QFX51004> request chassis system-mode flexi-pic-mode all-members   <<< changing system-mode
fpc0:
--------------------------------------------------------------------------

System-mode has changed. This will restart the Packet Forwarding Engine (PFE).

Caution : The Packet Forwarding Engine on the switch is restarted when you issue system mode changes. As a result, you might experience packet loss on the switch.

Note : When you request the system mode change, you must reboot for the system mode to take effect.

Reboot the system:

master:0}
root@QFX51004> request system reboot all-members    <<< rebooting
Reboot the system ? [yes,no] (no) yes

Shutdown at Sat Nov 8 08:54:13 2014.
[pid 1596].........


{master:0}
root@QFX5100> show chassis hardware     <<<< It will take a moment to load chassis configuration.
Hardware inventory:
Item Version Part number Serial number Description
Chassis TB3714120542
Pseudo CB 0
Fan Tray 0 QFX5100 Fan Tray 0, Fro nt to Back Airflow - AFO
Fan Tray 1 QFX5100 Fan Tray 1, Fro nt to Back Airflow - AFO
Fan Tray 2 QFX5100 Fan Tray 2, Fro nt to Back Airflow - AFO
Fan Tray 3 QFX5100 Fan Tray 3, Fro nt to Back Airflow - AFO
Fan Tray 4 QFX5100 Fan Tray 4, Fro nt to Back Airflow - AFO


{master:0}
root@QFX5100> show chassis hardware
Hardware inventory:
Item Version Part number Serial number Description
Chassis TB3714120542 QFX5100-24Q-2P
Pseudo CB 0
Routing Engine 0 BUILTIN BUILTIN QFX Routing Engine
FPC 0 REV 13 650-049942 TB3714120542 QFX5100-24Q-2P
CPU BUILTIN BUILTIN FPC CPU
PIC 0 BUILTIN BUILTIN 24x 40G-QSFP
Xcvr 0 REV 01 740-032986 QC310795 QSFP+-40G-SR4
Xcvr 1 REV 01 740-032986 QB151286 QSFP+-40G-SR4
Xcvr 22 REV 01 740-038623 MOC13046230415 QSFP+-40G-CU1M
Xcvr 23 REV 01 740-038623 MOC13046230411 QSFP+-40G-CU1M
PIC 1 REV 03 611-049556 RS3714230044 EX4600-EM-8F       <<<<<< Expansion modules
PIC 2 REV 03 611-049556 RS3714230093 EX4600-EM-8F       <<<<<< Expansion modules
Xcvr 6 REV 01 740-021308 ANB08N4 SFP+-10G-SR
Xcvr 7 REV 01 740-021308 APD2K9B SFP+-10G-SR
Power Supply 0 REV 03 740-041741 1GA24072171 JPSU-650W-AC-AFO
Power Supply 1 REV 03 740-041741 1GA24072169 JPSU-650W-AC-AFO
Fan Tray 0 QFX5100 Fan Tray 0, Front to Back Airflow - AFO
Fan Tray 1 QFX5100 Fan Tray 1, Front to Back Airflow - AFO
Fan Tray 2 QFX5100 Fan Tray 2, Front to Back Airflow - AFO
Fan Tray 3 QFX5100 Fan Tray 3, Front to Back Airflow - AFO
Fan Tray 4 QFX5100 Fan Tray 4, Front to Back Airflow - AFO
 

Verify installation

To verify that the expansion modules are installed and located, run the command:

show chassis fpc pic-status


{master:0}
root@QFX51004> show chassis fpc pic-status
Slot 0 Online QFX5100-24Q-2P
PIC 0 Online 24x 40G-QSFP
PIC 1 Online EX4600-EM-8F
PIC 2 Online EX4600-EM-8F

Modification History

2022-10-28: Updated module name from 'EX4600-EM-8S' to 'EX4600-EM-8F' in the title.

Related Information