This article explains how to disable channelization when using 40G DAC cables on EX9251 Series devices.
The EX9251 Series switches include eight 10-Gigabit Ethernet ports and four rate-selectable ports, which support transceivers and Direct Attach Copper (DAC) cables. The rate-selectable ports operate as:
100-Gigabit Ethernet ports
40-Gigabit Ethernet ports
10-Gigabit Ethernet ports
By default, when using 40G DAC cables on FPC 0 PIC 0, the interfaces will autochannelize into 4 XE interfaces of 10G speed each as shown below:
show chassis hardware Hardware inventory: Item Version Part number Serial number Description Chassis BX174 EX9251 Routing Engine 0 BUILTIN BUILTIN RE-S-2X00x6 CB 0 REV 15 750-081081 CALY4027 EX9251 FPC 0 BUILTIN BUILTIN MPC PIC 0 BUILTIN BUILTIN 4XQSFP28 PIC Xcvr 0 REV 01 740-044512 MOC18165121388 QSFP+-40G-CU50CM Xcvr 1 REV 01 740-044512 MOC16465121876 QSFP+-40G-CU50CM Xcvr 2 REV 01 740-044512 APF18080008RBW QSFP+-40G-CU50CM Xcvr 3 REV 01 740-044512 MOC18165120827 QSFP+-40G-CU50CM PIC 1 BUILTIN BUILTIN 8XSFPP PIC show interfaces terse Interface Admin Link Proto Local Remote lc-0/0/0 up up lc-0/0/0.32769 up up vpls pfe-0/0/0 up up pfe-0/0/0.16383 up up inet inet6 pfh-0/0/0 up up pfh-0/0/0.16383 up up inet pfh-0/0/0.16384 up up inet xe-0/0/0:0 up up xe-0/0/0:1 up up xe-0/0/0:2 up up xe-0/0/0:3 up up xe-0/0/1:0 up up xe-0/0/1:1 up up xe-0/0/1:2 up up xe-0/0/1:3 up up xe-0/0/2:0 up up xe-0/0/2:1 up up xe-0/0/2:2 up up xe-0/0/2:3 up up xe-0/0/3:0 up up xe-0/0/3:1 up up xe-0/0/3:2 up up xe-0/0/3:3 up up xe-0/1/0 up down xe-0/1/1 up down xe-0/1/2 up down xe-0/1/3 up down xe-0/1/4 up down xe-0/1/5 up down xe-0/1/6 up down xe-0/1/7 up down
To disable channelization on 40G interfaces, the port mode options must match on PIC 0 and PIC 1.
For this, you need to configure speed as 40G on PIC 0 ports under the chassis hierarchy while disabling PIC 1 ports by setting the number-of-ports option to 0. Normally this combination allows only three ports of 40G on PIC 0 to be created while disabling all ports on PIC 1:
number-of-ports
root# show chassis fpc 0 { pic 0 { port 0 { speed 40g; } port 1 { speed 40g; } port 2 { speed 40g; } } pic 1 { number-of-ports 0; } } show interfaces terse Interface Admin Link Proto Local Remote et-0/0/0 up up et-0/0/0.0 up up inet 10.10.10.1/24 lc-0/0/0 up up lc-0/0/0.32769 up up vpls pfe-0/0/0 up up pfe-0/0/0.16383 up up inet inet6 pfh-0/0/0 up up pfh-0/0/0.16383 up up inet pfh-0/0/0.16384 up up inet et-0/0/1 up up et-0/0/1.0 up up inet 30.30.30.1/24 et-0/0/2 up up et-0/0/2.0 up up inet 40.40.40.1/24 cbp0 up up demux0 up up cbp0 up up demux0 up up
To enable all four ports, PIC 0 must be restarted after committing the configuration.
root# show chassis fpc 0 { pic 0 { port 0 { speed 40g; } port 1 { speed 40g; } port 2 { speed 40g; } port 3 { speed 40g; <------- Including Port3 } } pic 1 { number-of-ports 0; } }
The following message prompt will also be displayed after commit to indicate that a restart is required:
chassisd[5498]: should_summit_pic_bounce_for_port_speed_change: FPC 0 PIC 0 Bounce is needed for port speed config change show interfaces terse Interface Admin Link Proto Local Remote et-0/0/0 up up et-0/0/0.0 up up inet 10.10.10.1/24 lc-0/0/0 up up lc-0/0/0.32769 up up vpls pfe-0/0/0 up up pfe-0/0/0.16383 up up inet inet6 pfh-0/0/0 up up pfh-0/0/0.16383 up up inet pfh-0/0/0.16384 up up inet et-0/0/1 up up et-0/0/1.0 up up inet 30.30.30.1/24 et-0/0/2 up up et-0/0/2.0 up up inet 40.40.40.1/24 cbp0 up up <----No port 0/0/3 yet showing demux0 up up cbp0 up up demux0 up up
The restart is typically performed automatically after committing the configuration, but if the restart does not happen, you can bounce PIC 0 by using the following commands:
request chassis pic pic-slot 0 fpc-slot 0 offline request chassis pic pic-slot 0 fpc-slot 0 online
After restart, the following messages may appear and all four ET ports will be programmed:
mib2d[5686]: SNMP_TRAP_LINK_DOWN: ifIndex 545, ifAdminStatus up(1), ifOperStatus down(2), ifName et-0/0/3 mib2d[5686]: SNMP_TRAP_LINK_UP: ifIndex 542, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/0 mib2d[5686]: SNMP_TRAP_LINK_UP: ifIndex 543, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/1 mib2d[5686]: SNMP_TRAP_LINK_UP: ifIndex 544, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/2 mib2d[5686]: SNMP_TRAP_LINK_UP: ifIndex 545, ifAdminStatus up(1), ifOperStatus up(1), ifName et-0/0/3 show interfaces terse Interface Admin Link Proto Local Remote et-0/0/0 up up et-0/0/0.0 up up inet 10.10.10.1/24 lc-0/0/0 up up lc-0/0/0.32769 up up vpls pfe-0/0/0 up up pfe-0/0/0.16383 up up inet inet6 pfh-0/0/0 up up pfh-0/0/0.16383 up up inet pfh-0/0/0.16384 up up inet et-0/0/1 up up et-0/0/1.0 up up inet 20.20.20.1/24 et-0/0/2 up up et-0/0/2.0 up up inet 30.30.30.1/24 et-0/0/3 up up et-0/0/3.0 up up inet 40.40.40.1/24 cbp0 up up demux0 up up
Note: Configuring 40G ports on PIC 0 and 10G on PIC 1 is not supported; the following errors may appear if you do so:
chassisd[5498]: summit_pic_port_profile_isvalid: FPC[0]PIC[1] have invalid profile type 0, reson PIC & TIC needs to use same pic-mode or other pic should have number-of-port is 0 chassisd[5498]: jam_core_ch_fpc_pic_port_profile_set_invalid FPC 0 PIC 1 config invalid updating FPC flag chassisd[5498]: should_summit_pic_bounce_for_num_ports_change: FPC 0 PIC 1 - Number-of-ports changed from 0 to 0 while pic-mode is default. Bouncing the PIC chassisd[5498]: pic_do_trinity_config 7011 Bouncing other PIC 0, in case of Summit both PICs are bounced when number of ports config is toggled
To re-enable channelization, you would only need to remove the configuration under the chassis hierarchy.
Note: It is recommended that you should restart FPC 0 after committing the changes by using request chassis fpc slot 0 restart (this task will require some minutes to complete).
request chassis fpc slot 0 restart