Article Detail

Description

vMX supports high-bandwidth applications or performance testing only in single-root I/O virtualization (SR-IOV) mode. So when users do not get proper throughput in vMX (deployed in RHOSP/openstack cluster), they can start troubleshooting the problem by checking whether the vMX is properly deployed with SRIOV NIC driver or not.

This article explains how users can check the vMX's SR-IOV Driver and NIC details in running VFP VM(KVM) configuration.

Note: Refer to Installing vMX for Different Use Cases for information about use case requirements. In this example, vMX was deployed on RHOSP13 cluster using heat templates. Also, the Openstack virtual networks(VNs) were properly set with SRIOV port(p1p1,p2p1) association with vlan id 3320 & 3321. SRIOV NIC type used in this RHOSP13 compute node is Intel's XXV710 for 25GbE (SFP28)

Solution

For proper SRIOV interface deployment in vMX, verify that the SRIOV interface driver is set to ' vfio ' in ' virsh dumpxml ' output of VFP VM.

To run these commands, root/heat-admin credentials of the particular compute host (nbncolab-dell-compute-1) are needed.

Note: If the ethtool/pciutils packages are not installed in the compute host OS, then these packages need to be installed.

In this case, vMX is configured with two SRIOV interface( ge-0/0/0, ge-0/0/1 ) and one Virtio Interface ( ge-0/0/2 ) as per the heat orchestration template.

First, identify the VCP and VFP VM's instance ID from Openstack CLI / Horizon GUI.

Below are the vMX's VM Instance-id:

VCP: instance-000009b7
VFP: instance-000009ba

Use the following procedure (commands) to verify SR-IOV interface driver name and NIC PCI slot mapping to a particular SRIOV NIC's Virtual Function (for VFP VM).

Run ' virsh list ' and identify the VFP VM's KVM Instance ID.

 [root@test-compute-1]# virsh list 
  Id    Name                           State 
 ---------------------------------------------------- 
  28    instance-000009b4              running 
  29    instance-000009ba              running        <--VFP VM  
  30    instance-000009b7              running        <--VCP VM  
  31    instance-000009bd              running

Verify that the SRIOV interface driver is set to ' vfio ' in ' virsh dumpxml ' output of VFP VM. Alternately you can verify instance-id.xml under /var/run/libvirt/qemu/ of the compute host.

Alternate: [root@test-compute-1 heat-admin]# more /var/run/libvirt/qemu/instance-000009ba.xml

 [root@test-compute-1]# virsh dumpxml 29 
  <domain type='kvm' id='29'>   
    <name>   instance-000009ba  
    <uuid>   $ABC123  
    <metadata>   
      <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.0">   
        <nova:package version="17.0.7-2.el7ost"/>    
        <nova:name>    Instance_RSP_In_A_Box-vmx-Test_fpc0   
        <nova:creationTime>   2020-10-29 02:51:36  
        <nova:flavor name="pfe-test">   
          <nova:memory>   12288  
          <nova:disk>   20  
          <nova:swap>   0  
          <nova:ephemeral>   0  
          <nova:vcpus>   12  
        
        <nova:owner>   
          <nova:user uuid="$ABC123">   indranil.hazra  
          <nova:project uuid="$ABC123">   RSP_In_A_Box  
        
        <nova:root type="image" uuid="$ABC123"/>    
      
    
    <memory unit='KiB'>   12582912  
    <currentMemory unit='KiB'>   12582912  
    <memoryBacking>   
      <hugepages>   
        <page size='1048576' unit='KiB' nodeset='0'/>    
      
    
    <vcpu placement='static'>   12  
    <cputune>   
      <shares>   12288  
      <vcpupin vcpu='0' cpuset='40'/>    
      <vcpupin vcpu='1' cpuset='96'/>    
      <vcpupin vcpu='2' cpuset='92'/>    
      <vcpupin vcpu='3' cpuset='36'/>    
      <vcpupin vcpu='4' cpuset='10'/>    
      <vcpupin vcpu='5' cpuset='66'/>    
      <vcpupin vcpu='6' cpuset='78'/>    
      <vcpupin vcpu='7' cpuset='22'/>    
      <vcpupin vcpu='8' cpuset='76'/>    
      <vcpupin vcpu='9' cpuset='20'/>    
      <vcpupin vcpu='10' cpuset='62'/>    
      <vcpupin vcpu='11' cpuset='6'/>    
      <emulatorpin cpuset='6,10,20,22,36,40,62,66,76,78,92,96'/>    
    
    <numatune>   
      <memory mode='strict' nodeset='0'/>    
      <memnode cellid='0' mode='strict' nodeset='0'/>    
    
    <resource>   
      <partition>   /machine  
    
    <sysinfo type='smbios'>   
      <system>   
        <entry name='manufacturer'>   Red Hat  
        <entry name='product'>   OpenStack Compute  
        <entry name='version'>   17.0.7-2.el7ost  
        <entry name='serial'>   $ABC123  
        <entry name='uuid'>   $ABC123  
        <entry name='family'>   Virtual Machine  
      
    
    <os>   
      <type arch='x86_64' machine='pc-i440fx-rhel7.6.0'>   hvm  
      <boot dev='hd'/>    
      <smbios mode='sysinfo'/>    
    
    <features>   
      <acpi/>    
      <apic/>    
    
    <cpu mode='custom' match='exact' check='full'>   
      <model fallback='forbid'>   Skylake-Server-IBRS  
      <vendor>   Intel  
      <topology sockets='6' cores='1' threads='2'/>    
      <feature policy='require' name='ss'/>    
      <feature policy='require' name='hypervisor'/>    
      <feature policy='require' name='tsc_adjust'/>    
      <feature policy='require' name='clflushopt'/>    
      <feature policy='require' name='pku'/>    
      <feature policy='require' name='stibp'/>    
      <feature policy='require' name='ssbd'/>    
      <numa>   
        <cell id='0' cpus='0-11' memory='12582912' unit='KiB' memAccess='shared'/>    
      
    
    <clock offset='utc'>   
      <timer name='pit' tickpolicy='delay'/>    
      <timer name='rtc' tickpolicy='catchup'/>    
      <timer name='hpet' present='no'/>    
    
    <on_poweroff>   destroy  
    <on_reboot>   restart  
    <on_crash>   destroy  
    <devices>   
      <emulator>   /usr/libexec/qemu-kvm  
      <disk type='network' device='disk'>   
        <driver name='qemu' type='raw' cache='writeback' discard='unmap'/>    
        <auth username='openstack'>   
          <secret type='ceph' uuid='$ABC123'/>    
        
        <source protocol='rbd' name='vms/$ABC123_disk'>   
          <host name='10.0.25.78' port='6789'/>    
          <host name='10.0.25.79' port='6789'/>    
          <host name='10.0.25.80' port='6789'/>    
       
        <target dev='vda' bus='virtio'/>    
        <alias name='virtio-disk0'/>

 
      
      <controller type='usb' index='0' model='piix3-uhci'>   
        <alias name='usb'/>

 
      
      <controller type='pci' index='0' model='pci-root'>   
        <alias name='pci.0'/>    
      
      <interface type='vhostuser'>   
        <mac address='fa:16:3e:5a:5d:9d'/>    
        <source type='unix' path='/var/lib/vhost_sockets/vhu0fde4046-dd' mode='server'/>   
        <target dev='vhu0fde4046-dd'/>    
        <model type='virtio'/>    
        <driver rx_queue_size='1024' tx_queue_size='1024'/>    
        <alias name='net0'/>

 
      
      <interface type='vhostuser'>   
        <mac address='fa:16:3e:fa:9a:73'/>    
        <source type='unix' path='/var/lib/vhost_sockets/vhua1c82c0a-d9' mode='server'/>   
        <target dev='vhua1c82c0a-d9'/>    
        <model type='virtio'/>    
        <driver rx_queue_size='1024' tx_queue_size='1024'/>    
        <alias name='net1'/>

 
      
      <interface type='hostdev' managed='yes'>   
        <mac address='<strong>    
        <driver name='<strong>                       <--1st SRIOV Interface ge-0/0/0  
        <source>

 
       
        <vlan>   
          <tag id='<strong>    
        
        <alias name='hostdev0'/>

 
      
      <interface type='hostdev' managed='yes'>   
        <mac address='<strong>    
        <driver name='<strong>                          <--2nd SRIOV Interface ge-0/0/1  
        <source>

 
       
        <vlan>   
          <tag id='<strong>    
        
        <alias name='hostdev1'/>

 
      
      <interface type='vhostuser'>   
        <mac address='fa:16:3e:1a:c7:43'/>    
        <source type='unix' path='/var/lib/vhost_sockets/vhua7a1f487-8d' mode='server'/>   
        <target dev='vhua7a1f487-8d'/>    
         <model type='virtio'/>                         <--3rd Virtio Interface ge-0/0/2  
        <driver rx_queue_size='1024' tx_queue_size='1024'/>    
        <alias name='net2'/>

 
      
      <serial type='pty'>   
        <source path='/dev/pts/3'/>   
        <log file='/var/lib/nova/instances/$ABC123/console.log' append='off'/>    
        <target type='isa-serial' port='0'>   
          <model name='isa-serial'/>    
        
        <alias name='serial0'/>    
      
      <console type='pty' tty='/dev/pts/3'>   
        <source path='/dev/pts/3'/>   
        <log file='/var/lib/nova/instances/$ABC123/console.log' append='off'/>    
        <target type='serial' port='0'/>    
        <alias name='serial0'/>    
      
      <input type='tablet' bus='usb'>   
        <alias name='input0'/>

 
     
      <input type='mouse' bus='ps2'>   
        <alias name='input1'/>    
     
      <input type='keyboard' bus='ps2'>   
        <alias name='input2'/>    
     
      <graphics type='vnc' port='5903' autoport='yes' listen='10.0.25.12' keymap='en-us'>   
        <listen type='address' address='10.0.25.12'/>    
      
      <video>   
        <model type='cirrus' vram='16384' heads='1' primary='yes'/>    
        <alias name='video0'/>

 
      
      <memballoon model='virtio'>   
        <stats period='10'/>    
        <alias name='balloon0'/>

 
      
    
    <seclabel type='dynamic' model='selinux' relabel='yes'>   
      system_u:system_r:svirt_t:s0:c235,c939  
      <imagelabel>   system_u:object_r:svirt_image_t:s0:c235,c939  
    
    <seclabel type='dynamic' model='dac' relabel='yes'>   
      +107:+42477  
      <imagelabel>   +107:+42477

Run the following commands:

 ethtool -i p2p1 
 lspci -nn | grep Ether

Running these commands as a superuser will give you the list of all NICs in the compute host with SRIOV VF PCI address mapping & MAC address details.

 [root@test-compute-1]# ethtool -i p2p1 
 driver: i40e 
 version: 2.3.2-k 
 firmware-version: 6.00 0x80003785 18.5.17 
 expansion-rom-version: 
  bus-info: 0000:5e:00.0  
 supports-statistics: yes 
 supports-test: yes 
 supports-eeprom-access: yes 
 supports-register-dump: yes 
 supports-priv-flags: yes 
 [root@test-compute-1]# lspci -nn | grep Ether 
 01:00.0 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01) 
 01:00.1 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01) 
 19:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller X710 for 10GbE SFP+ [8086:1572] (rev 01) 
 19:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller X710 for 10GbE SFP+ [8086:1572] (rev 01) 
 3b:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 [8086:158b] (rev 02) 
 3b:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 [8086:158b] (rev 02) 
 3b:02.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:02.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:02.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:02.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:02.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:02.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:02.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:02.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:03.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:03.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:03.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:03.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:03.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:03.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:03.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:03.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:04.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:04.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:04.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:04.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:04.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:04.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:04.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:04.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:05.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:05.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:05.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:05.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:05.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:05.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:05.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:05.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:06.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:06.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:06.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:06.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:06.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:06.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:06.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:06.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:07.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:07.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:07.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:07.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:07.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:07.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:07.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:07.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:08.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:08.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:08.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:08.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:08.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:08.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:08.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:08.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:09.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:09.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:09.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:09.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:09.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:09.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:09.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 3b:09.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 [8086:158b] (rev 02) 
 5e:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 [8086:158b] (rev 02) 
 5e:02.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:02.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:02.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:02.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:02.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:02.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:02.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:02.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:03.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:03.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:03.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:03.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:03.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:03.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:03.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:03.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:04.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:04.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:04.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:04.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:04.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:04.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:04.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:04.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:05.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:05.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:05.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:05.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:05.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:05.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:05.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:05.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:06.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:06.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:06.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:06.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:06.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:06.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:06.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:06.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:07.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:07.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:07.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:07.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:07.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:07.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:07.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:07.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:08.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:08.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:08.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:08.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:08.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:08.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:08.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:08.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:09.0 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
  5e:09.1 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02)     <--1st SRIOV Port of vMX(ge-0/0/0)  
  5e:09.2 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02)     <--2nd SRIOV Port of vMX(ge-0/0/1)  
 5e:09.3 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:09.4 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:09.5 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:09.6 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 5e:09.7 Ethernet controller [0200]: Intel Corporation Ethernet Virtual Function 700 Series [8086:154c] (rev 02) 
 d8:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 [8086:158b] (rev 02) 
 d8:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 [8086:158b] (rev 02) 
 [root@test-compute-1]# ip link 
 1: lo:  <LOOPBACK,UP,LOWER_UP>   mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 
     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 
 2: em3:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 24:6e:96:ca:f0:8e brd ff:ff:ff:ff:ff:ff 
 3: em4:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 24:6e:96:ca:f0:8f brd ff:ff:ff:ff:ff:ff 
 4: em1:  <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP>   mtu 9000 qdisc mq master bond0 state UP mode DEFAULT group default qlen 1000 
     link/ether 24:6e:96:ca:f0:6e brd ff:ff:ff:ff:ff:ff 
 5: em2:  <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP>   mtu 9000 qdisc mq master bond0 state UP mode DEFAULT group default qlen 1000 
     link/ether 24:6e:96:ca:f0:6e brd ff:ff:ff:ff:ff:ff 
 6: p1p1:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 9000 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 3c:fd:fe:c0:41:60 brd ff:ff:ff:ff:ff:ff 
     vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 1 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 2 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 3 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 4 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 5 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 6 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 7 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 8 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 9 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 10 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 11 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 12 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 13 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 14 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 15 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 16 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 17 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 18 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 19 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 20 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 21 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 22 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 23 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 24 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 25 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 26 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 27 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 28 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 29 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 30 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 31 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 32 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 33 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 34 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 35 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 36 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 37 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 38 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 39 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 40 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 41 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 42 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 43 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 44 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 45 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 46 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 47 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 48 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 49 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 50 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 51 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 52 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 53 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 54 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 55 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 56 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 57 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 58 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 59 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 60 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 61 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 62 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 63 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
 7: p1p2:  <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP>   mtu 9000 qdisc mq master bond1 state UP mode DEFAULT group default qlen 1000 
     link/ether 3c:fd:fe:bf:83:e1 brd ff:ff:ff:ff:ff:ff 
 8: p2p1:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 9000 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 3c:fd:fe:bf:83:e0 brd ff:ff:ff:ff:ff:ff 
     vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 1 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 2 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 3 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 4 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 5 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 6 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 7 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 8 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 9 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 10 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 11 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 12 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 13 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 14 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 15 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 16 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 17 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 18 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 19 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 20 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 21 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 22 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 23 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 24 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 25 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 26 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 27 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 28 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 29 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 30 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 31 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 32 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 33 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 34 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 35 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 36 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 37 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 38 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 39 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 40 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 41 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 42 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 43 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 44 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 45 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 46 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 47 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 48 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 49 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 50 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 51 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 52 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 53 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 54 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 55 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
     vf 56 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 
      vf 57 MAC fa:16:3e:bd:87:78, vlan 3320, spoof checking off, link-state enable, trust off           <--1st SRIOV Port of vMX(ge-0/0/0)  
          vf 58 MAC fa:16:3e:5f:0c:c5, vlan 3321, spoof checking off, link-state enable, trust off           <--2nd SRIOV Port of vMX(ge-0/0/1)  
     vf 59 MAC c2:5f:c7:7a:8e:74, spoof checking off, link-state enable, trust off 
     vf 60 MAC 1e:cc:ce:a2:04:d9, spoof checking on, link-state enable, trust off 
     vf 61 MAC 7e:d9:34:08:1a:19, spoof checking on, link-state enable, trust off 
     vf 62 MAC fa:16:3e:81:6c:0c, vlan 3320, spoof checking on, link-state enable, trust off 
     vf 63 MAC c6:2d:13:33:87:2a, spoof checking off, link-state auto, trust off 
 9: p2p2:  <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP>   mtu 9000 qdisc mq master bond1 state UP mode DEFAULT group default qlen 1000 
     link/ether 3c:fd:fe:bf:83:e1 brd ff:ff:ff:ff:ff:ff 
 12: p1p1_0:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 8e:09:00:ea:f3:95 brd ff:ff:ff:ff:ff:ff 
 13: p1p1_8:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether ca:3e:0c:bb:1d:9e brd ff:ff:ff:ff:ff:ff 
 14: p1p1_16:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 32:10:9d:7b:8e:9b brd ff:ff:ff:ff:ff:ff 
 15: p1p1_24:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 36:5e:d6:b7:9e:b4 brd ff:ff:ff:ff:ff:ff 
 16: p1p1_32:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 02:90:6c:4b:84:6c brd ff:ff:ff:ff:ff:ff 
 17: p1p1_40:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 3e:e0:e3:b5:b5:55 brd ff:ff:ff:ff:ff:ff 
 18: p1p1_48:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 56:52:3a:eb:4b:dc brd ff:ff:ff:ff:ff:ff 
 19: p1p1_56:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 7a:cf:e0:9e:f5:7f brd ff:ff:ff:ff:ff:ff 
 20: p1p1_9:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether a2:d0:dd:fb:89:0d brd ff:ff:ff:ff:ff:ff 
 21: p1p1_1:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether b6:e4:d3:0c:d6:57 brd ff:ff:ff:ff:ff:ff 
 22: p2p1_0:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 3e:d7:01:fb:61:93 brd ff:ff:ff:ff:ff:ff 
 23: p1p1_25:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 92:49:d5:05:c1:8b brd ff:ff:ff:ff:ff:ff 
 24: p1p1_17:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 0e:80:b8:e8:16:5d brd ff:ff:ff:ff:ff:ff 
 25: p2p1_8:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 92:28:f8:e6:df:9b brd ff:ff:ff:ff:ff:ff 
 26: p1p1_33:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 82:fd:16:0f:32:70 brd ff:ff:ff:ff:ff:ff 
 27: p1p1_49:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether ee:43:48:69:64:bf brd ff:ff:ff:ff:ff:ff 
 28: p1p1_41:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 02:c1:7a:2d:59:6a brd ff:ff:ff:ff:ff:ff 
 29: p1p1_57:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether a2:48:bf:2d:b6:36 brd ff:ff:ff:ff:ff:ff 
 30: p2p1_16:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 16:37:d2:3e:4f:c4 brd ff:ff:ff:ff:ff:ff 
 31: p1p1_10:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 6e:99:2d:0d:0d:02 brd ff:ff:ff:ff:ff:ff 
 32: p1p1_2:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 22:98:dd:7b:76:29 brd ff:ff:ff:ff:ff:ff 
 33: p2p1_9:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 4a:88:db:f3:e6:5b brd ff:ff:ff:ff:ff:ff 
 34: p2p1_1:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether a6:83:12:af:3d:ce brd ff:ff:ff:ff:ff:ff 
 35: p1p1_18:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 96:db:2e:b0:9f:6e brd ff:ff:ff:ff:ff:ff 
 36: p1p1_34:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether e2:d0:92:ec:c0:cd brd ff:ff:ff:ff:ff:ff 
 37: p1p1_26:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 36:25:0b:41:6c:58 brd ff:ff:ff:ff:ff:ff 
 38: p1p1_42:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 32:94:bd:e5:06:d8 brd ff:ff:ff:ff:ff:ff 
 39: p2p1_17:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 8e:59:86:8b:4e:f2 brd ff:ff:ff:ff:ff:ff 
 40: p1p1_50:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 76:4f:bb:45:23:32 brd ff:ff:ff:ff:ff:ff 
 41: p1p1_58:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 6a:6e:05:1e:03:76 brd ff:ff:ff:ff:ff:ff 
 42: p1p1_11:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 5a:ff:d6:ae:79:3e brd ff:ff:ff:ff:ff:ff 
 43: p1p1_3:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether f2:ec:36:ea:91:ff brd ff:ff:ff:ff:ff:ff 
 44: p2p1_2:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 3e:90:8f:5a:96:8d brd ff:ff:ff:ff:ff:ff 
 45: p1p1_19:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 9e:ed:fb:c4:76:7a brd ff:ff:ff:ff:ff:ff 
 46: p2p1_10:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether aa:35:4f:a1:c9:21 brd ff:ff:ff:ff:ff:ff 
 47: p1p1_35:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether b2:de:ba:26:0f:2f brd ff:ff:ff:ff:ff:ff 
 48: p1p1_27:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 8e:1b:83:67:62:61 brd ff:ff:ff:ff:ff:ff 
 49: p1p1_43:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether c6:43:ca:c9:42:04 brd ff:ff:ff:ff:ff:ff 
 50: p1p1_51:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether be:ef:dd:16:b8:c2 brd ff:ff:ff:ff:ff:ff 
 51: p1p1_59:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 0a:29:40:16:39:e5 brd ff:ff:ff:ff:ff:ff 
 52: p1p1_12:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 2a:87:4a:73:c0:09 brd ff:ff:ff:ff:ff:ff 
 53: p1p1_4:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 7e:b2:5e:51:c1:30 brd ff:ff:ff:ff:ff:ff 
 54: p2p1_3:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 16:9a:87:5e:1c:84 brd ff:ff:ff:ff:ff:ff 
 55: p1p1_20:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether b2:00:69:54:bf:fc brd ff:ff:ff:ff:ff:ff 
 56: p2p1_11:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 76:ed:c1:40:0f:13 brd ff:ff:ff:ff:ff:ff 
 57: p1p1_36:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 16:9e:93:37:12:b2 brd ff:ff:ff:ff:ff:ff 
 58: p1p1_28:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 26:cf:5c:ce:17:a2 brd ff:ff:ff:ff:ff:ff 
 59: p2p1_24:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 72:59:65:5e:b0:de brd ff:ff:ff:ff:ff:ff 
 60: p2p1_32:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 9e:3c:6f:cb:61:71 brd ff:ff:ff:ff:ff:ff 
 61: p1p1_44:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether fe:2c:34:c4:4c:15 brd ff:ff:ff:ff:ff:ff 
 62: p1p1_52:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether de:5b:75:86:fa:30 brd ff:ff:ff:ff:ff:ff 
 63: p1p1_60:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 3a:23:5b:67:80:40 brd ff:ff:ff:ff:ff:ff 
 64: p1p1_13:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 52:e1:81:fd:0a:bf brd ff:ff:ff:ff:ff:ff 
 65: p1p1_5:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether a6:f0:8d:02:a4:22 brd ff:ff:ff:ff:ff:ff 
 66: p2p1_4:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether ae:70:69:15:c7:14 brd ff:ff:ff:ff:ff:ff 
 67: p1p1_21:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 72:19:f6:70:f8:69 brd ff:ff:ff:ff:ff:ff 
 68: p2p1_25:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 9a:bc:78:0d:03:7e brd ff:ff:ff:ff:ff:ff 
 69: p1p1_37:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 5e:43:5d:4b:91:5f brd ff:ff:ff:ff:ff:ff 
 70: p1p1_29:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 52:20:c8:b2:1a:79 brd ff:ff:ff:ff:ff:ff 
 71: p2p1_33:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether aa:59:28:48:01:32 brd ff:ff:ff:ff:ff:ff 
 72: p2p1_12:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 96:76:69:b6:de:ce brd ff:ff:ff:ff:ff:ff 
 73: p1p1_45:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether fa:e6:4f:b7:88:9b brd ff:ff:ff:ff:ff:ff 
 74: p1p1_53:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 7e:4a:ea:0b:15:69 brd ff:ff:ff:ff:ff:ff 
 75: p2p1_40:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether b6:66:b2:3a:e6:68 brd ff:ff:ff:ff:ff:ff 
 76: p1p1_61:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether ce:37:47:2f:0a:3e brd ff:ff:ff:ff:ff:ff 
 77: p1p1_6:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether b2:8c:f0:9e:f1:47 brd ff:ff:ff:ff:ff:ff 
 78: p2p1_48:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether a2:6a:f2:a0:6c:a8 brd ff:ff:ff:ff:ff:ff 
 79: p1p1_22:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether d2:67:be:2f:35:fe brd ff:ff:ff:ff:ff:ff 
 80: p1p1_14:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 02:98:d4:d4:1a:7f brd ff:ff:ff:ff:ff:ff 
 81: p1p1_30:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 76:ed:c9:e8:fa:7e brd ff:ff:ff:ff:ff:ff 
 82: p2p1_56:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 5a:80:19:ac:bd:4b brd ff:ff:ff:ff:ff:ff 
 83: p2p1_18:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 4a:a1:8b:bf:a4:ee brd ff:ff:ff:ff:ff:ff 
 84: p2p1_5:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 2a:05:73:79:fd:5f brd ff:ff:ff:ff:ff:ff 
 85: p1p1_46:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 7a:fe:46:4a:14:f9 brd ff:ff:ff:ff:ff:ff 
 86: p2p1_26:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 6e:23:bf:99:49:b9 brd ff:ff:ff:ff:ff:ff 
 87: p1p1_38:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 9e:a6:1c:47:21:5c brd ff:ff:ff:ff:ff:ff 
 88: p1p1_54:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether f6:cd:4a:79:cc:e8 brd ff:ff:ff:ff:ff:ff 
 89: p2p1_34:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 9a:d3:7d:4b:f3:2a brd ff:ff:ff:ff:ff:ff 
 90: p2p1_13:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 3e:f3:f5:a8:df:2a brd ff:ff:ff:ff:ff:ff 
 91: p1p1_7:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 7e:6f:65:e7:71:4e brd ff:ff:ff:ff:ff:ff 
 92: p2p1_41:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 42:d9:50:a8:d9:74 brd ff:ff:ff:ff:ff:ff 
 93: p1p1_23:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether e6:f3:27:9f:e5:2e brd ff:ff:ff:ff:ff:ff 
 94: p1p1_15:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether c2:cf:2b:2b:db:25 brd ff:ff:ff:ff:ff:ff 
 95: p2p1_49:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 32:f8:52:ee:ab:6f brd ff:ff:ff:ff:ff:ff 
 96: p1p1_62:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 0e:39:4b:8b:fc:d6 brd ff:ff:ff:ff:ff:ff 
 97: p2p1_6:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 1e:2d:f6:3e:57:b1 brd ff:ff:ff:ff:ff:ff 
 98: p1p1_39:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether ee:65:55:99:cb:80 brd ff:ff:ff:ff:ff:ff 
 99: p1p1_31:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 26:25:66:d7:62:a1 brd ff:ff:ff:ff:ff:ff 
 101: p2p1_19:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 4a:1d:eb:d4:8e:3d brd ff:ff:ff:ff:ff:ff 
 102: p1p1_47:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 6a:3b:ea:29:d6:c0 brd ff:ff:ff:ff:ff:ff 
 103: p2p1_27:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 32:a6:33:d9:81:53 brd ff:ff:ff:ff:ff:ff 
 104: p1p1_55:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether ce:e5:98:d2:fb:eb brd ff:ff:ff:ff:ff:ff 
 105: p2p1_14:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 5a:ef:6d:27:30:f3 brd ff:ff:ff:ff:ff:ff 
 106: p1p1_63:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether de:48:4f:ac:a1:69 brd ff:ff:ff:ff:ff:ff 
 107: p2p1_42:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether a2:8b:d6:33:92:1f brd ff:ff:ff:ff:ff:ff 
 108: p2p1_7:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 92:c2:c7:c1:01:ae brd ff:ff:ff:ff:ff:ff 
 109: p2p1_50:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 3a:b1:9c:fd:f0:f6 brd ff:ff:ff:ff:ff:ff 
 111: p2p1_20:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether da:7d:42:76:c8:d9 brd ff:ff:ff:ff:ff:ff 
 112: p2p1_15:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether d2:2a:35:80:46:48 brd ff:ff:ff:ff:ff:ff 
 113: p2p1_28:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 06:aa:e8:8a:19:e8 brd ff:ff:ff:ff:ff:ff 
 114: p2p1_43:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether ea:37:a3:d3:d6:77 brd ff:ff:ff:ff:ff:ff 
 115: p2p1_35:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 2a:7c:d5:80:9c:de brd ff:ff:ff:ff:ff:ff 
 116: p2p1_51:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 22:d6:64:3e:e1:2e brd ff:ff:ff:ff:ff:ff 
 118: p2p1_21:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 06:5f:17:80:e2:e3 brd ff:ff:ff:ff:ff:ff 
 119: p2p1_29:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 5a:7b:f1:13:54:ef brd ff:ff:ff:ff:ff:ff 
 120: p2p1_44:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 3e:5c:0d:b5:c4:f1 brd ff:ff:ff:ff:ff:ff 
 121: p2p1_36:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether aa:c3:dd:4d:3b:8e brd ff:ff:ff:ff:ff:ff 
 122: p2p1_52:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether e2:35:10:20:12:49 brd ff:ff:ff:ff:ff:ff 
 123: p2p1_22:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 7a:18:75:51:a0:09 brd ff:ff:ff:ff:ff:ff 
 124: p2p1_30:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether fe:eb:d4:19:68:17 brd ff:ff:ff:ff:ff:ff 
 125: p2p1_45:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether a6:e9:ac:1c:a7:04 brd ff:ff:ff:ff:ff:ff 
 126: p2p1_37:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 3e:c8:4c:c0:69:5b brd ff:ff:ff:ff:ff:ff 
 127: p2p1_23:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 46:46:e9:bc:b7:05 brd ff:ff:ff:ff:ff:ff 
 129: p2p1_53:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 6a:6c:61:9d:06:4a brd ff:ff:ff:ff:ff:ff 
 130: p2p1_31:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether ee:37:9b:4d:9c:22 brd ff:ff:ff:ff:ff:ff 
 131: p2p1_38:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 7a:b5:c0:23:49:32 brd ff:ff:ff:ff:ff:ff 
 133: p2p1_54:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 2e:45:05:c1:28:14 brd ff:ff:ff:ff:ff:ff 
 134: p2p1_46:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 5e:47:71:8e:55:d2 brd ff:ff:ff:ff:ff:ff 
 135: p2p1_39:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether be:83:ac:33:b5:46 brd ff:ff:ff:ff:ff:ff 
 136: p2p1_55:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 46:8a:f0:e9:bb:a4 brd ff:ff:ff:ff:ff:ff 
 137: p2p1_47:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether d2:7c:75:b0:d6:be brd ff:ff:ff:ff:ff:ff 
 140: ovs-netdev:  <BROADCAST,PROMISC>   mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 
     link/ether b2:22:ec:16:05:fe brd ff:ff:ff:ff:ff:ff 
 142: br-ex:  <BROADCAST,PROMISC>   mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 
     link/ether 0a:5a:6b:d8:ee:44 brd ff:ff:ff:ff:ff:ff 
 143: bond0:  <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP>   mtu 9000 qdisc noqueue state UP mode DEFAULT group default qlen 1000 
     link/ether 24:6e:96:ca:f0:6e brd ff:ff:ff:ff:ff:ff 
 144: bond1:  <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP>   mtu 9000 qdisc noqueue state UP mode DEFAULT group default qlen 1000 
     link/ether 3c:fd:fe:bf:83:e1 brd ff:ff:ff:ff:ff:ff 
 145: br-tenant:  <BROADCAST,PROMISC,UP,LOWER_UP>   mtu 9000 qdisc pfifo_fast state UNKNOWN mode DEFAULT group default qlen 1000 
     link/ether 3c:fd:fe:c0:48:f0 brd ff:ff:ff:ff:ff:ff 
 146: vlan304@bond0:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 9000 qdisc noqueue state UP mode DEFAULT group default qlen 1000 
     link/ether 24:6e:96:ca:f0:6e brd ff:ff:ff:ff:ff:ff 
 147: vlan305@bond1:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 9000 qdisc noqueue state UP mode DEFAULT group default qlen 1000 
     link/ether 3c:fd:fe:bf:83:e1 brd ff:ff:ff:ff:ff:ff 
 148: vlan307@bond0:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 9000 qdisc noqueue state UP mode DEFAULT group default qlen 1000 
     link/ether 24:6e:96:ca:f0:6e brd ff:ff:ff:ff:ff:ff 
 149: docker0:  <NO-CARRIER,BROADCAST,MULTICAST,UP>   mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default  
     link/ether 02:42:7f:4b:d4:ea brd ff:ff:ff:ff:ff:ff 
 150: br-int:  <BROADCAST,PROMISC>   mtu 9000 qdisc noop state DOWN mode DEFAULT group default qlen 1000 
     link/ether ee:fe:1e:19:1d:4b brd ff:ff:ff:ff:ff:ff 
 153: p2p1_59:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether c2:5f:c7:7a:8e:74 brd ff:ff:ff:ff:ff:ff 
 155: p2p1_61:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 7e:d9:34:08:1a:19 brd ff:ff:ff:ff:ff:ff 
 156: p2p1_60:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether 1e:cc:ce:a2:04:d9 brd ff:ff:ff:ff:ff:ff 
 159: p2p1_63:  <BROADCAST,MULTICAST,UP,LOWER_UP>   mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 
     link/ether c6:2d:13:33:87:2a brd ff:ff:ff:ff:ff:ff 
 [root@test-compute-1]#