Description

In releases before 18.3R1, only 2 CPU cores are allocated to JUNOS VM in QFX10000 series switches.

Juniper increased processor resources for JUNOS VM in QFX10000 series switches since 18.3R1 and later releases.

Symptoms

For example, high interrupt usage from management network interface, disk operations etc, SLIP messages, FPC socket close and protocol flap might been seen as follows: 

Sep  7 19:39:18.103  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 5657 usec
Sep  7 19:41:42.144  QFX10000-SWITCH overlayd[6085]: JTASK_SCHED_SLIP_KEVENT: 4 sec 971157 usec kevent block
Sep  7 19:47:04.973  QFX10000-SWITCH sflowd[6079]: JTASK_SCHED_SLIP_KEVENT: 4 sec 878733 usec kevent block
Sep  7 19:47:08.830  QFX10000-SWITCH ufdd[6069]: JTASK_SCHED_SLIP_KEVENT: 4 sec 734634 usec kevent block
Sep  7 19:47:55.128  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 6966 usec
Sep  7 19:48:07.014  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 3346 usec
Sep  7 19:52:54.926  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 3001 usec
Sep  7 19:53:17.291  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 225382 usec
Sep  7 19:53:37.841  QFX10000-SWITCH overlayd[6085]: JTASK_SCHED_SLIP_KEVENT: 4 sec 669215 usec kevent block
Sep  7 19:54:29.508  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 4861 usec
Sep  7 19:54:52.543  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 2036 usec
Sep  7 20:00:07.247  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 2732 usec
Sep  7 20:00:29.305  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 4228 usec
Sep  7 20:00:34.312  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 3021 usec
Sep  7 20:00:45.368  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 2400 usec
Sep  7 20:07:16.640  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 3343 usec
Sep  7 20:07:25.654  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 5203 usec
Sep  7 20:10:26.851  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 19740 usec
Sep  7 20:10:47.177  QFX10000-SWITCH fpc1 DDOS: Master socket closed
Sep  7 20:10:47.000  QFX10000-SWITCH fpc1 fpc1 dcpfe: DDOS: Master socket closed
Sep  7 20:11:29.056  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 6817 usec
Sep  7 20:11:31.126  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 3569 usec
Sep  7 20:11:33.064  QFX10000-SWITCH fpc1 DDOS: Master socket closed
Sep  7 20:11:33.000  QFX10000-SWITCH fpc1 fpc1 dcpfe: DDOS: Master socket closed
Sep  7 20:12:50.994  QFX10000-SWITCH fpc1 DDOS: Master socket closed
Sep  7 20:12:51.000  QFX10000-SWITCH fpc1 fpc1 dcpfe: DDOS: Master socket closed
Sep  7 20:15:01.999  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 70738 usec
Sep  7 20:15:07.010  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 5863 usec
Sep  7 20:18:25.870  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 3265 usec
Sep  7 20:18:27.882  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 12053 usec
Sep  7 20:19:09.214  QFX10000-SWITCH dot1xd[6086]: JTASK_SCHED_SLIP_KEVENT: 4 sec 987972 usec kevent block
Sep  7 20:24:34.918  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 30471 usec
Sep  7 20:24:47.992  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 2034 usec
Sep  7 20:29:01.096  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 2019 usec
Sep  7 20:29:23.130  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 179 usec
Sep  7 20:29:47.081  QFX10000-SWITCH fpc1 DDOS: Master socket closed
Sep  7 20:29:47.000  QFX10000-SWITCH fpc1 fpc1 dcpfe: DDOS: Master socket closed
Sep  7 20:31:43.687  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 3218 usec
Sep  7 20:31:48.693  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 3247 usec
Sep  7 20:32:43.043  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 4916 usec
Sep  7 20:32:49.054  QFX10000-SWITCH chassisd[5395]: mcontrol hipri thread scheduling slip 2 sec, 4544 usec

Solution

Starting with 18.3R1 and later releases, processor resources for JUNOS VM has increased. This will improve the RE performance and system stability.

QFX10002

  • Current No. of CPU cores for JUNOS VM = 2
  • Proposed No. of cores = 2 but with different way of allocating,Two completely dedicated cores for JUNOS VM
  QFX10008/QFX10016
  • Current No. of CPU cores for JUNOS VM = 2
  • Proposed No. of cores = 4