Description

The zookeeper logs consumes memory and disk utilization reaches more than 80% in EVO devices.

 

Symptoms

The zookeeper logs consumes memory and disk utilization reaches more than 80% in EVO devices.
 

start shell
[vrf:none]jtac-1@r32:~$ cd /run/zookeeper/conf/default/
[vrf:none] jtac-1@r32:/run/zookeeper/conf/default$ du -sh *
4.0K myid
25G version-2
/run/zookeeper/conf/default/version-2$ ls -l | grep 'Sep 5'
-rw-r--r-- 1 root root 67108880 Sep 5 00:10 log.11a9faa9a
-rw-r--r-- 1 root root 67108880 Sep 5 00:58 log.11aa07195
-rw-r--r-- 1 root root 67108880 Sep 5 01:51 log.11aa18995
-rw-r--r-- 1 root root 67108880 Sep 5 02:29 log.11aa2f861
-rw-r--r-- 1 root root 67108880 Sep 5 03:10 log.11aa3dea0
-rw-r--r-- 1 root root 67108880 Sep 5 03:50 log.11aa4eec7
-rw-r--r-- 1 root root 67108880 Sep 5 04:31 log.11aa5ea35
-rw-r--r-- 1 root root 67108880 Sep 5 05:08 log.11aa6f1c7
-rw-r--r-- 1 root root 67108880 Sep 5 06:08 log.11aa7ce89


1 alarms currently active
Alarm time Class Description
2024-08-27 23:58:51 CEST Minor Host 0 Active Disk Usage Exceeded

Solution

As per the fix provided in PR#1678880, the disk manager clean up logs when the memory usage reaches  85%. 
This shows very high and sudden low memory usage in devices, which causes concern for customers.

PR#1788276 is raised to address this scenario. With this changes the zookeeper logs will be cleared for every 8 hours.

Modification History

2024-10-04 : Article Created