Frequent alarms "ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect." seen on Contrail 21.4L2. This may in-turn cause frequent alarms "Process(es) reporting as non-functional" on Contrail 21.4L2
These alarms are because of "ContrailConfig missing or incorrect" alerts. These alarms are caused because of a "regression" bug introduced in contrail version 21.4.L2.329. This bug will not impact any contrail functionality, and the alarms are shown because analytics is not receiving the UVEs. To fix this issue, customer need to upgrade the setup to 21.4L3 version.
Sample alarms seen on TF GUI
<hostname> <timestamp> Process(es) reporting as non-functional.)
Corresponding alarm-gen logs:
<time-stamp> 7f657ebfa370 [contrail-alarm-gen] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: AlarmgenConfigLog: name = default-global-system-config:system-defined-conf-incorrect config_type = alarm operation = UPDATE config = { fq_name : ["default-global-system-config", "system-defined-conf-incorrect"]alarm_severity : 1alarm_rules : {"or_list": [{"and_list": [{"operation": "==", "operand1": "ContrailConfig", "variables": [], "operand2": {"uve_attribute": null, "json_value": "null"}}]}]}parent_uuid : "<uuid>"parent_type : "global-system-config"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}id_perms : {"enable": true, "uuid": {"uuid_mslong": 4750045011169985404, "uuid_lslong": 11766729238488888548}, "created": "<time-stamp>", "creator": null, "user_visible": true, "last_modified": "<time-stamp>", "permissions": {"owner": "admin", "owner_access": 7, "other_access": 7, "group": "admin", "group_access": 7}, "description": "ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect."}display_name : "system-defined-conf-incorrect"uve_keys : {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}uuid : "<uuid>" }