The Accumulator service is a JSA process that counts and prepares events and flows in data accumulations to assist with searches, displaying charts, and report performance.
Accumulated data is an aggregate data view used to draw a time series graph or run scheduled Reports. The data that is created is referenced by the term Global View . The Accumulator service creates minute by minute accumulations. The accumulator_rollup service runs once per hour and creates the hourly roll-up's. At 12:15 AM it creates the daily roll-up.
There are two ways in which accumulation can be enabled:
The following steps outline how to capture time series data for accumulation:
Note: After enabling time series data capture for a selected parameter, an asterisk (*) is displayed next to the parameter in the Value to Graph list box. You will need to select the Capture Time Series Data check box and click the Save icon for each parameter for which you would like to accumulate data.
If a previously Saved Search Criteria is used in a hourly, daily, weekly, or monthly report, then the data matching the Saved Search Criteria will be accumulated.
This data is rolled up in to three different resolutions by time in order to reduce the amount of data that needs to be queried when a search is performed across a data set.
The first roll-up is the normal roll-up. The normal roll-up is 1 minute long, by default. This can also be referred to as the minute roll-up. Every minute, the normalized data collected in the previous minute is aggregated and rolled up based on the accumulation type in the criteria.
Every hour, the normal roll-up's are rolled up into hourly data. This means the 60 data points produced by the normal roll-up will be rolled into 1 data point for the hour.
Every day, the hourly roll-up's are rolled up into daily data. That means the 24 data points produced by the hourly roll-up will be rolled into 1 data point for the day. The different roll-up's are basically different resolutions of the data. They are placed in a flat file within the Ariel database. Each file is subdivided as years, months, days, and hours. The minute roll-up's are files in the hours file.
The accumulator data for this example is based on the following search criteria:
Data is grouped by IP and Policy and Risk Scores are summed. In the example data above, there are two events that occurred within the same minute. During the Minute Roll-up, these two events will be rolled into one, as the results of their grouped search parameters (IP and Policy) are the same. The Risk Scores for these two events will be summed together as shown below:
01/15/2018 01:01:02 IP=1.1.1.1, Policy A, Risk Score = 5 + 01/15/2018 01:01:23 IP=1.1.1.1, Policy A, Risk Score = 7 = 01/15/2018 01:01 IP=1.1.1.1, Policy A, Risk Score = 12
The accumulated Minute Roll-up from the example data will result in the following:
The Hourly Roll-up will further roll up the resulting data from the Minute Roll-up each hour. There were three results for the first hour. All were from the same IP, but two were from Policy A and one was from Policy B. The two results that have the same IP and Policy will be rolled together as the results of their grouped search parameters (IP and Policy) are the same. The Risk Scores for these two results will be summed together as shown below:
01/15/2018 01:01 IP=1.1.1.1, Policy A, Risk Score = 12 + 01/15/2018 01:02 IP=1.1.1.1, Policy A, Risk Score = 5 = 01/15/2018 01 IP=1.1.1.1, Policy A, Risk Score = 17
The accumulated Hourly Roll-up from the results of the Minute Roll-up data will result in the following:
Once a day, the Daily Roll-up will again roll up the resulting data from the Hourly Roll-up even further. There were three for the day, but only two have both the same IP and Policy, so those two will be rolled together as the results of their grouped search parameters (IP and Policy) are the same. The Risk Scores for these two results will be summed together as seen below:
01/15/2018 01 IP=1.1.1.1, Policy A, Risk Score = 17 + 01/15/2018 02 IP=1.1.1.1, Policy A, Risk Score = 5 = 01/15/2018 IP=1.1.1.1, Policy A, Risk Score = 22
The accumulated Daily Roll-up from the results of the Hourly Roll-up data will result in the following: