To automatically delete old transaction data from your Elasticsearch database, you must set a retention period.
Before you begin
What you should know
- When the Elasticsearch database reaches its flood stage watermark, the Elasticsearch indices stop accepting new data. Incoming data is queued in the SQL database until the watermark level changes. This will unblock the indices and the data recovery process moves the queued transaction to the Elasticsearch database. For more information, see Setting the trigger values for Elasticsearch low disk space behavior.
- The retention period defines how long to keep data in the Elasticsearch database.
- The cleanup interval is user-configurable. The cleanup process of data retention occurs every day at specified time.
- The data for the previous month is kept until the current month is over.
- When configuring the retention period, video storage capacity should be taken into consideration. In order to correlate transactions with video footage, the corresponding video footage must still exist on the system. Transaction data retention settings do not affect video retention settings.
Procedure
Example
This means that during the month of February, the data for the current and previous month are kept. On March 1, all data from the previous month of February is kept, and the data from January is deleted.