How to purge table data prior to version 7.0.1 in RSA Identity Governance & Lifecycle

[#1]

Article Number

000031223

Applies To

RSA Product Set: RSA Identity Governance & Lifecycle 
RSA Version/Condition: 6.9.1, 7.0.0
 

Issue

This document explains how to determine if an RSA Identity Governance & Lifecycle database has tables which are large and may benefit from a purge and how to purge those tables in RSA Identity Governance & Lifecycle versions 7.0.0 and below. If you are on RSA Identity Governance & Lifecycle 7.0.1 or above, please see RSA Knowledge Base Article 000038168 -- How to manage database growth in RSA Identity Governance & Lifecycle.

Large tables in a database may have the following negative impacts to the product

• Poor performance within the user interface
• Longer and larger database backups and restores
• Long run times for database statistics

Resolution

The easiest way to get an understanding of the RSA Identity Governance & Lifecycle database size is to run a Statistics Report.

1. From the RSA Identity Governance & Lifecycle user interface select Admin > System from the menu.
2. Click the Diagnostics tab.
3. Click Create Report as depicted below:

Image description

4. After clicking Create Report and refreshing the page, there will be a new report entry placed in the table below the button. Note that the View, Download and Delete buttons are greyed out during report compilation.  
5. Once the report is complete the buttons will be enabled.
6. Upon clicking on the View button an HTML page will be displayed which includes a number of metrics about the current implementation.  For this document the sections of interest are entitled

• Aveksa Database Size Summary
• Aveksa Internal Table Summary

Image description

7. From the screen shot above, specifically the Aveksa Database Size Summary, we learn that the size of all tables summed equals 37.51 GB and the sum of all tables is 38.92 GB.  The Aveksa Internal Table Summary will then list all tables, alphabetically listed, and for each table the following is displayed 

• Table Name
• Number of Rows
• Last Analyze Date, which is the date when database statistics were run on the table
• Table Size (MB)
• Index Size (MB)
• Number of Indexes
• Number of valid Indexes
• Number of non-valid indexes

8. One can either
   1. Scan this table and look for tables which have a large Table Size (MB) value, or
   2. Highlight and copy the entire table and paste it into a spreadsheet application, whereby one can then sort the data based upon the fourth column named Table Size (MB).
9. If the following tables are among your top N tables, they are eligible for a purge.

• T_AV_APPLICATION_LOG
• T_AV_JOB_STATS
• T_AV_AFX_LOG_MESSAGE
• T_EMAIL_LOG

T_AV_APPLICATION_LOG

Description:  
This table represents the same data represented in the aveksaServer.log.  It is governed by Admin > System > Logs tab > Settings button and the field entitled Database Retention N days, as depicted:
 

Image description

Configuring N days will increase/decrease the table size, as will a change to debug levels captured.

Purge:  
To purge from this table one can configure Database Retention N days as described above
 

T_AV_JOB_STATS

Description:  
The table is used by jobs running in the system to log the activity that they are performing. This table is typically used by processes or jobs that are executing SQL commands as a way to log their activity or process steps. The data in T_AV_JOB_STATS is displayed primarily within a job detail page as from Admin > Monitoring and specifically the link named Database Logs for Run ###, for example:
 

Image description

And the data represented behind the link Database Logs for Run ID ### is similar to what is seen here:
 

Image description

To which this data is used so as to understand the database packages and procedures, along with duration, that were called to complete the job.  Often times, this is the largest table in the schema for a single job under Admin > Monitoring and hundreds to thousands of rows can be added to this table.

Purge: 
To purge from this table one can run the following SQL statement as avuser to remove all data in the T_AV_JOB_STATS table that is older than 90 days:

$ sqlplus avuser/<password>
SQL> EXECUTE Data_Retention_Pkg.Prune_Run_Details(SYSDATE-90);

T_AV_AFX_LOG_MESSAGE

Description:  
If Access Fulfillment Express (AFX) is installed, this table holds log messages that are also logged in the connectors log file on the Linux host. Data from this tab is displayed in the user interface at AFX > Servers > Logs tab and the AFX > Connectors tab:
 

Image description

 

Image description

Purge: 
To purge data from T_AV_AFX_LOG_MESSAGE one can do the following:

Prior to version 6.9.1 

There is no procedure available to purge the T_AV_AFX_LOG_MESSAGE table.

 

On version 6.9.1

As avuser, run the following SQL to remove all data in the T_AV_AFX_LOG_MESSAGE table that is older than 90 days.
 

$ sqlplus avuser/<password>   
SQL> EXECUTE Data_Retention_Pkg.Prune_Application_Log(SYSDATE-90);

On version 7.0 or later

T_AV_AFX_LOG_MESSAGE will be purged per the same parameter for purging T_AV_APPLICATION_LOG.   

T_EMAIL_LOG

Description:  
This table holds a record of every email that was sent out via the application and is equivalent to the display in the Admin > Email > Logs tab:
 

Image description

The size of the table is governed by the configuration parameter defined in the Admin > Email > Settings tab for the value of Days to retain email log ( 0 = forever): N days
 

Image description

Purge:  
As detailed above, one can control the size of T_EMAIL_LOG by the field Days to retain email log ( 0 = forever): N days from the Admin > Email > Settings tab.

Notes

The Data_Retention_Pkg was deprecated in RSA Identity Governance & Lifecycle 7.0.2 and later. For RSA Identity Governance & Lifecycle 7.0.2 and and later, data purging is automatic and is configured in the user interface under the Admin > System > Data Management tab. See the following sources for more information:

• In the RSA Identity Governance & Lifecycle user interface, view the online help section Managing Data Purging.
• RSA Knowledge Base Article  000036367 -- ORA-06550 error when attempting to run the Data_Retention_Pkg in RSA Identity Governance & Lifecycle