Problem Statement:
Oracle ASM partition used by RSA IG&L is running out of space on the Production environment.
We have checked the existing configurations on the server and we can see that 1TB of disk space was allocated to Oracle ASM, out of which only 60GB is free. The AVUSER database export (.dmp file) is only 45GB in size.
Customer Environment:
RSA IG&L v7.0 Patch 3 – Hardware Appliance with Oracle 12C and Wildfly 8.2 Application Server on Suse Linux 11
Steps Taken Till Now:
We have done some housekeeping as suggested on the KB articles listed below but that has not solved the issue:
- https://community.rsa.com/docs/DOC-45883
- https://community.rsa.com/docs/DOC-45782
- https://community.rsa.com/docs/DOC-46137
- https://community.rsa.com/docs/DOC-86452
We had found another KB article which may have had some resolution steps, but that link does not seem to exist now:
https://community.rsa.com/articles/en_US/How_To/KB-1241-How-to-free-up-Oracle-ASM-disk-space
Thanks very much, Mostafa for your assistance in this issue. We found out that the Data Guard was not working for some reason due to which the archive logs generated on the Primary Oracle DB were not getting deleted (as a part of the scheduled cron job which deletes the archive logs) as they were not getting applied on the Secondary Oracle DB.
We had to manually delete the hidden archive logs (both on primary and secondary Oracle servers) on the ASM disk space, which is only accessible if you run a very specific set of commands. I am posting the steps here for everyone's benefit:
Run the below commands as an oracle user on a hardware appliance with ASM configured:
Don't forget to change the environment variables for ORACLE_SID and ORACLE_HOME back to their original values.