- RSA Product Set: SecurID
- RSA Product/Service Type: Authentication Manager
- RSA Version/Condition: 8.3 and higher
- Component: Config.groovy, biztier, console heap
Use this article if your RSA Authentication Manager Security Console is experiencing any of the following symptoms and your appliance has 16 GB or more of available RAM:
- The Security Console returns an HTTP 503 (Service Unavailable) error
- Stuck threads, transaction timeouts, or Java heap space errors appear in the logs:
In/opt/rsa/am/server/logs/biztier.log:Date&Time> <Error> <WebLogicServer> <securidadmin> <biztier> <[ACTIVE] ExecuteThread: '50' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1554957986183> <BEA-000337> <[STUCK] ExecuteThread: <Date&Time> <Info> <EJB> <securidadmin> <biztier> <BEA-010227> <EJB exception occurred during invocation from home or business: com.rsa.command.CommandServerEjb30_vraifm_Intf generated exception: COMMAND_EXECUTION_UNEXPECTED_ERROR Caused by: com.rsa.common.SystemException: com.rsa.common.UnexpectedDataStoreException: unable to select group from IMS_GROUP_DATA Caused by: java.sql.SQLException: The transaction is no longer active - status: 'Marked rollback. [Reason=weblogic.transaction.internal.TimedOutException: Transaction timed out after 600 seconds BEA1-7296CB88F9924262E80E]'. No further JDBC access is allowed within this transaction.
In /opt/rsa/am/server/logs/console.log:
'19' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1554471588597> <BEA-000337> <[STUCK] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "620" seconds working on the request "Http Request Information: weblogic.servlet.internal.ServletRequestImpl@6c4c9b83[GET /console-ims/DashBoardUserGroupMembership.do]"
In/opt/rsa/am/server/logs/imsTrace.log:
INFO | jvm 1 | main | 2019/03/27 19:20:42 | Exception in thread "OARequestHandler Dispatcher Thread" java.lang.OutOfMemoryError: Java heap space INFO | jvm 1 | main | 2019/03/27 19:22:46 | Exception in thread "weblogic.GCMonitor" java.lang.OutOfMemoryError: Java heap space STATUS | wrapper | main | 2019/03/27 19:23:05 | TERM trapped. Shutting down. Caused by: java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOfRange(Arrays.java:2694) at java.lang.String.<init>(String.java:203) at java.lang.StringBuilder.toString(StringBuilder.java:405) at com.rsa.authmgr.internal.common.dal.hibernate.util.FilterHQL.createQuery(FilterHQL.java:543) at com.rsa.authmgr.internal.admin.common.dal.sql.DataObjectAccessSql$3.doInHibernate(DataObjectAccessSql.java:931) at org.springframework.orm.hibernate3.HibernateTemplate.doExecute(HibernateTemplate.java:407) at org.springframework.orm.hibernate3.HibernateTemplate.executeFind(HibernateTemplate.java:344) at com.rsa.authmgr.internal.admin.common.dal.sql.DataObjectAccessSql.executeFind(DataObjectAccessSql.java:902) at com.rsa.authmgr.internal.admin.common.dal.sql.DataObjectAccessSql.executeSearch(DataObjectAccessSql.java:856) at com.rsa.authmgr.internal.admin.common.dal.sql.DataObjectAccessSql.executeCiSearch(DataObjectAccessSql.java:821) at com.rsa.authmgr.internal.admin.common.dal.sql.DataObjectAccessSql.search(DataObjectAccessSql.java:661) at com.rsa.authmgr.internal.admin.agentmgt.dal.sql.AgentAccessSQL.searchAccessibleAgentsByGroups(AgentAccessSQL.java:61) at com.rsa.authmgr.internal.admin.agentmgt.impl.AgentLocatorImpl.searchAccessibleAgentsByGroups(AgentLocatorImpl.java:183) at com.rsa.authmgr.admin.agentmgt.SearchAccessibleAgentsForPrincipalCommand$Executive.execute(SearchAccessibleAgentsForPrincipalCommand.java:25) at com.rsa.authmgr.admin.agentmgt.SearchAccessibleAgentsForPrincipalCommand.performExecute(SearchAccessibleAgentsForPrincipalCommand.java:217)
In the System Log report (Security Console > Reporting):16042 GetPrincipalGroupsCommand ActivityMonitorCommand SQL No value specified for parameter 3 Could not get JDBC Connection; Rolled back. Transaction timed out after 599 seconds 16099 Administrator “<admin>” attempted to read a group ou=<group or ou> 16263 Find user across Identity Sources <LDAP Identity Source name> 16294 Failed to connect to identity source <LDAP Identity Source name>Prerequisites:
- SSH access to the primary Authentication Manager server
- Operating system credentials (
rsaadminor the username configured during Quick Setup) - Sufficient available RAM on the appliance (16–32 GB minimum recommended)
- Operations Console administrator credentials (required to retrieve secrets if needed)
To resolve this issue:
- Increase both console and biztier heap size memory allocation in:
/opt/rsa/am/config/src/scripts/Config.groovy - Reboot the RSA Authentication Manager server.
Task 1: Increase Heap Size in Config.groovy
- Log in to the primary Authentication Manager server via SSH using the operating system credentials.
NOTE: If a different username was selected during Quick Setup, use that username instead ofrsaadmin.
NOTE: If SSH is not enabled on the Authentication Manager instance, enable it before proceeding. For instructions, see Enable Secure Shell on the Appliance - Navigate to the Config.groovy scripts directory:
cd /opt/rsa/am/config/src/scripts/ - Back up the original Config.groovy file:
cp Config.groovy Config.groovy.orig - Open the Config.groovy file for editing using vi and press I to enter edit mode.
vi Config.groovy - Under the
heapsizes normalsection, update thebiztierandconsolevalues for the 8G, 16G, and 32G memory profiles as follows:
"8G" { opsconsole = "512m" biztier = "3072m" console = "2048m" radiusoc = "100m" quicksetup = "512m" } "16G" { opsconsole = "512m" biztier = "4096m" console = "4096m" radiusoc = "100m" quicksetup = "512m" } "32G" { opsconsole = "1024m" biztier = "10240m" console = "5120m" radiusoc = "256m" quicksetup = "512m" } - Save and close the file:
- Press Esc to exit edit mode.
- Type :wq and press Enter to save and exit.
- Reboot the Authentication Manager server and wait for it to fully restart before proceeding.
sudo reboot - Verify: Confirm the updated heap sizes are active by running:
ps -ef | grep biztier ps -ef | grep consoleThe output should show the updated
-Xmsand-Xmxvalues matching your memory profile. For example:-Xms4096m -Xmx4096m - Repeat Steps 1–8 on each replica server, one at a time.
Task 2: Reduce LDAP Group Search Memory Consumption (Optional)
-
Log in to the Operations Console.
-
Navigate to Deployment Configuration > Identity Sources > Manage Existing.
-
Click the context arrow next to the identity source and choose Edit.
-
Click the Map tab.
-
Scroll to Directory Configuration — User Groups.
-
For Search Scope, change the value from Search all sublevels to Search only single level.
- Under Use MemberOf Attribute, clear the option Enable the use of the MemberOf attribute.
Before:
After: -
Click Save or Save and Finish.
-
Verify: Confirm the identity source settings have been saved and monitor the Security Console for recurrence of the
OutOfMemoryError.
-
Wrapper Configuration Files: There is no need to manually update
wrapper.java.additionalentries 35 and 36 in/opt/rsa/am/server/wrapper/BiztierServerWrapper.conforConsoleServerWrapper.conf. These files are automatically updated byConfig.groovyafter reboot. However, if you apply the same heap size changes directly to both wrapper files, you can apply the changes without a full reboot by restarting Authentication Manager services instead:/opt/rsa/am/server/rsaserv restart all -
Memory Allocation Principles: Increasing heap size is only effective when the appliance has spare RAM available. If spare RAM is not available, consider reducing the scope of resource-intensive operations such as LDAP group searches (see Task 2) rather than increasing allocations.
-
User Dashboard Memory Impact: The Security Console User Dashboard performs resource-intensive queries across all identity sources, including group membership, authentication history, and accessible agent information. If Help Desk administrators do not require all this data, restricting LDAP group search scope (Task 2) can significantly reduce memory consumption.
-
Alternative Memory Approaches: There are three ways to address
OutOfMemoryErrorissues in Authentication Manager:- Allocate more memory (Task 1) — if spare RAM is available
- Reduce resource consumption (Task 2) — by adjusting LDAP group search settings
- Apply both approaches together for maximum effect
Related Articles
"Unknown Action Field" and "<field> is required" errors when running Authentication Manager Bulk Admin (AMBA); ^M found in… 11Number of Views Error "Unrecognized VM option 'MetaSpaceSize=256m'" and services do not start on RSA Authentication Manager 8.3 38Number of Views 'java.lang.IllegalAccessError: tried to access field org.apache.xpath.compiler.FunctionTable.m_functions from class org.ap… 13Number of Views RSA Authentication Manager Administration Server with Operations Console service fails to start when restarted from the SS… 1.71KNumber of Views RSA Authentication Manager 8.8 upgrade fails with ERROR: auth_manager.rest_service.old_access_key is not found 2.13KNumber of Views
Trending Articles
RSA Authentication Manager Upgrade Process How to Update the Root (Server) and Client Certificates in RSA Identity Governance & Lifecycle RSA Authenticator 6.2.2 for Windows Administrator Guide RSA SecurID software token .sdtid file fails to import into RSA SecurID Software Token 5.0 for Windows RSA MFA Agent 2.3.6 for Microsoft Windows Installation and Administration Guide