000029582 - RSA Security Analytics 10.4 rabbitmq-server in a failed state due to too many open files

Document created by RSA Customer Support Employee on Jun 15, 2016Last modified by RSA Customer Support Employee on Apr 21, 2017
Version 2Show Document
  • View in full screen mode

Article Content

Article Number000029582
Applies ToRSA Product Set: Security Analytics
RSA Product/Service Type: Security Analytics Server
RSA Version/Condition: 10.4.0.x
Platform: CentOS
Platform (Other): RabbitMQ
O/S Version: EL6
IssueThe rabbitmq-server service is in a failed state on the Security Analytics server.
The following messages are seen when attempting to stop and start the service:
[root@SA-Server ~]# service rabbitmq-server status
su: /bin/sh: Too many open files in system
[root@SA-Server ~]# service rabbitmq-server stop
Stopping rabbitmq-server: RabbitMQ is not running
[root@SA-Server ~]# service rabbitmq-server start
Starting rabbitmq-server: FAILED - check /var/log/rabbitmq/startup_
{log, _err}

CauseThe issue occurs because the underlying OS has not been configured to allow a high enough number of open files.

In order to resolve the issue, perform the steps below to increase the number of open files handles and then start rabbitmq-server service.

  1. Check the current value before making changes.
    [root@SA-Server ~]# sysctl fs.file-max

  2. Set the value to survive a reboot.
    [root@SA-Server ~]# echo "fs.file-max = 30000" >> /etc/sysctl.conf

  3. Set the value in the live OS environment.
    [root@SA-Server ~]# sysctl -w fs.file-max=30000 
    [root@SA-Server ~]# sysctl -p

  4. Verify that the change has taken effect in the live OS environment.
    [root@SA-Server ~]# sysctl fs.file-max

If you are unsure of any of the steps above or experience any issues, contact RSA Support and quote this article number for further assistance.