In the event the Decoder suffers a crash or power outage it is likely there will be a large number of sessions it deems as invalid. It will then set a flag for the Concentrators to indicate which sessions are invalid so the Concentrator can invalidate them in its database. At times this process can take a long time which will cause the service to be unavailable for investigations.
In order to bypass this the invalidation flag needs to be removed from the decoder for the affected Concentrators. Follow these steps for each Concentrator to remove the invalidation flag and bring the Concentrator back online.
- Stop the Concentrator service via the appliance tasks in Administrator.
- Connect to the Decoder via Administrator and open an explorer tab by entering Ctrl-E with the Decoder selected.
- Navigate to decoder->config->recovery.
- Right click on the recovery folder and select "Properties".
- In the frame that opens in the bottom right click the pull down menu and select "setrecov".
- In the parameters field enter 'device=<concentrator> key=sessions.invalid value=' where <concentrator> is the complete folder name including colon ":" and port number if present of the Concentrator entry in the frame above.
- Click "Send".
- Start the Concentrator service via the appliance tasks in Administrator.
The Concentrator should start normally and resume consuming from the decoder once it finishes initializing its indexes.
This may also occur in the event a Decoder was data reset without being removed from it's Concentrator first. If this is the case you may need to take the following additional steps:
- On the Concentrator attempt to stop aggregation. Look in the log window for "Aggregation threads have completed" to confirm Aggregation has stopped. In this case it might not.
- If after 5 minutes aggregation still has not stopped stop the Concentrator service from the Appliance Service using "Appliance Tasks". Select "stop service" and enter "service=concentrator" where appropriate and click "Run".
- In the same window switch to "start service" and enter "service=concentrator" and click "Run"
- Connect back to the Concentrator's service
- If additional Decoders are attached the Concentrator make take some time to Initialize. You can watch the logs in the logs window for how long the Concentrator will take to initialize.
- If your Concentrator is set to start aggregation automatically, stop aggregation and look in the log window for "Aggregation threads have completed" to confirm Aggregation has stopped.
- Attempt to add the recently reset Decoder back in, if it's already there, remove it then attempt to add it back in. You may see status "error" for the Decoder, this is OK.
- Start aggregation and the error should clear and the Concentrator should start aggregating from the Decoder once again
If you are unsure of any of the steps above or experience any issues, contact RSA Support and quote this article ID for further assistance.