Benchmark problem with nicsftp agent
We have some benchmark with nicsftp agent on IIS servers where's a lot of log files. Our test team observed CPU peek`s when nicsftp agent start checking new logs files. We have about 400 files with old logs and there is no chance to move them in another location. every one minute nicsftp service generate peek 40-60% it takes about 10-14seconds.
Is there any chance to reduce this problem? As I wrote , there is no chance to move old logs to another location. Always there are logs from few months.
please could you give me some advice , we are middle of the test this solution
We had also observed the problem. We have the simlar requirements that we need to keep the log files for some time on the server. So what we suggested to Application team to write a batch file to zip the old log files everyday i.e. at least change the extention so that the enViison agent does not read all these files everyday for changes.
This has improved the situation and we don;t see any performance problem with the servers as well as the requirement is fulfilled for keeping the months of files on the server itself. (which is not required)
Could you share this script? I'm not sure that your suggestion will be accepted by our IT stuff, they are afraid using some scripts/batch files on most importand production servers.
I was thinking about using filespec options and regular expression in sftpagent.conf , but I do not think it helped me.
The last resort option is to install sftp agent on several servers (different then IIS for example) and share this logs via SMB. We did some test and there is only 2-3% CPU usage of this solution. But in this way , how to configure drive maping on different domain on different credentials and so one. (same local user and password on both sides?)