Datafeed:Distinction of files in web server Datafeed Directory
I have a question on Datafeed regarding distinction of files at web server at Datafeed directory.Currently we have setup 5 different File transporter datafeeds and all these Datafeeds we are running manually. The current setup of server and datafeed are:
a.1 webserver where only Configuration service is ruunning,1 application server where rest other services are running like job engine,queining ..etc along with Configuration service and 1 SQL server.
b. The datafeed Directory is on web server where we are currently dumping the various files(DLP,USB,..etc) manually on the web server datafeed directory to run the feeds. Since we are using the Default Configuration of Datafeed Home Directory we have not changed the Relative path in the Installation tab. By saying that i mean that we are using the "File Name.CSV" in the Transport path for running all these datafeeds.
Going forward these datafeeds will run Scheduled wise monthly and in that case there is a tool called "OPEN AM" which will dump all these various files (DLP,USB..etc..) in these Datafeed directory at the Web server.
So my question is,
How will Datafeed recognise these various new files from that Datafeed Directory which have to run monthly on scheduled basis?
will appreciate your suggestions and ideas.
Thank you for your reply.I have one question if the file name is same then what about the previous files which are already existing in the same folder. By that i want to mean ,let say i have configured the datafeed for this octobor month with name "ABC.CSV" and in NOV month through the open AM tool they have dumped a new CSV file "ABC.CSV" at the same location . Will the Datafeed will not process the OLD file(ABC.CSV) for the october month? The same will be consecutive for the next months also.
will i have to select "Delete" option in the post processing tab,so that Data feed will delete the source file when the feed is completed? If its the case will it have any impact ?
If your filenames follow certain pattern such as:
Then you can use a wildcard character in the datafeed to pick up files beginning with the word DLP : (relative path)\DLP*.csv
And for your second question: Yes, you will either need to delete the source file or rename it to something unique so that your datafeed does not pick up the file on the next run.
Thanks Syed for your explaination.I was looking for that response as my business requirement matches that requirement. Just to clear my doubt regarding relative path, if my various DLP files as you mentioned above
are kept in Datafeed(folder) directory at webserver ,so i guess my path will at Data feed(Transport tab) will be,
D:\RSAArcher\Datafeed\DLP*.CSV ? Is these you are talking about? or are there any better options!
Thanks for your line.
Yes, That is correct. Keep in mind - when you used DLP*.csv -> The feed will pick up ALL files that begin with the name DLP. So, if you do not want a file to picked up on the next run, you will need to rename to something that doesn't start with DLP.
Hope that helps.