I would greatly appreciate it if someone can help me with my problem.
I have a crawler which collects spam URLs everyday & this data needs to be published in a blacklist.
Here's the catch:
The "Time To Live" (TTL) for each URL is 3 months (or whatever for that matter). If i see the same URL again within the expiry of its TTL, I need to update that URLs TTL, so it stays in the blacklist for another 3 months (TTL).
The URLs which were never seen after the TTL need to be removed from the list after the TTL expires, so I don't have old data & can manage the size of my blacklist.
Here's an example current URL list which my crawler would have got today:
[URL followed by TTL of 3 days or whatever for that matter]
Here's an example of the current master URL file used for comparison:
Here's an example of the updated master URL file after comparison:
Here's what the final blacklist should look like:
How do can do this using using sed/grep/date (if it is indeed possible)? Unfortunately, I can't install any SQL db on this machine, which I realize would make things easy.
I need to help to calculating using date in a script.
One application is licensed by date, some month at a time.
I can read the date from system and get an output like this:
echo $status
6A34 System4 01.01.11-31.01.11
My goal is to use license date 31.01.11 and subtract todays date... (7 Replies)
Hello folks,
I have question about my expiry of shell script, today date is 2009-11-11, i will have to deploy a script today, how i should setup that my script will not work after 2010-05-11, Between if someone will change the date of server then script will again not work, please give... (3 Replies)
Hi,
Is there any way i can give an expiry date for files that i create? For example, i would like to get a file deleted automatically after 60 days from the creation date. Is there any possibility for this in Unix?
Thanks,
RRVARMA (3 Replies)
Hi,
We are going to create the new user, using that user we are automate the work, but every 90 days password get expired how can i create or avoid the expiry the password. (1 Reply)
Does anyone know a simple way to find out the expiry date of my UNIX user password?
I do not have root access to the box.
Surely there is a way to so this... (4 Replies)
Hi Guys,
I am trying to write one ksh script where I have to go to lots of unix boxes and read one text file which will have data like this though this is not complete data. And I just have to extract expire date ( which is 2nd date value 08/31/2009 in the first one ) and the server name ( astro... (0 Replies)
HI,
I want to know the certificate expiry dates and who is owner of the certificate installed in UNIX.
example certiface name
1)SSL
2)Veri Sign Trust Network (1 Reply)
Hi all,
I want to write a shell script that read line by line of a file that have all domain names written, after reading complete file it will give us following output.
Domain Name Expiry Days-Left
abcd.com 20-Feb-200 6 10
How can i acheive that script... (6 Replies)