Working with files that are named with a timestamp Post: 302740641

Sponsored Content

Top Forums Shell Programming and Scripting Working with files that are named with a timestamp Post 302740641 by os2mac on Thursday 6th of December 2012 01:29:34 PM

12-06-2012

Registered User

Working with files that are named with a timestamp

So I have a script that runs an ls on a given directory and looks for files with a timestamp that has the current hour in it and then does work with the files that it discovers

Code:

DATE=`date +'%y%m%d%H'`
HOSTIS=`hostname`
#EMAIL NOTIFICATION ALS
EMAIL=address@server.com
#

if [ $HOSTIS = 'serverhostname' ]; then
  TOHOST='destination_address@destination_server.com'
 else
#This is for the test server
 TOHOST='test_address@test_server.com'
fi

for i in `ls /transfer |grep $DATE`
do

   sftp  -vvv $TOHOST 2>&1 | tee /homedir/user/debug.out<<EFT
   cd /directory/file
      lcd /transfer
      put $i
EFT
   echo "SFTP Completed successfully."
   echo "SFTP Completed successfully." |mailx -s "SFTP completed successfully" $EMAIL
exit
done

This is then run as a cron at 58 after the hour. This has obvious implications if the user manages to generate data between hh:58:01 and HH:00:00. it was a small risk but a risk nonetheless. It only took them two weeks. So now I need to figure out how to search for $DATE -1 hour and run the cron based on that and it has me stumped...

any ideas?

os2mac

View Public Profile for os2mac

Find all posts by os2mac

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Comparing files named by date/time

I've looked at several of the previous posts and can't seem to find any that pertain to my problem, I'd appreciate some help if possible. I have a directory with numerous logs of various names all named by heading and date ie. dog.20050529.log dog.20050530.log ...

2. UNIX for Dummies Questions & Answers

fifo or named pipe working?

Can someone explain to me the working of fifo() system call using simple C programs so that I can implement them in the UNIX environement?

3. Shell Programming and Scripting

Finding missing files that are named sequentially with Perl?

Hello I am new to Perl, in fact I am on chapter one of the book. :) However I am in need of a Perl Script faster than I can finish the book. Perhaps someone can help me with my immediate need while I read my book. I have a directory with hundreds of files that are all named like...

4. Shell Programming and Scripting

cat certain files in directories to files named after the dir?

Hi all, I have a directory with many subdirectories each named like so: KOG0001, KOG0002, ...KOG9999. Each of these subdirectories contain a variable number two kinds of files (nuc and prot) named like so: Capitella_sp_nuc_hits.fasta (nuc) and Capitella_sp_prot_hits.fasta (prot). The...

5. Shell Programming and Scripting

sort the files based on timestamp and execute sorted files in order

Hi I have a requirement like below I need to sort the files based on the timestamp in the file name and run them in sorted order and then archive all the files which are one day old to temp directory My files looks like this PGABOLTXML1D_201108121235.xml...

6. Shell Programming and Scripting

Move all files not in a directory into a subdirectory named for each given file

Hi Everyone! Looking for some help with a script that will take all files in any given root folder (which are not already in a folder) and put them into separate folders with the name of each given file. Any ideas? Thank you!

7. Shell Programming and Scripting

Identifying files with a timestamp greater than a given timestamp

I need to be able to identify files with file timestamps greater than a given timestamp. I am using the following solution, although it appears to compare files at the "seconds" granularity and I need it at the milliseconds. When I tested my solution, it missed files that had timestamps...

8. Shell Programming and Scripting

Joining Similarly Named Files

Have a few hundred files that I have no control over. I need to join them on a common string. There are two files per unit. The file names are: AAAA_X_file1.txt AAAA_file2.txt join -a1 file1 file2 - this works. My question is, is there a way to use the join command listing the file...

9. Shell Programming and Scripting

[Solved] awk manipulation of sequentially named files

Hello, I am a very novice user of awk, I have a set of files named file001, file002, file003, file004, etc., each contains four fields (columns of data) separated each by a uneven number of spaces. I want to substitute those spaces by a TAB, so I am using this line of awk script: awk -v OFS="\t"...

10. Shell Programming and Scripting

How to zip or rm the multi part named files?

Hello There, There are more than 1000 files in my log folder and i want to zip it to relase the space. But my method throwing syntax error due to the multi part file name, how to overcome in this ? ls -lart | grep "MDB_Kernel11.1_gwlog_SUN 22_09_2013" | awk '{print $9,$10,$11,$12}' | head...

LEARN ABOUT PLAN9

cron

CRON(8) 						      System Manager's Manual							   CRON(8)

NAME

       cron - clock daemon

SYNOPSIS

       auth/cron [-c]

DESCRIPTION

       Cron executes commands at specified dates and times according to instructions in the files /cron/user/cron.  It runs only on an authentica-
       tion server.  Option -c causes cron to create /cron/user and /cron/user/cron for the current user; it can be run from any Plan 9 machine.

       Blank lines and lines beginning with # in these files are ignored.  Entries are lines with fields

	      minute hour day month weekday host command

       Command is a string, which may contain spaces, that is passed to an rc(1) running on host for execution.  The first five fields are integer
       patterns for

	      minute	     0-59

	      hour	     0-23

	      day of month   1-31

	      month of year  1-12

	      day of week    0-6; 0=Sunday

       The syntax for these patterns is

	      time  : '*'
		    | range
	      range : number
		    | number '-' number
		    | range ',' range

       Each number must be in the appropriate range.  Hyphens specify inclusive ranges of valid times; commas specify lists of valid time ranges.

       To run the job, cron calls host and authenticates remote execution, equivalent to running rx host command (see con(1)).	The user's profile
       is run with $service set to rx.

       Cron is not a reliable service.	It skips commands if it cannot reach host within two minutes, or if the cron daemon is not running at  the
       appropriate time.

EXAMPLES

       Here is the job that mails system news.

	      % cat /cron/upas/cron
	      # send system news
	      15 8-17, 21 ***	  helix     /mail/lib/mailnews
	      %

SOURCE

       /sys/src/cmd/auth/cron.c

SEE ALSO

       con(1), rc(1)

																	   CRON(8)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Comparing files named by date/time

Discussion started by: gillr

2. UNIX for Dummies Questions & Answers

fifo or named pipe working?

Discussion started by: lvkchaitanya

3. Shell Programming and Scripting

Finding missing files that are named sequentially with Perl?

Discussion started by: newftronics

4. Shell Programming and Scripting

cat certain files in directories to files named after the dir?

Discussion started by: kmkocot