07-17-2007
How to process only new files
Dear Experts,
I desperately need help in some scripting that im totally stuck at.
I have some files like this :-
-rw-rw---- 1 rtp99 ticgroup 2603099 Jul 17 13:24 cft.CO0102.20070717051933.20070717052451
-rw-rw---- 1 rtp99 ticgroup 3040772 Jul 17 13:24 cft.CO0101.20070717051133.20070717052453
-rw-rw---- 1 rtp99 ticgroup 3102533 Jul 17 13:36 cft.CO0102.20070717052451.20070717053611
-rw-rw---- 1 rtp99 ticgroup 3069764 Jul 17 13:37 cft.CO0101.20070717052453.20070717053741
-rw-rw---- 1 rtp99 ticgroup 3159779 Jul 17 13:48 cft.CO0102.20070717053611.20070717054803
-rw-rw---- 1 rtp99 ticgroup 3167636 Jul 17 13:48 cft.CO0101.20070717053741.20070717054844
-rw-rw---- 1 rtp99 ticgroup 3074107 Jul 17 13:59 cft.CO0102.20070717054803.20070717055925
-rw-rw---- 1 rtp99 ticgroup 3098716 Jul 17 14:00 cft.CO0101.20070717054844.20070717060030
-rw-rw---- 1 rtp99 ticgroup 3182712 Jul 17 14:10 cft.CO0102.20070717055925.20070717061033
-rw-rw---- 1 rtp99 ticgroup 3195226 Jul 17 14:11 cft.CO0101.20070717060030.20070717061148
As you can see the files come in every 2-10 mins. I need to process some info inside these files and dump the info elsewhere. The problem is, i dont know how to only pick up the next new file (latest file), and process it. I tried dumping the output of "ls" onto a file, and then using "comm" to find the new file, but this method seems to be slowing down my server a lot.
Appreciate any help. Many thanks.
Sara
10 More Discussions You Might Find Interesting
1. HP-UX
Hi, i'd like to get the files which are opened by a process during his execution using the c language.
Thanks for helping me. (2 Replies)
Discussion started by: benoit.gaillard
2 Replies
2. Shell Programming and Scripting
Hi,
I have some file in /users/xyz directoty with .tar.gz extension. i need to find these files and if found in need to run other commands. I now the command for finding files,but how to put if condition ?please help me
Thanks (3 Replies)
Discussion started by: bmkreddy
3 Replies
3. UNIX for Dummies Questions & Answers
Hi,
First post here.
In Mac OSX terminal I need to run a program against multiple files in a directory and append the output to tab separated variable file.
I currently type the following to process just one file
MBP:/Users/dc1743/Desktop/SFT root# ./myprogram myfile1.plist >>... (1 Reply)
Discussion started by: dc1743
1 Replies
4. Solaris
if i am finding out that a process has a more cpu usage before killing the process what are the commands to find out the files which are used by the process.
can anyone help this
thanks (1 Reply)
Discussion started by: sureshlee_83
1 Replies
5. Shell Programming and Scripting
hi i have a dir contains files
i am reading
ls $path | while read FILE
do
grep "a GFT buffer" $path/$FILE
......
.....
done
it is able to process the fist file, from secomd onwards it is giving the following error, 2nd file name is "sd_gfts_GFT1_TCPGFT.trc.4"
grep:... (1 Reply)
Discussion started by: Satyak
1 Replies
6. OS X (Apple)
I am having a client/server application which will download files from server. If server has directories, it will create directories/sub directories and then download files. In this process, I observed that number of open files are more than 400 (which is approxmately same as number of dir/subdir... (1 Reply)
Discussion started by: satyam90
1 Replies
7. UNIX for Dummies Questions & Answers
Hi all,
when i run a program in a Linux, it may call bunch of other files.
How do i find those files?
thanks in adanvance
Sajith (1 Reply)
Discussion started by: email2sajith
1 Replies
8. Shell Programming and Scripting
Hello forum members,
I hope you can help me with this I don't know hot to reach.
I have a list of files in "/home/MyPath1/" and in "/home/MyPath2/". The files have the same name in both folders.
(but different content, the content doesn't matter here I think)
/home/MyPath1/
filename1.txt... (4 Replies)
Discussion started by: Ophiuchus
4 Replies
9. Shell Programming and Scripting
Is there a general way I can use so as to process paths/files from your terminal without the need to backslash things?
Till recently I used to use
touch "file_here"
but it does not work if file_here contains any of the characters ` and ", I still need to backslash them if I want to make the... (1 Reply)
Discussion started by: hakermania
1 Replies
10. Red Hat
I would like to test open files usage in my system, if I want to create a process ( or script ) that can use a certain amount ( eg. 1000 ) of open files , is it possible to create such process ( or script ) ? (3 Replies)
Discussion started by: ust
3 Replies
fspy(1) User Commands fspy(1)
NAME
fspy - filesystem activity monitoring tool
SYNOPSIS
fspy [options] [file/dir]
OPTIONS
-F, --filter STRING/REGEX
a string or regular expression which will be used to filter the output. (the regex will be matched against the whole path e.g.
[/etc/passwd])
-I, --inverted STRING/REGEX
its the same like -F/--filter but inverted. you can combine both. e.g. -F '.conf' -I 'wvdial.conf' will filter for files with
".conf" in its name but without "wvdial.conf" in it.
-R, --recursive NUMBER
enables the recursive engine to look at a depth of NUMBER.
-A, --adaptive
(HIGHLY-EXPERIMENTAL) enables the adaptive mode. e.g. if new items will be added within the path fspy will automatically add those
items to the watch list.
-D, --diff VALUE
(EXPERIMENTAL) enables the diffing feature. VALUE may be a comma separated list of: s - element size (byte) A - last access time
(e.g. Mon Jul 21 21:32:31 2008) M - last modification time (e.g. Mon Jul 21 21:32:31 2008) S - last status change time (e.g. Mon Jul
21 21:32:31 2008) O - permissions (octal) U - owner (uid) G - group (gid) I - inode number D - device id
-T, --type VALUE
specifies the type of objects to look for. VALUE may be a comma separated list of: f - regular file d - directory s - symlink p -
FIFO/pipe c - character device b - block device o - socket default is any.
-O, --output VALUE
specifies output format. VALUE may be a comma separated list of: f - filename p - path d - access description t - element type s -
element size (byte) w - watch descriptor (inotify manpage) c - cookie (inotify manpage) m - access mask (inotify manpage | src/fsev-
ents.h) l - len (inotify manpage) A - last access time (e.g. Mon Jul 21 21:32:31 2008) M - last modification time (e.g. Mon Jul 21
21:32:31 2008) S - last status change time (e.g. Mon Jul 21 21:32:31 2008) O - permissions (octal) U - owner (uid) G - group (gid) I
- inode number D - device id T - date and time (for this event) (e.g. Tue Mar 25 09:23:16 CET 2008) e.g.: '[,T,], ,d,:,p,f' would
result in: '[Mon Sep 1 12:31:25 2008] file was opened:/etc/passwd' (take a look at the README).
-h, --help
this short help.
--version
version information.
AUTHOR
fspy is Copyright 2008-2009, Richard Sammet
This manual page was written by Giuseppe Iuculano <giuseppe@iuculano.it>, for the Debian project (but may be used by others).
fspy 0.1.0 January 2009 fspy(1)