Shell Programming and Scripting

I have a backup folder that has sub folders created daily. Each sub-folder contains files for that specific day. I need to search all those files to see which ones contains a specific phrase. I also need to take that phrase and output to a text file for that day. This can be done with a one liner, but due to space issues on the box, all the files are gzipped. So, I need to work with a days worth of files before moving the next day.

1. Find the files for say april 1st (this is in the file name as 110401)
3. Gunzip the files
4. Grep the files and send output to a text file
5. Gzip the files
6. Move on to the next day

I know how to find, gunzip, grep, redirect to another file, gzip the files. But how do I get it to do it per day?

Code:

find . -type f -name "*.110401*" -exec gunzip {} \;
 grep <string1> *.110401* > ../110401.txt
 gzip "*.110401*"

After this, the script should go to the next day. How do I accomplish this?

---------- Post updated at 04:38 PM ---------- Previous update was at 11:17 AM ----------

I found that zgrep allows me to read into the gz file without having to uncompress it.

So it's pretty easy to do from here.

You mean like putting it into a loop? Try

Code:

for p in dir1104*/*1104[0-9][0-9]*.gz ; do 
   tar --to-stdout -xf $p | grep  Amethyst >> ${p%%.*}.log 
done

The above will loop through all .gz files containing 1104 and two digits inside the dir1104* directories (please adjust to your particular dir structure); grep needs to be redirected with >> otherwise you'll have in the log only the matches of the last file; no need for find(1) in this construct. You can use 'grep -A3' to get 3 lines after the matched line. ${p%%.*} will substitute only the part of filename before the first period (in some modern shells).

I tried zgrep, but it only reports match/no match, and not the actual content matched....

--------------------------------
I just noticed you're not dealing with tarballs, just gzipped files... zgrep works fine there:

Code:

for p in dir1104*/*1104[0-9][0-9]*.gz ; do 
   zgrep  Amethyst "$p" >> ${p%%.*}.log 
done

Didn't you already make a topic about this?

For grepping within the zip you need not unzip it. Use the command zgrep.
eg:-

Code:

zgrep "your phrase" log.gz

regards,
Ahamed