Loop certain code to all files within directory


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Loop certain code to all files within directory
# 1  
Old 01-19-2009
Loop certain code to all files within directory

Hi all,

Can somebody help me with this problem pls.

I need to extract one specific line from each files in a folder and put
the all lines extracted in a unique output file in the following format.

line extracted, respective name of file, date of file.

I´m, trying the part to extract the desired line with


Code:
awk '/Category/ {getline; print}' infile.txt

But I dont know how to do a loop over all files and send all lines
to one outfile.txt with the format desired.

Example:
If the line extracted from one specific file with


Code:
awk '/Category/ {getline; print }' infile.txt

is "District school", the desire result would be:


Code:
District school,  file date,  file name

Thanks in advance for any help
# 2  
Old 01-19-2009
Hi cg,

You can loop through the files inside a directory like this:

Code:
FLDR="."
cd $FLDR
find . ! -name . -prune -type f | while read x; do
   # this will print the filename
  #echo $x

  # To get the date
  #ls -lt $x | awk '{print $6" "$7" "$8}' 
  # If the file is older than 6 months (not sure though), this will include the year. If not, this will include the time

  # What you want maybe like this: 
  found=`awk '/Category/ {getline; print }' "$x"`
  [ "$found" != "" ] && echo "$found,$x,"`ls -lt $x | awk '{print $6" "$7" "$8}'`
done

# 3  
Old 01-19-2009
Code:
#!/usr/bin/perl
@files=glob("*.txt");
open FH,">out.txt";
foreach(@files){
	open F,"<$_";
	my $file=$_;
	while(<F>){
		print FH $file," line $.: ",$_ if /Toyota/;
	}
	close F;
}
close FH;

# 4  
Old 01-20-2009
Hi anghel and summer_cherry,

SmilieSimply perfect!!!, exactly what I need.

Very appreciated your always kindly help.

Best regards
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to exclude some files from the loop on the directory?

I have one question. On the directory I have many files start with DB.DAILYxxxxxxx.YYYYMMDD.HHMMSS and I have several files with other format, like LET.20170310 daily.20170310 tba.20170310 How can I exclude from my loop DB.DAILY files? I tried ls *20170310* | while read... (4 Replies)
Discussion started by: digioleg54
4 Replies

2. Shell Programming and Scripting

Loop through files in directory

I am trying to loop through files in a directory, and sort each file. No matter what changes I make to the code, I get the following errors: 'aunch.sh: line 4: syntax error near unexpected token `do 'aunch.sh: line 4: `for f in ${FILES}/*; do #!/bin/bash FILES=$(pwd) for f in ${FILES}/*;... (6 Replies)
Discussion started by: ldorsey
6 Replies

3. Shell Programming and Scripting

Loop through files in directory

I am trying to loop through files in a directory, and sort each file. No matter what changes I make to the code, I get the following errors: 'aunch.sh: line 4: syntax error near unexpected token `do 'aunch.sh: line 4: `for f in ${FILES}/*; do #!/bin/bash FILES=$(pwd) for f in ${FILES}/*;... (1 Reply)
Discussion started by: ldorsey
1 Replies

4. Shell Programming and Scripting

Loop through files in a directory

Hello How do I loop through files in a specific directory ? This script is not working! #! /bin/bash FILES=/usr/desktop/input/* For f in $FILES; do awk '-v A="$a" -v B="$b" {$6=($1-64)/2 ;$7=((10^($6/10))/A)^(1/B) ; print}' OFS="\t" $f > /root/Desktop/output/$f.txt; done ... (7 Replies)
Discussion started by: ali.seifaddini
7 Replies

5. UNIX for Dummies Questions & Answers

[Solved] Writing a loop to changing the names of files in a directory

Hi, I would like to write a loop to change the names of files in a directory. The files are called data1.txt through data1000.txt. I'd like to change their names to a1.txt through a1000.txt. How do I go about doing that? Thanks! (2 Replies)
Discussion started by: evelibertine
2 Replies

6. UNIX Desktop Questions & Answers

Copy all files in 1 directory to another usinge for-in loop

I was looking to get some help with copying files in one directory to another using a for-in loop. My script file is called copyfile and here is what I have: for file in $(ls -a $1) do cp $file ~/dir-2 done When I run copyfile dir-1 this is what I get cp: omitting directory `.'... (1 Reply)
Discussion started by: Trinimini
1 Replies

7. Shell Programming and Scripting

Find the latest directory and loop through the files and pick the error messages

Hi, I am new to unix and shell scripting,can anybody help me in sctipting a requirement. my requirement is to get the latest directory the name of the directory will be like CSB.monthdate_time stamp like CSB.Sep29_11:16 and CSB.Oct01_16:21. i need to pick the latest directory. in the... (15 Replies)
Discussion started by: sudhir_83k
15 Replies

8. Shell Programming and Scripting

loop through files in directory

hi all i have some files present in a directory i want to loop through all the files in the directory each time i loop i should change the in_file parameter in the control file and load it into a table using sql loader there is only one table where i have to load alll the files ... (3 Replies)
Discussion started by: rajesh_tns
3 Replies

9. AIX

loop through the directory for files and sort by date and process the first file

hello i have a requirement where i have a direcotry in which i get files in the format STOCKS.20080114.dat STOCKS.20080115.dat STOCKS.20080117.dat STOCKS.20080118.dat i need to loop through the directory and sort by create date descending order and i need to process the first file. ... (1 Reply)
Discussion started by: dsdev_123
1 Replies

10. Shell Programming and Scripting

Loop through files in a directory

Hi, I want to write bash script that will keep on looking for files in a directory and if any file exists, it processes them. I want it to be a background process, which keeps looking for files in a directory. Is there any way to do that in bash script? I can loop through all the files like... (4 Replies)
Discussion started by: rladda
4 Replies
Login or Register to Ask a Question