Apply command to all files in folder Post: 303004629

Sponsored Content

Top Forums Shell Programming and Scripting Apply command to all files in folder Post 303004629 by jim mcnamara on Thursday 5th of October 2017 10:04:05 AM

10-05-2017

Registered User

Scott is correct: here is a start using your existing grep and sed logic. Which I think has some problems. Tinker with it, do not uncomment the lines that remove files, so you can run it till you get the sed the way you want.

I don't see how you determine the files to process
but let's assume you write the files you want to process to a text file.

Code:

ls *.txt > /tmp/list  # create a list of files
while read fname 
do

shortname=${fname%.txt}  # remove trailing .txt string
grep -E '^\To: |^\Date: |^\Subject: ' $fname > ${shortname}_1.txt && 
grep -v '^\To: |^\Date: |^\Subject: ' $fname >> ${shortname}_1.txt && 
sed -i -e 's/\(Date: \|Subject: \|To: \)//g' ${shortname}_1.txt

done < /tmp/list

# moved the rm out here for safety.  You cannot test code that removes files like that
# assume this worked correctly so: uncomment if true
# rm $(cat /tmp/list)
# rm /tmp/list

PS: stringing together in looong lines gains you very little and prevents making changes like I showed. You still need a loop.

Plus this code is not always going to work like you described - or so it seems to me.

This User Gave Thanks to jim mcnamara For This Post:

jim mcnamara

View Public Profile for jim mcnamara

Find all posts by jim mcnamara

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

unix command to cound the number of files in a folder

Hi All Can some one help me out. Please tell the unix command to cound the number of files in a folder. Ungent please# Thanks manas

2. Shell Programming and Scripting

using mv command for moving multiple files in a folder

Hi, I have a requirement where I need to move Bunch of folders containing multiple files to another archive location. i want to use mv command .I am thinking when we use mv command to move directory does it create directory 1st and then move all the files ? e.g source...

3. UNIX for Advanced & Expert Users

UNIX: Command to compress folder and all files into a tar

I am trying to grab a folder and all the folders and files underneath it and send it from one computer to another. I basically want to compress the whole folder into a tar, tgz, or zip file so that it can be sent as one file. is there a command to compress a folder and all its contents into a tar...

4. Shell Programming and Scripting

Apply 'awk' to all files in a directory or individual files from a command line

Hi All, I am using the awk command to replace ',' by '\t' (tabs) in a csv file. I would like to apply this to all .csv files in a directory and create .txt files with the tabs. How would I do this in a script? I have the following script called "csvtabs": awk 'BEGIN { FS...

5. UNIX for Dummies Questions & Answers

how to create a command that would print files only from 1 folder

Hi there how to create a command in csh that would print files only from 1 folder but as an argument takes home directory for e.g. in my home diecrtory I have 3 folders unix, windows,mac and alot of files. and I running the program as ./op ~ this should return me files from unix folder without...

6. Shell Programming and Scripting

reading information from a table and apply a command on multiple files

Hey gyuz, I wanna calculate the number of mapped reads of a bam file in a region of interest. I used this code to do so : samtools view input.bam chrname:region1 > region1.txt This will store all the reads from given bam file within the region of interest in region1.txt Now I have...

7. UNIX for Dummies Questions & Answers

Select all files in a folder based on creation date (ls command)

Hi All, <Re-posting in Correct group> I'm trying to select all the files in a folder that starts with a particular name format and are created in a gven date range using 'ls' command...but i'm not successful.... Example : I'm trying to see all the text files in a folder who names start...

8. Shell Programming and Scripting

find command to move the files to other folder - ksh 88

Hi , I've learnt that the following command will remove the files from the given folder for given no.of days find /home/etc -type f -atime -10 -exec rm -f {} \; But how can I change the above command that will move the files to another specified directory instead of removing the...

9. Shell Programming and Scripting

How to use a loop for multiple files in a folder to run awk command?

Dear folks I have two data set which there names are "final.map" and "1.geno" and look like this structures: final.map: gi|358485511|ref|NC_006088.3| 2044 gi|358485511|ref|NC_006088.3| 2048 gi|358485511|ref|NC_006088.3| 2187 gi|358485511|ref|NC_006088.3| 17654 ...

10. UNIX for Dummies Questions & Answers

Loop awk command on files in a folder

Hi, I'd like to loop an action over all files with given extension within a folder. The "main" action is: awk -F "\t" 'BEGIN{OFS="\t"}{if ($10=="S") print$0; }' input.txt > output.txt The input.txt should be every file in the folder with *.subVCF extension; and the output should be a file...

LEARN ABOUT NETBSD

zfgrep

ZGREP(1)						    BSD General Commands Manual 						  ZGREP(1)

NAME

     zgrep, zegrep, zfgrep -- print lines matching a pattern in gzip-compressed files

SYNOPSIS

     zgrep [grep-flags] [--] pattern [files ...]

     zegrep [grep-flags] [--] pattern [file ...]

     zfgrep [grep-flags] [--] pattern [file ...]

DESCRIPTION

     zgrep runs grep(1) on files or stdin, if no files argument is given, after decompressing them with zcat(1).

     The grep-flags and pattern arguments are passed on to grep(1).  If an -e flag is found in the grep-flags, zgrep will not look for a pattern
     argument.

     zegrep calls egrep(1), while zfgrep calls fgrep(1).

EXIT STATUS

     In case of missing arguments or missing pattern, 1 will be returned, otherwise 0.

SEE ALSO

     egrep(1), fgrep(1), grep(1), gzip(1), zcat(1)

AUTHORS

     Thomas Klausner <wiz@NetBSD.org>

BSD
								 December 28, 2003							       BSD

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

unix command to cound the number of files in a folder

Discussion started by: manas6

2. Shell Programming and Scripting

using mv command for moving multiple files in a folder

Discussion started by: rkmbcbs

3. UNIX for Advanced & Expert Users

UNIX: Command to compress folder and all files into a tar

Discussion started by: kane4355

4. Shell Programming and Scripting

Apply 'awk' to all files in a directory or individual files from a command line

Discussion started by: ScKaSx