Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Apply command to all files in folder
Top Forums Shell Programming and Scripting Apply command to all files in folder Post 303004629 by jim mcnamara on Thursday 5th of October 2017 10:04:05 AM
Old 10-05-2017
Scott is correct: here is a start using your existing grep and sed logic. Which I think has some problems. Tinker with it, do not uncomment the lines that remove files, so you can run it till you get the sed the way you want.


I don't see how you determine the files to process
but let's assume you write the files you want to process to a text file.
Code:
ls *.txt > /tmp/list  # create a list of files
while read fname 
do

shortname=${fname%.txt}  # remove trailing .txt string
grep -E '^\To: |^\Date: |^\Subject: ' $fname > ${shortname}_1.txt && 
grep -v '^\To: |^\Date: |^\Subject: ' $fname >> ${shortname}_1.txt && 
sed -i -e 's/\(Date: \|Subject: \|To: \)//g' ${shortname}_1.txt

done < /tmp/list

# moved the rm out here for safety.  You cannot test code that removes files like that
# assume this worked correctly so: uncomment if true
# rm $(cat /tmp/list)
# rm /tmp/list

PS: stringing together in looong lines gains you very little and prevents making changes like I showed. You still need a loop.

Plus this code is not always going to work like you described - or so it seems to me.
This User Gave Thanks to jim mcnamara For This Post:
guilliber
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

unix command to cound the number of files in a folder

Hi All Can some one help me out. Please tell the unix command to cound the number of files in a folder. Ungent please# Thanks manas (6 Replies)
Discussion started by: manas6
6 Replies

2. Shell Programming and Scripting

using mv command for moving multiple files in a folder

Hi, I have a requirement where I need to move Bunch of folders containing multiple files to another archive location. i want to use mv command .I am thinking when we use mv command to move directory does it create directory 1st and then move all the files ? e.g source... (4 Replies)
Discussion started by: rkmbcbs
4 Replies

3. UNIX for Advanced & Expert Users

UNIX: Command to compress folder and all files into a tar

I am trying to grab a folder and all the folders and files underneath it and send it from one computer to another. I basically want to compress the whole folder into a tar, tgz, or zip file so that it can be sent as one file. is there a command to compress a folder and all its contents into a tar... (7 Replies)
Discussion started by: kane4355
7 Replies

4. Shell Programming and Scripting

Apply 'awk' to all files in a directory or individual files from a command line

Hi All, I am using the awk command to replace ',' by '\t' (tabs) in a csv file. I would like to apply this to all .csv files in a directory and create .txt files with the tabs. How would I do this in a script? I have the following script called "csvtabs": awk 'BEGIN { FS... (4 Replies)
Discussion started by: ScKaSx
4 Replies

5. UNIX for Dummies Questions & Answers

how to create a command that would print files only from 1 folder

Hi there how to create a command in csh that would print files only from 1 folder but as an argument takes home directory for e.g. in my home diecrtory I have 3 folders unix, windows,mac and alot of files. and I running the program as ./op ~ this should return me files from unix folder without... (1 Reply)
Discussion started by: FUTURE_EINSTEIN
1 Replies

6. Shell Programming and Scripting

reading information from a table and apply a command on multiple files

Hey gyuz, I wanna calculate the number of mapped reads of a bam file in a region of interest. I used this code to do so : samtools view input.bam chrname:region1 > region1.txt This will store all the reads from given bam file within the region of interest in region1.txt Now I have... (5 Replies)
Discussion started by: @man
5 Replies

7. UNIX for Dummies Questions & Answers

Select all files in a folder based on creation date (ls command)

Hi All, <Re-posting in Correct group> I'm trying to select all the files in a folder that starts with a particular name format and are created in a gven date range using 'ls' command...but i'm not successful.... Example : I'm trying to see all the text files in a folder who names start... (6 Replies)
Discussion started by: Satya C1
6 Replies

8. Shell Programming and Scripting

find command to move the files to other folder - ksh 88

Hi , I've learnt that the following command will remove the files from the given folder for given no.of days find /home/etc -type f -atime -10 -exec rm -f {} \; But how can I change the above command that will move the files to another specified directory instead of removing the... (1 Reply)
Discussion started by: smile689
1 Replies

9. Shell Programming and Scripting

How to use a loop for multiple files in a folder to run awk command?

Dear folks I have two data set which there names are "final.map" and "1.geno" and look like this structures: final.map: gi|358485511|ref|NC_006088.3| 2044 gi|358485511|ref|NC_006088.3| 2048 gi|358485511|ref|NC_006088.3| 2187 gi|358485511|ref|NC_006088.3| 17654 ... (2 Replies)
Discussion started by: sajmar
2 Replies

10. UNIX for Dummies Questions & Answers

Loop awk command on files in a folder

Hi, I'd like to loop an action over all files with given extension within a folder. The "main" action is: awk -F "\t" 'BEGIN{OFS="\t"}{if ($10=="S") print$0; }' input.txt > output.txt The input.txt should be every file in the folder with *.subVCF extension; and the output should be a file... (3 Replies)
Discussion started by: dovah
3 Replies

LEARN ABOUT DEBIAN

xclip-copyfile

XCLIP-COPYFILE(1)					      General Commands Manual						 XCLIP-COPYFILE(1)

NAME

       xclip-copyfile, xclip-cutfile, xclip-pastefile - copy and move files via the X clipboard

SYNOPSIS

       xclip-copyfile [-p] FILES...

       xclip-cutfile [-p] FILES...

       xclip-pastefile

DESCRIPTION

       xclip-copyfile copies files into the X clipboard, recursing into directories.

       xclip-cutfile copies the files, but also deletes them afterwards.

       -p     preserve path formation

       xclip-pastefile pastes the files out of the clipboard

EXAMPLES

       Copying a file to a remote host

       [maggie.lkpg.cendio.se ~]$ echo "A file created on ${HOSTNAME}" > file1
       [maggie.lkpg.cendio.se ~]$ xclip-copyfile file1
       [sofie.homeip.net ~/doc]$ xclip-pastefile
       file1
       [sofie.homeip.net ~/doc]$ cat file1
       A file created on maggie.lkpg.cendio.se

       Copying an entire tree structure

       [sofie.homeip.net ~]$ xclip-copyfile doc
       [maggie.lkpg.cendio.se ~/tmp]$ xclip-pastefile
       doc/
       doc/letter-mom-april.txt
       doc/file1
       doc/letter-dad-march.txt

       Copying files with preserved path information

       [maggie.lkpg.cendio.se ~]$ xclip-copyfile -p /etc/sysconfig/grub
       tar: Removing leading `/' from member names
       [sofie.homeip.net ~/tmp]$ xclip-pastefile
       etc/sysconfig/grub
       [sofie.homeip.net ~/tmp]$ ls etc/sysconfig/grub
       etc/sysconfig/grub

       Moving files

       [sofie.homeip.net ~]$ ls letter-brother-may.txt
       letter-brother-may.txt
       [sofie.homeip.net ~]$ xclip-cutfile letter-brother-may.txt
       [sofie.homeip.net ~]$ ls letter-brother-may.txt
       ls: cannot access letter-brother-may.txt: No such file or directory
       [sofie.homeip.net ~]$ cd doc
       [sofie.homeip.net ~/doc]$ xclip-pastefile
       letter-brother-may.txt

AUTHORS

       This  manual  page  was written by Maximilian Gass <mxey@cloudconnected.org> for the Debian project. It may be used for everything else, of
       course.

																 XCLIP-COPYFILE(1)
All times are GMT -4. The time now is 03:41 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy