Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Loop awk command on files in a folder
Top Forums UNIX for Dummies Questions & Answers Loop awk command on files in a folder Post 302959822 by dovah on Friday 6th of November 2015 08:30:08 AM
Old 11-06-2015
Loop awk command on files in a folder
Hi, I'd like to loop an action over all files with given extension within a folder.

The "main" action is:
Code:
 awk -F "\t" 'BEGIN{OFS="\t"}{if ($10=="S") print$0; }' input.txt > output.txt

The input.txt should be every file in the folder with *.subVCF extension; and the output should be a file named in the same way than the input file, but with addition of the string 'NEW'

I am currently trying:

Code:
for i in $(ls *.subVCF); do echo $i; a=$(echo $i | awk -F "\t" 'BEGIN{OFS="\t"}{if ($10=="S") print$0; }'); $i > 'NEW'$a; done

But it isn't working... what I am doing wrong?

Thanks in advance
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

using mv command for moving multiple files in a folder

Hi, I have a requirement where I need to move Bunch of folders containing multiple files to another archive location. i want to use mv command .I am thinking when we use mv command to move directory does it create directory 1st and then move all the files ? e.g source... (4 Replies)
Discussion started by: rkmbcbs
4 Replies

2. Shell Programming and Scripting

Comparison and editing of files using awk.(And also a possible bug in awk for loop?)

I have two files which I would like to compare and then manipulate in a way. File1: pictures.txt 1.1 1.3 dance.txt 1.2 1.4 treehouse.txt 1.3 1.5 File2: pictures.txt 1.5 ref2313 1.4 ref2345 1.3 ref5432 1.2 ref4244 dance.txt 1.6 ref2342 1.5 ref2352 1.4 ref0695 1.3 ref5738 1.2... (1 Reply)
Discussion started by: linuxkid
1 Replies

3. Shell Programming and Scripting

Loop through text file > Copy Folder > Edit XML files in bulk?

I have a text file which contains lines in this format - it contains 105 lines in total, but I'm just putting 4 here to keep it short: 58571,east_ppl_ppla_por 58788,east_pcy_hd_por 58704,east_pcy_ga_por 58697,east_pcy_pcybs_por It's called id_key.txt I have a sample folder called... (9 Replies)
Discussion started by: biscuitcreek
9 Replies

4. Shell Programming and Scripting

loop through files in each folder and perform sed

Dear all, I have few log folders in directory (FILE) and i need to perform sed on each files inside each folders. Here is my script, and i wish to rename each file back to the same file name after modification. Can anyone guide me on my script below? eg: folder1 contain files... (2 Replies)
Discussion started by: ymeyaw
2 Replies

5. UNIX for Dummies Questions & Answers

how to create a command that would print files only from 1 folder

Hi there how to create a command in csh that would print files only from 1 folder but as an argument takes home directory for e.g. in my home diecrtory I have 3 folders unix, windows,mac and alot of files. and I running the program as ./op ~ this should return me files from unix folder without... (1 Reply)
Discussion started by: FUTURE_EINSTEIN
1 Replies

6. Shell Programming and Scripting

For loop for number of files in a folder

Hi All, Need a for loop which should run for number of files in a folder and should pass the file name as parameter to another shell script for each loop. Please help me. Thanks. (2 Replies)
Discussion started by: chillblue
2 Replies

7. Shell Programming and Scripting

How to use a loop for multiple files in a folder to run awk command?

Dear folks I have two data set which there names are "final.map" and "1.geno" and look like this structures: final.map: gi|358485511|ref|NC_006088.3| 2044 gi|358485511|ref|NC_006088.3| 2048 gi|358485511|ref|NC_006088.3| 2187 gi|358485511|ref|NC_006088.3| 17654 ... (2 Replies)
Discussion started by: sajmar
2 Replies

8. Shell Programming and Scripting

awk error when increasing number of files in folder

I have a folder with several files of which I want to eliminate all of the terms that they have in common using `awk`. Here is the script that I have been using: awk ' FNR==1 { if (seen++) { firstPass = 0 outfile = FILENAME "_new" ... (4 Replies)
Discussion started by: owwow14
4 Replies

9. Shell Programming and Scripting

Apply command to all files in folder

Hi all! I have this command grep -E '^\To: |^\Date: |^\Subject: ' fileA.txt > fileA_1.txt && grep -v '^\To: |^\Date: |^\Subject: ' fileA.txt >> fileA_1.txt && rm fileA.txt && sed -i -e 's/\(Date: \|Subject: \|To: \)//g' fileA_1.txtHow do I apply it to all the files in the folder (each file has a... (7 Replies)
Discussion started by: guilliber
7 Replies

10. UNIX for Beginners Questions & Answers

For loop to accept params and delete folder/files

Hi Folks - I'm trying to build a simple for loop to accept params and then delete the folder & files on the path older than 6 days. Here is what I have: Purge () { for _DIR in "$1" do find "${_DIR}"/* -mtime +0 -exec rm {} \; done } I would be passing... (4 Replies)
Discussion started by: SIMMS7400
4 Replies

LEARN ABOUT DEBIAN

rdup-up

RDUP-UP(1)							       rdup								RDUP-UP(1)

NAME

       rdup-up - update a directory tree with a rdup archive

SYNOPSIS

       rdup-up [OPTION]...  DIRECTORY

DESCRIPTION

       With rdup-up you can update an (possibly) existing directory structure with a rdup archive.

       The rdup archive has to be given to rdup-up's standard input.

   Username and uids
       rdup  outputs  both  the  username  and	uid, the receiving system (which may be a totally different system) checks if the username and uid
       match. If the username and uid don't match the (numeric) uid is used on the file. The same holds true for the groupname and gid.

OPTIONS

       -n     Do a dry-run and do not create anything on disk.

       -t     Create DIRECTORY (ala mkdir -p) if it does not exist.

       -s N   Strip N path components from a pathname. If the resulting pathname is empty after this operation it is skipped. Be  careful  however
	      with the following structure:

		  /foo
		  /foo/bar
		  /foo/bar/bla.txt
		  /foo/blork/bla.txt

	      With rdup-up -s2 this will leave:

		  <empty>
		  <empty>
		  /bla.txt
		  /bla.txt

	      And the last 'bla.txt' will overwrite the previous one, this will happen without warnings.

       -r PATH
	      This option is related to the -s option, but works different. The string PATH is removed from (the beginning of) each pathname. With
	      -r /home/backup the pathname /home/backup/bin/mycmd becomes /bin/mycmd. The same could be done with -s 2, but then you need to count
	      the slashes. Note -s is always performed before -r.

       -v     Be more verbose and echo the processed files to standard output.

       -vv    Be even more verbose and echo processed file and the uid and gid information to standard output.

       -T     Show  a  table  of  contents of the rdup stream received (ala tar -tf -).  With -T the directory argument is optional. -T unsets any
	      verbose (-v) options.

       -h     A short help message.

       -V     Show the version.

EXIT CODE

       rdup-up return a zero exit code on success, otherwise 1 is returned.

AUTHOR

       Written by Miek Gieben.

REPORTING BUGS

       Report bugs to <miek@miek.nl>.

SEE ALSO

       http:/www.miek.nl/projects/rdup/ is the main site of rdup. Also see rdup(1), rdup-tr(1) and rdup-backups(7).

COPYRIGHT

       Copyright (C) 2005-2010 Miek Gieben. This is free software. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A	PARTICULAR
       PURPOSE.

       Licensed under the GPL version 3. See the file LICENSE in the source distribution of rdup.

1.1.11								    13 Dec 2008 							RDUP-UP(1)
All times are GMT -4. The time now is 01:59 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy