Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Issue with search and replacing multiple items in multiple files
Top Forums UNIX for Beginners Questions & Answers Issue with search and replacing multiple items in multiple files Post 303039118 by ncwxpanther on Monday 23rd of September 2019 01:42:34 PM
Old 09-23-2019
Issue with search and replacing multiple items in multiple files
Im having an issue when trying to replace the first column with a new set of values in multiple files. The results from the following code only replaces the files with the last set of values in val.txt. I want to replace all the files with all the values.

Code:
for date in {1..31}
do
for val in `cat val.txt`
do
csv="file/location/csv"
fid=$(awk -F"," '$2 == "'$val'" { print $3 }' $csv)
awk '$1=='${val}'{$1='${fid}'}{print}' data-${date}.txt > data-${date}-new.txt
done
done

For instance:
Code:
val.txt
01
02
03
04

csv
Code:
abc,01,01
abc,50,02
abc,02,04
abc,03,05
abc,04,06

data-1.txt
Code:
01  001  1.062
01  003  0.216
01  005  1.89
01  007  0.828
02  001  1.44
02  003  -3.492
02  005  -4.536
03  147  -0.144
03  149  0.216
04  001  -0.144
04  003  -1.62

The result I was hoping for was this in all of the files:

data-1-new.txt
Code:
01  001  1.062
01  003  0.216
01  005  1.89
01  007  0.828
04  001  1.44
04  003  -3.492
04  005  -4.536
05  147  -0.144
05  149  0.216
06  001  -0.144
06  003  -1.62

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Multiple search in multiple files

Hello, I would like to perform a search of several different strings in different files. I have the ouput of a unix command X which is for instance: aaa bbb ccc and I would like to look for each of these three strings into several files: file1 file2 etc. I have come up with a solution... (2 Replies)
Discussion started by: maxvirrozeito
2 Replies

2. Shell Programming and Scripting

Multiple search string in multiple files using awk

Hi, filenames: contains name of list of files to search in. placelist contains the names of places to be searched in all files in "filenames" for i in $(<filenames) do egrep -f placelist $i if ] then echo $i fi done >> outputfile Output i am getting: (0 Replies)
Discussion started by: pinnacle
0 Replies

3. Shell Programming and Scripting

Replacing string in multiple files

Hi, I need to replace the string 'abcd' with 'xyz' in a file sample.xml This sample.xml is also present in the subdirectories of the current directory. Eg, If I am in /user/home/ the sample.xml if present in /user/home/ /user/home/folder1/ /user/home/folder2/... (3 Replies)
Discussion started by: arulanandsp
3 Replies

4. Shell Programming and Scripting

Replacing text from multiple files at multiple location

Hi, I have many files scattered in all different folders. I want to replace the text within all the files using a single command ( awk, sed...) Is it possible? example find all the files in which there is text "memory" and replace it with "branded_memories". the files can be at the... (2 Replies)
Discussion started by: rudoraj
2 Replies

5. UNIX for Dummies Questions & Answers

best method of replacing multiple strings in multiple files - sed or awk? most simple preferred :)

Hi guys, say I have a few files in a directory (58 text files or somthing) each one contains mulitple strings that I wish to replace with other strings so in these 58 files I'm looking for say the following strings: JAM (replace with BUTTER) BREAD (replace with CRACKER) SCOOP (replace... (19 Replies)
Discussion started by: rich@ardz
19 Replies

6. Shell Programming and Scripting

Search multiple patterns in multiple files

Hi, I have to write one script that has to search a list of numbers in certain zipped files. For eg. one file file1.txt contains the numbers. File1.txt contains 5,00,000 numbers and I have to search each number in zipped files(The number of zipped files are around 1000 each file is 5 MB) I have... (10 Replies)
Discussion started by: vsachan
10 Replies

7. Shell Programming and Scripting

Search & Replace: Multiple Strings / Multiple Files

I have a list of files all over a file system e.g. /home/1/foo/bar.x /www/sites/moose/foo.txtI'm looking for strings in these files and want to replace each occurrence with a replacement string, e.g. if I find: '#@!^\&@ in any of the files I want to replace it with: 655#@11, etc. There... (2 Replies)
Discussion started by: spacegoose
2 Replies

8. Shell Programming and Scripting

Compare multiple files, and extract items that are common to ALL files only

I have this code awk 'NR==FNR{a=$1;next} a' file1 file2 which does what I need it to do, but for only two files. I want to make it so that I can have multiple files (for example 30) and the code will return only the items that are in every single one of those files and ignore the ones... (7 Replies)
Discussion started by: castrojc
7 Replies

9. Shell Programming and Scripting

Replacing old TNS entries with New one in multiple files

I have requirement to replace old TNS entries with New one in multiple files. one file may contain more then one occurrence of tns. Example: Below is the one of occurrence in a current file(s). i am interested to replace only red part. <connection-pool name="Google_APP_CP"... (4 Replies)
Discussion started by: KDDubai333
4 Replies

10. Shell Programming and Scripting

sed parser behaving strange on replacing multiple words in multiple files

I have 4000 files like $cat clus_grp_seq10_g.phy 18 1002 anig_OJJ65951_1 ATGGTTTCGCAGCGTGATAGAGAATTGTTTAGGGATGATATTCGCTCGCGAGGAACGAAGCTCAATGCTGCCGAGCGCGAGAGTCTGCTAAGGCCATATCTGCCAGATCCGTCTGACCTTCCACGCAGGCCACTTCAGCGGCGCAAGAAGGTTCCTCG aver_OOF92921_1 ... (1 Reply)
Discussion started by: sammy777888
1 Replies

LEARN ABOUT DEBIAN

algorithm::checkdigits

CheckDigits(3pm)					User Contributed Perl Documentation					  CheckDigits(3pm)

NAME

       Algorithm::CheckDigits - Perl extension to generate and test check digits

SYNOPSIS

	 perl -MAlgorithm::CheckDigits -e Algorithm::CheckDigits::print_methods

       or

	 use Algorithm::CheckDigits;

	 @ml = Algorithm::CheckDigits->method_list();

	 $isbn = CheckDigits('ISBN');

	 if ($isbn->is_valid('3-930673-48-7')) {
	       # do something
	 }

	 $cn = $isbn->complete('3-930673-48');	   # $cn = '3-930673-48-7'

	 $cd = $isbn->checkdigit('3-930673-48-7'); # $cd = '7'

	 $bn = $isbn->basenumber('3-930673-48-7'); # $bn = '3-930673-48'

ABSTRACT

       This module provides a number of methods to test and generate check digits. For more information have a look at the web site
       www.pruefziffernberechnung.de (german).

SUBROUTINES
/METHODS
   CheckDigits($method)
       Returns an object of an appropriate Algorithm::CheckDigits class for the given algorithm.

       Dies with an error message if called with an unknown algorithm.

       See below for the available algorithms. Every object understands the following methods:

       is_valid($number)
	   Returns true or false if $number contains/contains no valid check digit.

       complete($number)
	   Returns a string representation of $number completed with the appropriate check digit.

       checkdigit($number)
	   Extracts the check digit from $number if $number contains a valid check digit.

       basenumber($number)
	   Extracts the basenumber from $number if $number contains a valid check digit.

   Algorithm::CheckDigits::method_list()
       Returns a list of known methods for check digit computation.

   Algorithm::CheckDigits::print_methods()
       Returns a list of known methods for check digit computation.

       You may use the following to find out which methods your version of Algorithm::CheckDigits provides and where to look for further
       information.

	perl -MAlgorithm::CheckDigits -e Algorithm::CheckDigits::print_methods

   CHECK SUM METHODS
       At the moment these methods to compute check digits are provided: (vatrn - VAT Return Number, in german ustid UmsatzSTeuer-ID)

       m07-001
	   See Algorithm::CheckDigits::M07_001.

       euronote, m09-001
	   European bank notes, see Algorithm::CheckDigits::M09_001.

       amex, bahncard, diners, discover, enroute, eurocard, happydigits, isin, jcb, klubkarstadt, mastercard, miles&more, visa, m09-001, imei,
       imeisv
	   See Algorithm::CheckDigits::M10_001.

       siren, siret, m10-002
	   See Algorithm::CheckDigits::M10_002.

       ismn, m10-003
	   See Algorithm::CheckDigits::M10_003.

       ean, iln, isbn13, nve, 2aus5, m10-004
	   See Algorithm::CheckDigits::M10_004.

       identcode_dp, leitcode_dp, m10-005
	   See Algorithm::CheckDigits::M10_005.

       rentenversicherung, m10-006
	   See Algorithm::CheckDigits::M10_006.

       sedol, m10-008
	   See Algorithm::CheckDigits::M10_008.

       betriebsnummer, m10-009
	   See Algorithm::CheckDigits::M10_009.

       postscheckkonti, m10-010
	   See Algorithm::CheckDigits::M10_010.

       ups, m10-011
	   See Algorithm::CheckDigits::M10_011.

       hkid, isbn, issn, nhs_gb, ustid_pt, vat_sl, wagonnr_br, m11-001
	   See Algorithm::CheckDigits::M11_001.

       pzn, m11-002
	   See Algorithm::CheckDigits::M11_002.

       pkz, m11-003
	   See Algorithm::CheckDigits::M11_003.

       cpf, titulo_eleitor, m11-004
	   See Algorithm::CheckDigits::M11_004.

       ccc_es, m11-006
	   See Algorithm::CheckDigits::M11_006.

       ustid_fi, vatrn_fi, m11-007
	   See Algorithm::CheckDigits::M11_007.

       ustid_dk, vatrn_dk, m11-008
	   See Algorithm::CheckDigits::M11_008.

       nric_sg, m11-009
	   See Algorithm::CheckDigits::M11_009.

       ahv_ch, m11-010
	   See Algorithm::CheckDigits::M11_010.

       ustid_nl, vatrn_nl, m11-011
	   See Algorithm::CheckDigits::M11_011.

       bwpk_de, m11-012
	   See Algorithm::CheckDigits::M11_012.

       ustid_gr, vatrn_gr, m11-013
	   See Algorithm::CheckDigits::M11_013.

       esr5_ch, m11-015
	   See Algorithm::CheckDigits::M11_015.

       ustid_pl, vatrn_pl, m11-016
	   See Algorithm::CheckDigits::M11_016.

       ecno, ec-no, einecs, elincs, m11-017
	   See Algorithm::CheckDigits::M11_017.

       isan, m16-001
	   See Algorithm::CheckDigits::M16_001.

       dni_es, m23-001
	   See Algorithm::CheckDigits::M23_001.

       ustid_ie, vatrn_ie, m23-002
	   See Algorithm::CheckDigits::M23_002.

       code_39, m43-001
	   See Algorithm::CheckDigits::M43_001.

       ustid_lu, vatrn_lu, m89-001
	   See Algorithm::CheckDigits::M89_001.

       ustid_be, vatrn_be, m97-001
	   See Algorithm::CheckDigits::M97_001.

       iban, m97-002
	   See Algorithm::CheckDigits::M97_002.

       upc, mbase-001
	   See Algorithm::CheckDigits::MBase_001.

       blutbeutel, bzue_de, ustid_de, vatrn_de, mbase-002
	   See Algorithm::CheckDigits::MBase_002.

       sici, mbase-003
	   See Algorithm::CheckDigits::MBase_003.

       pa_de, mxx-001
	   See Algorithm::CheckDigits::MXX_001.

       cas, mxx-002
	   See Algorithm::CheckDigits::MXX_002.

       dem, mxx-003
	   Old german bank notes (DEM), see Algorithm::CheckDigits::MXX_003.

       ustid_at, vatrn_at, mxx-004
	   See Algorithm::CheckDigits::MXX_004.

       esr9_ch, mxx-005
	   See Algorithm::CheckDigits::MXX_005.

       verhoeff, mxx-006
	   Verhoeff scheme, see Algorithm::CheckDigits::MXX_006 or Algorithm::Verhoeff

   EXPORT
       None by default.

SEE ALSO

       perl, www.pruefziffernberechnung.de.

AUTHOR

       Mathias Weidner, <mathias@weidner.in-bad-schmiedeberg.de>

THANKS

       Petri Oksanen made me aware that CheckDigits('IMEI') would invoke no test at all since there was no entry for this in the methods hash.

COPYRIGHT AND LICENSE

       Copyright 2004-2006 by Mathias Weidner

       This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

perl v5.10.0							    2008-06-06							  CheckDigits(3pm)
All times are GMT -4. The time now is 01:44 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy