Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Speeding up search and replace in a for loop
Top Forums Shell Programming and Scripting Speeding up search and replace in a for loop Post 302657699 by jawsnnn on Monday 18th of June 2012 09:00:32 AM
Old 06-18-2012
A marginal improvement to your original solution may be by removing the echo commands and reading the fields in the read statement itself:

Code:
while IFS=\, read old new
do
  sed -i "s#\"$old\"#\"$new\"#g" file.txt
done < conversion.csv

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Perl: Search for string on line then search and replace text

Hi All, I have a file that I need to be able to find a pattern match on a line, search that line for a text pattern, and replace that text. An example of 4 lines in my file is: 1. MatchText_randomNumberOfText moreData ReplaceMe moreData 2. MatchText_randomNumberOfText moreData moreData... (4 Replies)
Discussion started by: Crypto
4 Replies

2. UNIX for Dummies Questions & Answers

Speeding up a Shell Script (find, grep and a for loop)

Hi all, I'm having some trouble with a shell script that I have put together to search our web pages for links to PDFs. The first thing I did was: ls -R | grep .pdf > /tmp/dave_pdfs.outWhich generates a list of all of the PDFs on the server. For the sake of arguement, say it looks like... (8 Replies)
Discussion started by: Dave Stockdale
8 Replies

3. Shell Programming and Scripting

awk - replace number of string length from search and replace for a serialized array

Hello, I really would appreciate some help with a bash script for some string manipulation on an SQL dump: I'd like to be able to rename "sites/WHATEVER/files" to "sites/SOMETHINGELSE/files" within the sql dump. This is quite easy with sed: sed -e... (1 Reply)
Discussion started by: otrotipo
1 Replies

4. Programming

PERL, search and replace inside foreach loop

Hello All, Im a Hardware engineer, I have written this script to automate my job. I got stuck in the following location. CODE: .. .. ... foreach $key(keys %arr_hash) { my ($loc,$ind,$add) = split /,/, $arr_hash{$key}; &create_verilog($key, $loc, $ind ,$add); } sub create_verilog{... (2 Replies)
Discussion started by: riyasnr007
2 Replies

5. UNIX for Dummies Questions & Answers

Speeding/Optimizing GREP search on CSV files

Hi all, I have problem with searching hundreds of CSV files, the problem is that search is lasting too long (over 5min). Csv files are "," delimited, and have 30 fields each line, but I always grep same 4 fields - so is there a way to grep just those 4 fields to speed-up search. Example:... (11 Replies)
Discussion started by: Whit3H0rse
11 Replies

6. Shell Programming and Scripting

perl search and replace - search in first line and replance in 2nd line

Dear All, i want to search particular string and want to replance next line value. following is the test file. search string is tmp,??? ,10:1 "???" may contain any 3 character it should remain the same and next line replace with ,10:50 tmp,123 --- if match tmp,??? then... (3 Replies)
Discussion started by: arvindng
3 Replies

7. Shell Programming and Scripting

search replace with loop and variable

Hi, could anyone help me with this, tried several times but still not getting it right or having enough grounding to do it outside of javascript: Using awk or sed or bash: need to go through a text file using a for next loop, replacing substrings in the file that consist of a potentially multi... (3 Replies)
Discussion started by: wind
3 Replies

8. Shell Programming and Scripting

Nested search in a file and replace the inner search

Hi Team, I am new to unix, please help me in this. I have a file named properties. The content of the file is : ##Mobile props east.url=https://qa.east.corp.com/prop/end west.url=https://qa.west.corp.com/prop/end south.url=https://qa.south.corp.com/prop/end... (2 Replies)
Discussion started by: tolearn
2 Replies

9. Shell Programming and Scripting

Speeding up substitutions

Hi all, I have a lookup table from which I am looking up values (from col1) and replacing them by corresponding values (from col2) in another file. lookup file a,b c,d So just replace a by b, and replace c by d. mainfile a,fvvgeggsegg,dvs a,fgeggefddddddddddg... (7 Replies)
Discussion started by: senhia83
7 Replies

10. Shell Programming and Scripting

Help speeding up script

This is my first experience writing unix script. I've created the following script. It does what I want it to do, but I need it to be a lot faster. Is there any way to speed it up? cat 'Tax_Provision_Sample.dat' | sort | while read p; do fn=`echo $p|cut -d~ -f2,4,3,8,9`; echo $p >> "$fn.txt";... (20 Replies)
Discussion started by: JohnN6
20 Replies

LEARN ABOUT SUNOS

ibmjtoeuc

euctoibmj(1)							   User Commands						      euctoibmj(1)

NAME

       euctoibmj, ibmjtoeuc - Code conversion between Japanese EUC and IBM-Japanese

SYNOPSIS

       euctoibmj [-t] [-u code] [-U] [filename...]

       ibmjtoeuc [-u code] [-U] [filename...]

AVAILABILITY

       SUNWjfpu

DESCRIPTION

       euctoibmj  converts  the contents of the specified filenames from  ASCII/ Japanese EUC to  EBCDIC/IBM-Japanese. ibmjtoeuc converts the con-
       tents of the specified filenames from  EBCDIC/IBM-Japanese to  ASCII/ Japanese EUC. The both commands write the resultant code  to  stdout.
       If filename is not given, input characters are read from the standard input.

       For Japanese language handling, the euctoibmj/ibmjtoeucj pair of commands provide conversion only between the two code standards. Code con-
       version among Japanese EUC, JIS, and PC kanji are supported by another set of commands, jistoeuc(1) family or iconv(1).

OPTIONS

       -u code	With this option specified, characters in one code set that do not have corresponding characters in the other are  mapped  to  the
		code  given  in four-digit hexadecimal HOST CODE of IBM Japanese (for euctoibmj) or in four-digit JIS Ku-Ten code (for ibmjtoeuc).
		Without this option, such characters are mapped to HOST CODE 4040 (for euctoibmj) or JIS Ku-Ten code 0101 (for ibmjtoeuc).

       -U	The output is not buffered (The default is buffered output).

       -t	With this option specified, euctoibmj translates Half-Size Katakana (Code Set 2) in Japanese EUC to the  corresponding	characters
		in Code Set 1 prior to conversion. Without this option, Code Set 2 characters in Japanese EUC are processed to the illegal charac-
		ter.

ENVIRONMENT VARIABLES

       The environment variables LC_CTYPE and LANG control the character classification throughout these commands. For euctoibmj and ibmjtoeuc	to
       work correctly, one or both of the environment variables must be set to ja or an equivalent locale. On entry to these commands, these envi-
       ronment variables are checked in the following order: LC_CTYPE and LANG. When a valid value is found, remaining environment  variables  for
       character classification are ignored.

FILES

       /usr/lib/jcodetables/ibmj-euc

	   Code conversion table for IBM Japanese.

SEE ALSO

       iconv(1), jistoeuc(1), iconv_ja(5)

DIAGNOSTICS

       unexpected data encountered in input.

	   Illegal character code is found in input file.

BUGS

       The   ASCII/EBCDIC conversion table are taken from the 256 character standard in the  CACM Nov, 1968. The conversion, while less blessed as
       a standard, corresponds better to certain  IBM print train convertions. There is no universal solution.

       The Japanese EUC/IBM Japanese conversion table is based on the  IBM Kanji codebook (4th edition - September 1987),  JIS X 0201, and  JIS  X
       0208-1983.

       If  JIS X 0212 caracter set is specified as input, euctoibmj can not support the conversion correctly.

SunOS 5.10							    10 Jan 2003 						      euctoibmj(1)
All times are GMT -4. The time now is 04:15 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy