Shell Script to replace tokens in multiple files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Shell Script to replace tokens in multiple files
# 1  
Old 10-23-2008
Shell Script to replace tokens in multiple files

I have multiple script files that I have created, that allow me to simply replace a few tokens at the top of the file, and then not have to go through the actual script and change anything. I have about 10 of them, but I was hoping to find a way to write a small script that would allow me to input what value I want those tokens to hold, and then run that script, and it would go through all the scripts I have and replace the tokens with the values I input in to the first script.

Not sure if I explained it very well, but here's an example.

replaceScript.sh -

serverScript1.sh
serverScript2.sh
serverScript3.sh

when I run replaceScript.sh, I'd like to be able to input, say, 5 variables(var1-var2-...var5), then the replaceScript.sh will go through and replace those same variables that have been set in serverScript1-3, with the values I input in to the replaceScript.sh
# 2  
Old 10-23-2008
Yes, we can help you do that, but we need some examples
ie. input and expected output.
control file name control.ctl:
Code:
value=1 value=32
value7=a value7=b

Code:
for file in *.txt
do
      while read old new
      do
          sed "s/$old/$new" "$file" > tmp
          mv tmp "$file"
      done < control.ctl
done

This will not always work, especially when you try to replace what are regex metacharacters.
# 3  
Old 10-23-2008
Okay, I have about, 8 variables(now that I think about it, variable isn't the best name for them. More just tags that I have created in the following format to make it easy to replace them manually, which I am now trying to do with a script). All named in this format


@tag1@
@tag2@
@tag3@
etc
.
.
.
Now the text inside the @..@ tag doesn't follow the naming convention of tag1.2.3.4.... etc, but it was just easier to use that on here.


The file names that hold these tags are as follows:

startTestABC
stopTestABC
deleteABC
rotateABC

A little more information would be that those ABC scripts all set some variable equal to the tag, ie

TEST_NAME="@tag3@"
ANOT_VAR="@tag4@"

That way, when I run the script I can replace all the @...@ tags with what I need, and then the bottom of the script calls everything by the constant variable names.

I was thinking either the script has a header that I could vi it and change it b/c this script will be used over and over with different values for the tags each time. So, either a header section, or even an interactive script where it asks for the values, stores them, then uses those to run the replace command in each script.

Output is obviously the updated ABC script. It doesn't even need to create the new files, all it has to do is modify the existing script, b/c I have my directory which holds these scripts, and then when I use them I always have to move them somewhere else, and then run the replace script from the new directory.
# 4  
Old 10-23-2008
Okay, got a better way to explain it



Code:
##################################
#Header of script, place values in variable names#
##################################
VAR_MAN_NAME="@MAN_NAME@"
VAR_PORT_NUM="@PORT_NUM@"
VAR_TEST_NUM="@TEST_NUM@"
###################################
#---------------Script Logic---------------------#
###################################

.
.
.
.
This section uses all the variable names, and doesn't use any flags
.
.
.
.

I have multiple different scripts that use this same format and have the same variables and tags in each of them. Let's say I have hundreds of different things I need to run this script for. Right now it works fine, I just replace the @...@ tags manually each time I need a new set of scripts. That's the part I want to automate, I need a script where I can input the new tag values only once, and then that script will go through and replace the tags of my 10 scripts that use the same tags.
# 5  
Old 10-24-2008
Looks like sed can do it, but I still haven't figured out the bst way to do it when I have 10 different strings I need to replace(that will be different everytime I run the replace.sh script) in 10 different files.
# 6  
Old 10-24-2008
The replacement part itself ( replaceScript.sh script ) is not very hard. The point is that the *ABC scripts will be running multiple times, and after their first change through the replacement script, there won't be any more tags @..@ left in them ( or am I missing something here ? ), and you need to change those values back again in the future.

Code:
    before 			after
VAR_MAN_NAME="@MAN_NAME@"  VAR_MAN_NAME=other         NO more tags @..@!
VAR_PORT_NUM="@PORT_NUM@"  VAR_PORT_NUM=1001 
VAR_TEST_NUM="@TEST_NUM@"  VAR_TEST_NUM=20

So how are you planning to rechange the new values ( other,1001,20,...) to the old tag values @..@, for the next run ?

Are the variable names VAR_MAN_NAME, VAR_PORT_NUM,..., the same in all *ABC scripts ? If so, you can replace their values based on their unique names in all the files.

Another way, you might use their same record number ( NR ) in all the files, if they are in the same position.

I think you need to provide more details about the unique properties of these variables.
# 7  
Old 10-27-2008
Quote:
Originally Posted by rubin
The replacement part itself ( replaceScript.sh script ) is not very hard. The point is that the *ABC scripts will be running multiple times, and after their first change through the replacement script, there won't be any more tags @..@ left in them ( or am I missing something here ? ), and you need to change those values back again in the future.

Code:
    before 			after
VAR_MAN_NAME="@MAN_NAME@"  VAR_MAN_NAME=other         NO more tags @..@!
VAR_PORT_NUM="@PORT_NUM@"  VAR_PORT_NUM=1001 
VAR_TEST_NUM="@TEST_NUM@"  VAR_TEST_NUM=20

So how are you planning to rechange the new values ( other,1001,20,...) to the old tag values @..@, for the next run ?

Are the variable names VAR_MAN_NAME, VAR_PORT_NUM,..., the same in all *ABC scripts ? If so, you can replace their values based on their unique names in all the files.

Another way, you might use their same record number ( NR ) in all the files, if they are in the same position.

I think you need to provide more details about the unique properties of these variables.
I didn't explain this part very well.

The ABC scripts I have in a separate directory. What I'm going to do is copy all those ABC scripts to a different directory along with the replace.sh script. Then I'll run the replace script. So I'll still have the originals untouched, and then the new ones are what I'll use for that. Then I can do the same thing with the original ABC scripts, whenever I need to replace the @...@ tokens with something else.

Edit:

to add to that, the name of the scripts are always going to be static, and won't change, that's why I just want to copy them to a temp directory, run the script, and then I can do what I need to with them. No need to rename the files or anything like that.

Last edited by cbo0485; 10-27-2008 at 03:03 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Script to replace stings in multiple text files

Good Evening Folks - Happy Friday! I have a need to replace a certain string in all .csv files from "0.00" to "#Missing" in my /app/hyp_app/files directory. Does anyone have a script they use regularly that's rather quick in performance? My files are rather large so I'm looking for a... (5 Replies)
Discussion started by: SIMMS7400
5 Replies

2. Shell Programming and Scripting

Getting error -: more tokens expected in shell script

Hi can someone help me to resolve the error for this condition if ] && ]; then i am passing the values $k and $kkm i am getting the error like "-: more tokens expected" Thanks in Advance (5 Replies)
Discussion started by: makigate
5 Replies

3. Shell Programming and Scripting

Shell script to find and replace contents of files in directory

Hi all This is my first post. Please bear with me with all my mistakes. I started learning shell since couple of days now and this might be quite basic for all, i want to search for files in a directory containing specific string and replace it with new string. The code i wrote is quite bulky... (2 Replies)
Discussion started by: theprogrammer
2 Replies

4. Shell Programming and Scripting

Script to find & replace a multiple lines string across multiple php files and subdirectories

Hey guys. I know pratically 0 about Linux, so could anyone please give me instructions on how to accomplish this ? The distro is RedHat 4.1.2 and i need to find and replace a multiple lines string in several php files across subdirectories. So lets say im at root/dir1/dir2/ , when i execute... (12 Replies)
Discussion started by: spfc_dmt
12 Replies

5. Shell Programming and Scripting

Need tokens in shell script

Hi All, Im writing a shell script in which I want to get the folder names in one folder to be used in for loop. I have used: packsName=$(cd ~/packs/Acquisitions; ls -l| awk '{print $9}') echo $packsName o/p: opt temp user1 user2 ie. Im getting the output as a string. But I want... (3 Replies)
Discussion started by: AB10
3 Replies

6. Shell Programming and Scripting

Strip log file with multiple tokens

I have app log files that need to be cleansed for readability, and my sed skills are not adequate. Each line has a long multi-segment header, which I am trying to remove, example below: : 2010.05.26 20:38:00.640--DatabaseSessionImpl(21447570)--Connection(26209441)--Thread(Thread)--SELECT... (4 Replies)
Discussion started by: migurus
4 Replies

7. Shell Programming and Scripting

Complex Search/Replace Multiple Files Script Needed

I have a rather complicated search and replace I need to do among several dozen files and over a hundred occurrences. My site is written in PHP and throughout the old code, you will find things like die("Operation Aborted due to....."); For my new design skins for the site, I need to get... (2 Replies)
Discussion started by: UCCCC
2 Replies

8. Shell Programming and Scripting

shell script to find and replace string in multiple files

I used the following script cd pathname for y in `ls *`; do sed "s/ABCD/DCBA/g" $y > temp; mv temp $y; done and it worked fine for finding and replacing strings with names etc. in all files of the given path. I'm trying to replace a string which consists of path (location of file) ... (11 Replies)
Discussion started by: pharos467
11 Replies

9. Shell Programming and Scripting

Shell script to parse/split input string and display the tokens

Hi, How do I parse/split lines (strings) read from a file and display the individual tokens in a shell script? Given that the length of individual lines is not constant and number of tokens in each line is also not constant. The input file could be as below: ... (3 Replies)
Discussion started by: yajaykumar
3 Replies

10. Shell Programming and Scripting

Find and Replace in multiple files (Shell script)

hi guys, Suppose you have 100 files in a folder and you want to replace all occurances of a word say "ABCD" in those files with "DCBA", how would you do it ??? jatin (13 Replies)
Discussion started by: jatins_s
13 Replies
Login or Register to Ask a Question