Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Replace a multi-line strings or numbers

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Replace a multi-line strings or numbers
# 8  
Old 05-21-2013
rveri

it wont work !

Code:
 
# v=45654;perl -0777  -pe 's/$ENV{v}\n199\n225/$ENV{v}\n258/igs' file

---------- Post updated at 08:14 PM ---------- Previous update was at 07:45 PM ----------

Quote:
Originally Posted by Yoda
So I assume that you are going to define starting sequence in a variable.

In that case you can pass whatever variable to awk, assign it and use it.

You can code something like:
Code:
SEQ=XXX
 
awk -v S="$SEQ" '
        {
                A[++c] = $1
        }
        END {
                for ( i = 1; i <= c; i++ )
                {
                        if ( A[i] == S && A[i+1] == 199 && A[i+2] == 225 )
                        {
                                A[i+1] = 258
                                A[i+2] = 0
                        }
                        if ( A[i] )
                                print A[i]
                }
        }
' file

I used shell variable: SEQ, replace value XXX with the number of your choice. I hope this helps.

Yoda

for small files awk working with no problem
but, with large files the awk shows this error


Code:
 
awk: cmd. line:3: (FILENAME=a.txt FNR=18498251) fatal: more_nodes: nextfree: can 't allocate 4000 bytes of memory (Cannot allocate memory)

and this error too printed in Cygwin terminal

Code:
 
line 3: 7488 Aborted (core dumped) awk -v S="$SEQ" '
{
A[++c] = $1
}
END {
for ( i = 1; i <= c; i++ )
{
if ( A[i] == S && A[i+1] == 199 && A[i+2] == 225 )
{
A[i+1] = 258
A[i+2] = 0
}
if ( A[i] )
print A[i]
　
}
}
' ascii.txt >pre.txt

any help about it?

Thanks a lot



# 9  
Old 05-21-2013
How about this awk code?
Code:
SEQ=45654

awk -v S="$SEQ" '
        $0 == S {
                V = $0
                getline
                if ( $0 == 199 )
                {
                        getline
                        if ( $0 == 225 )
                        {
                                print V RS "258"
                                next
                        }
                        else
                        {
                                print V RS "199" RS $0
                                next
                        }
                }
                else
                {
                        print V RS $0
                        next
                }
        }
        $0 != S {
                print $0
        }
' file

This User Gave Thanks to Yoda For This Post:
khaled79
# 10  
Old 05-21-2013
Dear Yoda

I will test it now for large files I have

Thanks

---------- Post updated at 09:25 PM ---------- Previous update was at 08:58 PM ----------

Thanks Yoda

it works well for large and small files as well

Thank you very much.

could you please tell me what is the different between two codes?

Khaled
# 11  
Old 05-21-2013
Quote:
Originally Posted by khaled79
could you please tell me what is the different between two codes?
The first awk program that I posted loads all the records in your file into an Indexed Array A[++c] = $1 and in the end it performs the required operation.

This caused the program to throw Cannot allocate memory error for large files.

But in the second awk program, entire records are not loaded into any variable or array but instead checking record by record to perform the required operation.

Hence it is not a memory intensive program and works for large files.
This User Gave Thanks to Yoda For This Post:
khaled79
# 12  
Old 05-22-2013
Yoda

can I make it search for any of tow or more numbers if found then replaced it like for example

Code:
 
SEQ=45654 | 234567  |57899 

awk -v S="$SEQ" '
        $0 == S {
                V = $0
                getline
                if ( $0 == 199 )
                {
                        getline
                        if ( $0 == 225 )
                        {
                                print V RS "258"
                                next
                        }
                        else
                        {
                                print V RS "199" RS $0
                                next
                        }
                }
                else
                {
                        print V RS $0
                        next
                }
        }
        $0 != S {
                print $0
        }
' file


Thanks a lot

Khaled
# 13  
Old 05-22-2013
Quote:
Originally Posted by khaled79
can I make it search for any of tow or more numbers if found then replaced it
Yes you can. For implementing this change use regular expression comparison operators ~ and !~ instead:
Code:
SEQ="45654|234567|57899"

awk -v S="$SEQ" '
        $0 ~ S {
                V = $0
                getline
                if ( $0 == 199 )
                {
                        getline
                        if ( $0 == 225 )
                        {
                                print V RS 258
                                next
                        }
                        else
                        {
                                print V RS "199" RS $0
                                next
                        }
                }
                else
                {
                        print V RS $0
                        next
                }
        }
        $0 !~ S {
                print $0
                F = 0
        }
' file

This User Gave Thanks to Yoda For This Post:
khaled79
# 14  
Old 05-24-2013
Yoda

I have used this code to print the number that comes before and after specific character

Code:
 
SEQ=200
awk -v S="$SEQ" '
        {
                A[++c] = $1
        }
        END {
                for ( i = 1; i <= c; i++ )
                {
                        if ( A[i] == S )
                        {        
              print " the letter is " A[i]   
                                print " followed by " A[i+1] 
                                print " comes after " A[i-1]  
                        }
                        
        
                               
                }
        }
' file


result was like the following

Code:
 
the letter is 200
 followed by 202
 comes after 211
 the letter is 200
 followed by 223
 comes after 212
 the letter is 200
 followed by 202
 comes after 211

I need it to print counter of times that happened if it repeated rather than print it many time so the result should be something like this

Code:
 
2 times 
the letter is 200
 followed by 202
 comes after 211
 
1 times 
the letter is 200
 followed by 223
 comes after 212

how I can do it?

Thanks a lot
Khaled
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Multi line regex for search and replace

I have text file like below: a.txt Server=abc Run=1 Time=120.123 Tables=10 Sessions=16 Time=380.123 Version=1.1 Jobs=5 Server=abc Run=2 Time=160.123 Tables=15 Sessions=16 Time=400.258 Version=2.0 (1 Reply)
Discussion started by: sol_nov
1 Replies

2. Homework & Coursework Questions

[solved]Perl: Printing line numbers to matched strings and hashes.

Florida State University, Tallahassee, FL, USA, Dr. Whalley, COP4342 Unix Tools. This program takes much of my previous assignment but adds the functionality of printing the concatenated line numbers found within the input. Sample input from <> operator: Hello World This is hello a sample... (2 Replies)
Discussion started by: D2K
2 Replies

3. Shell Programming and Scripting

sed to replace a line with multi lines from a var

I am trying to find a line in a file ("Replace_Flag") and replace it with a variable which hold a multi lined file. myVar=`cat myfile` sed -e 's/Replace_Flag/'$myVar'/' /pathto/test.file myfile: cat dog boy girl mouse house test.file: football hockey Replace_Flag baseball ... (4 Replies)
Discussion started by: bblondin
4 Replies

4. Shell Programming and Scripting

SED - insert space at the beginning of line and multi replace command

hi I am trying to use SED to replace the line matching a pattern using the command sed 'pattern c\ new line ' <file1 >file 2 I got two questions 1. how do I insert a blank space at the beginning of new line? 2. how do I use this command to execute multiple command using the -e... (5 Replies)
Discussion started by: piynik
5 Replies

5. Shell Programming and Scripting

Multi-line filtering based on multi-line pattern in a file

I have a file with data records separated by multiple equals signs, as below. ========== RECORD 1 ========== RECORD 2 DATA LINE ========== RECORD 3 ========== RECORD 4 DATA LINE ========== RECORD 5 DATA LINE ========== I need to filter out all data from this file where the... (2 Replies)
Discussion started by: Finja
2 Replies

6. Shell Programming and Scripting

Search for a multi-line strings in a file

Hello I need to search for a mult-line strngs(with spaces in between and qoted) in a file1 and replace that text with Fixed string globally in file1. The strng to search for is in file2. The file is big with some 20K records. so speed and effciency is required file1: (where srch & rplc will... (7 Replies)
Discussion started by: Hiano
7 Replies

7. Shell Programming and Scripting

Global search and replace multi line file

Hello I need to search for a mult-line strngs(with spaces in between and qoted) in a file1 and replace that text with Fixed string globally in file1. The strng to search for is in file2. The file is big with some 20K records. so speed and effciency is required file1: (where srch & rplc... (0 Replies)
Discussion started by: Hiano
0 Replies

8. Shell Programming and Scripting

Multi-Line Search and Replace

There appears to be several threads that touch on what I'm trying to do, but nothing quite generic enough. What I need to do is search through many (poorly coded) HTML files and make changes. The catch is that my search string may be on one line or may be on several lines. For example there... (5 Replies)
Discussion started by: bisbell
5 Replies

9. Shell Programming and Scripting

multi line multirecord find and replace

Hello I am looking to have a script that performs some tasks for find and replace and inserts a line as well. I have done some programming 10 years ago, so it is causing me a little grief. File consists of 2500 records. I will show you a sample consisting of two records below and what needs... (3 Replies)
Discussion started by: cdc01
3 Replies

10. Shell Programming and Scripting

Search and replace multi-line text in files

Hello I need to search for a mult-line text in a file exfile1 and replace that text with another text. The text to search for is in exfile2 and the replacement text is in exfile3. I work with kornshell under AIX and need to do this with a lot of files. (the file type is postscript and they need... (10 Replies)
Discussion started by: marz
10 Replies
Login or Register to Ask a Question