How to extract string between two specified characters and end of line?


 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers How to extract string between two specified characters and end of line?
# 8  
Old 03-03-2020
The below code is throwing error too

Code:
#!/bin/bash
while read line
do
key= $(sed 's/\(.*\)\=.*/\1/' $line)
value=$(sed 's/.*\=//g' $line)
sed "s/$key/$value/g" test.txt
done <  bbb.txt

Moderator's Comments:
Mod Comment
Please use code tags when posting data and code samples!

Last edited by vgersh99; 03-03-2020 at 04:28 PM.. Reason: code tags, please!
# 9  
Old 03-03-2020
Hi
Code:
key= $(sed 's/\(.*\)\=.*/\1/' $line)

There should be no space after the equal sign
Code:
key=$(sed 's/\(.*\)\=.*/\1/' $line)

put error messages in the post too
# 10  
Old 03-03-2020
Furthermore, sed gets the $line as a filename.
If it should get it as input then do
Code:
echo "$line" | sed ...

Some shells (bash, zsh) take as well
Code:
sed ... <<< "$line"

This User Gave Thanks to MadeInGermany For This Post:
# 11  
Old 03-04-2020
extract string between two specified characters and end of line

You can leave the $start or $end arguments empty and it will use the start or end of the string.

Code:
echo get_string_between("Hello my name is bob", "my", ""); //output: " name is bob"

private function get_string_between($string, $start, $end){ // Get
    if($start != ''){ //If $start is empty, use start of the string
        $string = ' ' . $string;
        $ini = strpos($string, $start);
        if ($ini == 0) return '';
        $ini += strlen($start);
    }
    else{
        $ini = 0;
    }

    if ($end == '') { //If $end is blank, use end of string
        return substr($string, $ini);
    }
    else{
        $len = strpos($string, $end, $ini) - $ini; //Work out length of string
        return substr($string, $ini, $len);
    }
}


Last edited by vgersh99; 03-04-2020 at 11:29 AM.. Reason: fix code tags
# 12  
Old 03-04-2020
Thanks for the suggestion. that worked. But now the last part of replacing it in a different file is not working. I tried the below two codes.

Code:
#!/bin/bash
while read line
do
key= echo "$line" | sed 's/\(.*\)\=.*/\1/' 
value= echo "$line" | sed 's/.*\=//'
sed 's/$key/$value/g' test.txt
done < bbb.tx

Code:
#!/bin/bash
input=/home/wip4599/test.txt
while read line
do
key= echo "$line" | sed 's/\(.*\)\=.*/\1/' 
value= echo "$line" | sed 's/.*\=//'
sed 's/$key/$value/g' $input
done < bbb.txt

--- Post updated at 08:04 PM ---

@MadeInGermany

--- Post updated at 08:42 PM ---

used the below format and it worked

Code:
key=$(echo "$line" | sed 's/\(.*\)\=.*/\1/')


Last edited by Scrutinizer; 03-04-2020 at 03:54 PM.. Reason: code tags
# 13  
Old 03-04-2020
Yes that is the correct format.
And it should be sed "s/$key/$value/g" with normal (double-)quotes, so the shell can expand $key and $value.

A more efficient way is to let the read command spllit into fields and directly assign them to distinct variables.
We can set the "input field separator" IFS to = (by default it is whitespace). By prefixing IFS="=" we set this environment variable only for the following read command.
Code:
input=/home/wip4599/test.txt
while IFS="=" read key value
do
  sed "s/$key/$value/g" $input
done < bbb.txt

# 14  
Old 03-05-2020
both the codes are replacing all the matching pattern. If I have $$Date and $$Date_1 it is replacing like 20200305 and 20200305_1 but I have different values for $$Date_1. How to skip that. if I try this echo statement its working but not when im using variables key and value.

echo $(sed -e 's/^$$Date$/20200305/g' test.txt)
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grep a particular string from column eliminating characters at the end.

Hi, So basically I have this file containing query output in seperated columns. In particular column I have the below strings: news news-prio I am trying to grep the string news without listing news-prio aswell. I tried grep "$MSG_TYPE" , grep -w "$MSG_TYPE" , grep... (4 Replies)
Discussion started by: nms
4 Replies

2. Red Hat

How to add a new string at the end of line by searching a string on the same line?

Hi, I have a file which is an extract of jil codes of all autosys jobs in our server. Sample jil code: ************************** permission:gx,wx date_conditions:yes days_of_week:all start_times:"05:00" condition: notrunning(appDev#box#ProductLoad)... (1 Reply)
Discussion started by: raghavendra
1 Replies

3. Shell Programming and Scripting

How to extract text from STRING to end of line?

Hi I have a very large data file with several hundred columns and millions of lines. The important data is in the last set of columns with variable numbers of tab delimited fields in front of it on each line. Im currently trying sed to get the data out - I want anything beetween :RES and... (4 Replies)
Discussion started by: Manchesterpaul
4 Replies

4. UNIX for Dummies Questions & Answers

How to specify beginning-of-line/end-of-line characters inside a regex range

How can I specify special meaning characters like ^ or $ inside a regex range. e.g Suppose I want to search for a string that either starts with '|' character or begins with start-of-line character. I tried the following but it does not work: sed 's/\(\)/<do something here>/g' file1 ... (3 Replies)
Discussion started by: jawsnnn
3 Replies

5. UNIX for Dummies Questions & Answers

Removing characters from end of string

Hello, I have records like below that I want to remove any five characters from the end of the string before the double quotes unless it is only an asterik. 3919,5020 ,04/17/2012,0000000000006601.43,,0000000000000000.00,, 132, 251219,"*" 1668,0125 ... (2 Replies)
Discussion started by: jyoung
2 Replies

6. Shell Programming and Scripting

adding characters end of line where line begins with..

Hi all, using VI, can anyone tell me how to add some characters onto the end of a line where the line begins with certain charactars eg a,b,c,......., r,s,t,........, a,b,c,......., all lines in the above example starting with a,b,c, I want to add an x at the end of the line so the... (6 Replies)
Discussion started by: satnamx
6 Replies

7. Shell Programming and Scripting

Get the 1st 99 characters and add new line feed at the end of the line

I have a file with varying record length in it. I need to reformat this file so that each line will have a length of 100 characters (99 characters + the line feed). AU * A01 EXPENSE 6990370000 CWF SUBC TRAVEL & MISC MY * A02 RESALE 6990788000 Y... (3 Replies)
Discussion started by: udelalv
3 Replies

8. AIX

CUT command - cutting characters from end of string

Hello, I need to delete the final few characters from a parameter leaving just the first few. However, the characters which need to remain will not always be a string of the same length. For instance, the parameter will be passed as BN_HSBC_NTRS/hub_mth_ifce.sf. I only need the bit before the... (2 Replies)
Discussion started by: JWilliams
2 Replies

9. Shell Programming and Scripting

Extract digits at end of string

I have a string like xxxxxx44. What's the best way to extract the digits (one or more) in a ksh script? Thanks (6 Replies)
Discussion started by: offirc
6 Replies

10. Shell Programming and Scripting

Removing characters from end of $string

I am writing a script to search PCL output and append more PCL data to the end accordingly. I need to remove the last 88 bytes from the string. I have searched for a few hours now and am coming up with nothing. I can't use head or tail because the PCL output is all on one line. awk crashes on... (3 Replies)
Discussion started by: craig2k
3 Replies
Login or Register to Ask a Question