Sed/awk/perl substitution with multiple lines Post: 302928998

Sponsored Content

Top Forums Shell Programming and Scripting Sed/awk/perl substitution with multiple lines Post 302928998 by Chubler_XL on Tuesday 16th of December 2014 07:08:22 PM

12-16-2014

Moderator

Do these tags (like <!HTMLPLACE>) always appear in the template file on lines by themselves like in you example or can you have stuff like this:

Code:

Re: <!REFNUMPLACE>

Dear <!FIRSTNAMEPLACE>,

Is this format acceptable for the snippets.txt file:

Code:

<!REFNUMSTART>239048390248<!REFNUMEND>
<!HTMLSTART>--Company-Mail=_566WSE37-113E-4C71-ADE1-31SD22E1081D
Content-Transfer-Encoding: base64
Content-Disposition: inline;
	filename=pxl.png
Content-Type: image/png;
	name="pxl.png"
Content-Id: <6ASS72B8-SSA9-4C6B-SAF-77F5851CSS36@company.com>
<!HTMLEND>

---------- Post updated at 10:08 AM ---------- Previous update was at 09:20 AM ----------

See how this suits you:

Code:

awk '
FNR==NR {
   if (/^![A-Z]+START>/) {
      i=index($0, ">")
      tag=substr($0,2,i-7)
      $0=substr($0,i+1)
   }
   if( $0 ~ "^!" tag "END>") { tag="" }
   if(length(tag)) data[tag]=data[tag]"<"$0
   next
}
/<![A-Z]+PLACE>/ {
  V=""
  while(match($0, "<![A-Z]+PLACE>")) {
     tag=substr($0, RSTART+2, RLENGTH-8)
     if(tag in data) {
         V=V substr($0, 1, RSTART-1)
         $0=substr(data[tag],2) substr($0, RSTART+RLENGTH)
     } else {
         V=V substr($0, 1, RSTART+RLENGTH)
         $0=substr($0, RSTART+RLENGTH)
     }
  }
  $0=V$0
} 1' RS='<' snippets.txt RS='\n' emailTemplate.eml

snippets.txt:

Code:

<!ENCODESTART>base64<!ENCODEEND>
<!FILESTART>pxl.png<!FILEEND>
<!DISPSTART>inline<!DISPEND>
<!HTMLSTART>
--Company-Mail=_566WSE37-113E-4C71-ADE1-31SD22E1081D
Content-Transfer-Encoding: <!ENCODEPLACE>
Content-Disposition: <!DISPPLACE>;
    filename=<!FILEPLACE>
Content-Type: image/png;
    name="<!FILEPLACE>"
Content-Id: <6ASS72B8-SSA9-4C6B-SAF-77F5851CSS36@company.com>

iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAACXBIWXMAAAsTAAALEwEAmpwYAAAK
T2lDQ1BQaG90b3Nob3AgSUNDIHByb2ZpbGUAAHjanVNnVFPpFj333vRCS4iAlEtvUhUIIFJCi4AU
kSYqIQkQSoghodkVUcERRUUEG8igiAOOjoCMFVEsDIoK2AfkIaKOg6OIisr74Xuja9a89+bN/rXX
Pues852zzwfACAyWSDNRNYAMqUIeEeCDx8TG4eQuQIEKJHAAEAizZCFz/SMBAPh+PDwrIsAHvgAB
<!HTMLEND>

emailTemplate.eml:

Code:

<!PICTUREPLACE>
<!HTMLPLACE>
<!FOOTERPLACE>

Output:

Code:

<!PICTUREPLACE>

--Company-Mail=_566WSE37-113E-4C71-ADE1-31SD22E1081D
Content-Transfer-Encoding: base64
Content-Disposition: inline;
    filename=pxl.png
Content-Type: image/png;
    name="pxl.png"
Content-Id: <6ASS72B8-SSA9-4C6B-SAF-77F5851CSS36@company.com>

iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAACXBIWXMAAAsTAAALEwEAmpwYAAAK
T2lDQ1BQaG90b3Nob3AgSUNDIHByb2ZpbGUAAHjanVNnVFPpFj333vRCS4iAlEtvUhUIIFJCi4AU
kSYqIQkQSoghodkVUcERRUUEG8igiAOOjoCMFVEsDIoK2AfkIaKOg6OIisr74Xuja9a89+bN/rXX
Pues852zzwfACAyWSDNRNYAMqUIeEeCDx8TG4eQuQIEKJHAAEAizZCFz/SMBAPh+PDwrIsAHvgAB

<!FOOTERPLACE>

Chubler_XL

View Public Profile for Chubler_XL

Find all posts by Chubler_XL

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sed substitution and multiple lines

I have a file names 'log.txt' that looks something like this: #This is a comment /sbin/iptables -A INPUT -p tcp -s ip.of.a machine --destination-port 21 -j ACCEPT #This is the comment to read# /sbin/iptables -A INPUT -p tcp -s ip.of.a.machine --destination-port 21 -j ACCEPT I would like...

2. Shell Programming and Scripting

sed/awk to insert multiple lines before pattern

I'm attempting to insert multiple lines before a line matching a given search pattern. These lines are generated in a separate function and can either be piped in as stdout or read from a temporary file. I've been able to insert the lines from a file after the pattern using: sed -i '/pattern/...

3. Shell Programming and Scripting

Command to remove duplicate lines with perl,sed,awk

Input: hello hello hello hello monkey donkey hello hello drink dance drink Output should be: hello hello monkey donkey drink dance

4. Shell Programming and Scripting

Sed or Awk for lines between two strings multiple times and keep the last one

Hi, I am trying to get lines between the last occurrences of two patterns. I have files that have several occurrences of “Standard” and “Visual”. I will like to get the lines between “Standard” and “Visual” but I only want to retain only the last one e.g. Standard Some words Some words Some...

5. Shell Programming and Scripting

Print lines between two strings multiple occurencies (with sed, awk, or grep)

Hello, I can extract lines in a file, between two strings but only one time. If there are multiple occurencies, my command show only one block. Example, monfichier.txt contains : debut_sect texte L1 texte L2 texte L3 texte L4 fin_sect donnees inutiles 1 donnees inutiles 2 ...

6. Shell Programming and Scripting

Sed/awk/perl command to replace pattern in multiple lines

Hi I know sed and awk has options to give range of line numbers, but I need to replace pattern in specific lines Something like sed -e '1s,14s,26s/pattern/new pattern/' file name Can somebody help me in this.... I am fine with see/awk/perl Thank you in advance

7. Shell Programming and Scripting

Using sed, awk or perl to remove substring of all lines except the first

Greetings All, I would like to find all occurences of a pattern and delete a substring from the all matching lines EXCEPT the first. For example: 1234::group:user1,user2,user3,blah1,blah2,blah3 2222::othergroup:user9,user8 4444::othergroup2:user3,blah,blah,user1 1234::group3:user5,user1 ...

8. Shell Programming and Scripting

Awk/sed : help on:Filtering multiple lines to one:

Experts Good day, I want to filter multiple lines of same error of same day , to only 1 error of each day, the first line from the log. Here is the file: May 26 11:29:19 cmihpx02 vmunix: NFS write failed for server cmiauxe1: error 5 (RPC: Timed out) May 26 11:29:19 cmihpx02 vmunix: NFS...

9. Shell Programming and Scripting

Process alternate lines in awk/sed/perl

hi.. i have a fasta file with the following format >sequence1 CCGGTTTTCGATTTGGTTTGACT >sequence2 AAAGTGCCGCCAGGTTTTGAGTGT >sequence3 AGTGCCGCAGAGTTTGTAGTGT Now, i want to read alternate line and add "GGGGGGGGGGG" to end of every sequence Desired output: >sequence1...

10. UNIX for Beginners Questions & Answers

How to find=grep or maybe sed/awk for multiple lines of text?

Hi, I am running the following: PASS="username/password" sqlplus -s << EOF | grep -v "^$" $PASS set feedback off set heading off set termout off select name from v\$database ; exit EOF Which gives ERROR: ORA-28002: the password will expire within 5 days PSMP1

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sed substitution and multiple lines

Discussion started by: manouche

2. Shell Programming and Scripting

sed/awk to insert multiple lines before pattern

Discussion started by: zksailor534

3. Shell Programming and Scripting

Command to remove duplicate lines with perl,sed,awk

Discussion started by: cola

4. Shell Programming and Scripting

Sed or Awk for lines between two strings multiple times and keep the last one

Discussion started by: damanidada

5. Shell Programming and Scripting

Print lines between two strings multiple occurencies (with sed, awk, or grep)

Discussion started by: theclem35

6. Shell Programming and Scripting

Sed/awk/perl command to replace pattern in multiple lines

Discussion started by: dani777

7. Shell Programming and Scripting

Using sed, awk or perl to remove substring of all lines except the first

Discussion started by: jacksolm

8. Shell Programming and Scripting

Awk/sed : help on:Filtering multiple lines to one:

Discussion started by: rveri

9. Shell Programming and Scripting

Process alternate lines in awk/sed/perl

Discussion started by: empyrean

10. UNIX for Beginners Questions & Answers

How to find=grep or maybe sed/awk for multiple lines of text?

Discussion started by: newbie_01