SED command help

Thread Tools Search this Thread
Top Forums Shell Programming and Scripting SED command help
# 1  
Old 10-23-2007
Bug SED command help


I have a script that executes a batch job within our application and then e-mails the log file. What I'm looking to do is to use the sed command to extract a value from this log file and set it as a variable, and then do further processing.

I've searched and read several things on using sed, but I guess I'm just not understanding how it works.

This is what I've formed so far...
ErrCnt=`cat taic.log | sed -n s/         /p'

This is what the taic.log looks like:

Batch process TAIC started
Running Processes
Processes completed, 0 errors found
Batch process TAIC completed

So, I'm trying to extract the number of errors found as a variable. Any assistance would be appreciated.

# 2  
Old 10-23-2007
I'm not sure what you want, but this counts the number of errors:
awk '{if(/^Process/) { total+=$3}} END { print total}' filename

Batch process TAIC started
Running Processes
Processes completed, 0 errors found
Batch process TAIC completed
Batch process TAIC started
Running Processes
Processes completed, 1 errors found
Batch process TAIC completed
Batch process TAIC started
Running Processes
Processes completed, 0 errors found
Batch process TAIC completed


in a variable:
errcnt=`awk '{if(/^Process/) { total+=$3}} END { print total}' filename`

# 3  
Old 10-23-2007
I appreciate your response!

I put the following into a separate script ( to verify that the variable is being set properly:
errcnt=`awk '{if(/^Process/) { total+=$3}} END { print total}' taic.kt.log`
print $errcnt

And I received this as the response:
$ ./

Any thoughts has to why this isn't returning anything? I've never looked into awk, so I'm not sure of how to check the syntax. thanks!
# 4  
Old 10-23-2007
Using awk for such a purpose is like using H-bombs for chasing blackbirds away.

As i take it from your explanation of the problem you want to find the line containing "Processes completed, XX errors found" where XX could be any number. Then you want to get this value of XX into a variable for further processing.

I suppose here for the sake of simplicity that the file cannot contain more than one line with "Processes completed....". If this would be the case the solution would need a loop to process one value after the other. Pls. check back if this is the case and I'll expand on this. Here we go:

We want to find a line that contains "Processes completed,", then some integer value, followed by " errors found". We want to ignore all the other lines in the file and reduce this line to only the integer value. This is the basis of our regular expression:

sed -n 's/^Processes completed, \([0-9][0-9]*\) errors found/\1/p' taic.log

The '-n'-option tells sed not to print any lines until explicitly being told so by the "p" option. Now we have phrased our substitute-expression in a way, where only the one line we look for fits in, so this is the only one which will get printed. within the line we define a variable ("\(....\)") and in it we catch every number there might be. We replace the comlete line by only the numbers in this variable ( .../\1/....) and hence print only them to stdout.

The next part is to catch this output into a shell variable. We do this by issuing the sed-command in a subshell:

iErrors=$(sed -n 's/^Processes completed, \([0-9][0-9]*\) errors found/\1/p' taic.log)

Now the shell fires up a new shell, executes in this everything between "$(" and ")" and replaces the "$(...)" with the output of that command. This is our integer and after doing this the command really to be executed would be (in case the errors would be 10) "iErrors=10". Now the only task left is to tidy up by declaring all the involved variables. Taken them for granted is *yuck*, y'know? ;-))

#! /bin/ksh

typeset -i iErrors=$(sed -n 's/^Processes completed, \([0-9][0-9]*\) errors found/\1/p' taic.log)

if     [ $iErrors -eq 0 ] ; then
     # 0 errors found
elseif [ $iErrors -eq 1 ] ; then
     # 1 errors found
     # more than 1 errors fould


I hope this helps.

# 5  
Old 10-23-2007

I will integrate into my script and test tomorrow as I'm walking about the door now. thank you for your help! Smilie
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Output of sed command to another sed command

Hi All, I'm relatively new to Unix scripting and am trying to get my head around piping. I'm trying to take a header record from one file and prepend it to another file. I've done this by creating several temp files but i'm wondering if there is a cleaner way to do this. I'm thinking... (10 Replies)
Discussion started by: BigCroyd
10 Replies

2. Shell Programming and Scripting

sed and awk giving error ./ line 13: sed: command not found

Hi, I am running a script in bash environment .In the script i am using sed and awk commands which when executed individually from terminal they are getting executed normally but when i give these sed and awk commands in the script it is giving the below errors :- ./ line... (12 Replies)
Discussion started by: satishmallidi
12 Replies

3. Shell Programming and Scripting

sed Command

Hello, I'm working with this command which I'm having trouble understanding it: sed -e '1,$ s/SUB/N/g' < $1 > file.txt Where SUB stand for an special character with code in ASCII is 0x1A, notepad read it as a right arrow. Any help will be appreciated. (5 Replies)
Discussion started by: emilioveras
5 Replies

4. Shell Programming and Scripting

sed returns error "sed: -e expression #1, char 18: unterminated `s' command"

Hello All, I have something like below LDC100/rel/prod/libinactrl.a LAA2000/rel/prod/libinactrl.a I want to remove till first forward slash that is outputshould be as below rel/prod/libinactrl.a rel/prod/libinactrl.a How can I do that ??? (8 Replies)
Discussion started by: anand.shah
8 Replies

5. UNIX for Advanced & Expert Users

sed command

Hi..... I'm using sed command for replace the words in a file cat >test.txt My test.txt contains Mary had a little ham Mary fried a lot of spam Jack ate a Spam sandwich Jill had a lamb spamwich Marry had a spicy wich $ sed 's/wich$/mirchi/g' test.txt output is: Mary had a little ham... (24 Replies)
Discussion started by: ksrivani
24 Replies

6. UNIX for Dummies Questions & Answers

sed insert command and variable expansion/command substitution

I know this script is crummy, but I was just messing around.. how do I get sed's insert command to allow variable expansion to show the filename? #!/bin/bash filename=`echo $0` /usr/bin/sed '/#include/ { i\ the filename is `$filename` }' $1 exit 0 (8 Replies)
Discussion started by: glev2005
8 Replies

7. Shell Programming and Scripting

Convert Sed command to perl command

Hello, Can any perl experts help me convert my sed string to perl. I am unsuccessful with this. I have to remove this string from html files OAS_AD('Top'); I have come up with this. However the requirement is in perl. for find in $(find . -type f -name "file1.html") ; do cat $find |... (2 Replies)
Discussion started by: abacus
2 Replies

8. UNIX for Dummies Questions & Answers

some help with the sed command please

hi all, attached you can find a small txt file ( .txt ), GIVEN that past_scheduler="islip" and scheduler="mucf" can somebody please tell me WHY sed 's/-u '$past_scheduler'/-u '$scheduler'/g' .txt > .txt.temp fails ? thanx (3 Replies)
Discussion started by: OneDreamCloser
3 Replies

9. Shell Programming and Scripting

Loop with sed command to replace line with sed command in it

Okay, title is kind of confusion, but basically, I have a lot of scripts on a server that I need to replace a ps command, however, the new ps command I'm trying to replace the current one with pipes to sed at one point. So now I am attempting to create another script that replaces that line. ... (1 Reply)
Discussion started by: cbo0485
1 Replies

10. Shell Programming and Scripting

awk/sed Command : Parse parameter file / send the lines to the ksh export command

Sorry for the duplicate thread this one is similar to the one in Since there were no responses on the parent thread since it got resolved partially i thought to open the new... (4 Replies)
Discussion started by: rajan_san
4 Replies
Login or Register to Ask a Question