Shell Programming and Scripting

Hello All,


In a Bash Script I'm writing I have a section where I loop through a text file that was
outputted by another script. In the text file some of the strings in there are enclosed with
the BOLD "character sequences" (i.e. "\033[1m" ) and the "OFF" sequence (i.e. "\033[0m" ). Now I
am reading the file line-by-line in a while loop and saving each line into an element in an array.

What I would like to do is remove/disable these backslah escapes while saving the line from the
file into the Array element.

But it's weird, because if I run this command:
echo -E "\033[1m Hello World \033[0m"

The Output is:
\033[1m Hello World \033[0m

And running it with "-e" instead, prints:
Hello World

Here is a part of my while loop and I was hoping that it would diable those backslash escapes but it doesn't.

Code:

    while read line
     do
        if [[ $line =~ $PATTERN ]]
         then
            FILE_Lines[$x]=$(echo -E "$line")
            x=$(($x+1))
        fi
    done < $outputFile

So is there another way to read in the file or while saving the line to remove those sequences..?
I also tried adding a "sed 's/\\033\[1m//g'" to the end of the line in the while loop that assigns the line to the
FILE_Lines Array, but that didn't do anything either... I've also tried every different combination of quotes,
single and double, and still nothing...


If anyone has any suggestions, that would be great!


Thanks in Advance,
Matt

Try this:

Code:

$ line="\033[1m Hello World \033[0m"
$ echo $line | sed 's/\\033\[1m \(.\{1,\}\) \\033\[0m/\1/'
Hello World

I did a search for "Strip VT100 escape sequences" and came up with this perl code (thanks Anonymous Monk):

Code:

perl -pe  's/\e\[[\d,\s]*[a-zA-Z]//g; s/\e\][\d];//g; s/\r\n/\n/g; s/[\000-\011]//g; s/[\013-\037]//g'

so..

Code:

FILE_Lines[$x]=$(echo -e "$line"|perl -pe  's/\e\[[\d,\s]*[a-zA-Z]//g; s/\e\][\d];//g; s/\r\n/\n/g; s/[\000-\011]//g; s/[\013-\037]//g')

Hey Guys, thank you both for the replies.

I'll give those a try and post back....
I had no idea though that they were called VT100 Escape Sequences... Good to know!


Thanks Again,
Matt

---------- Post updated at 09:44 AM ---------- Previous update was at 09:24 AM ----------

Hey spacebar, I gave that a try and it didn't seem to work...
Probably some character missing or something like that within the REGEX Pattern somewhere...


Hey Chubler_XL thanks again for your suggestion!
Perfect! Thanks that did the trick! That's gotta be one of the longest REGEX's I've ever seen lol...


Many thanks...!


Thanks Again,
Matt

Take a closer look; it's five little regexes.

Hey Corona, thanks for the reply...

Yeah funny you say that, I actually just noticed that a little while before I read your post... Thanks!


UPDATE:
So I'm guessing I ran into a little Perl version problem on some of our older servers...
When I ran the REGEX on the machine I'm testing this on, it worked perfectly... But when I transferred it over
to another server running Perl v5.8.2 and another with v5.8.8 it didn't do anything to the "strings" at all.

So what I did was, I tried to simplify the REGEX, because I'm guessing it matched ANY/ALL V100 Character
Sequences, but I ONLY needed to look out for the ones for BOLD "\033[1m", and the one for OFF "\033[0m"
and possibly the one for UNDERLINE "\033[4m"...

Strangely though, those escape sequences above are how you would enter them into a bash script, like this:
i.e. --> echo -e "\033[1m THIS PRINTS BOLD \033[0m"

Then if I redirect the echo statement into a txt file, they show like this instead of what's above...
i.e. --> "^[[1m THIS PRINTS BOLD ^[[0m"


So here's my new REGEX (also I changed the while loop to just a 'cat' command):

Code:

outputFile="/usr/local/test/Output.txt"

### Split the output of the 'cat' command on newlines, and insert it into the array FILE_Lines...
IFS='
'
FILE_Lines=($(cat $outputFile | perl -pe 's/\^\[\[(1|0|4)m//g'))

for (( x=0; x<=${#NRPE_Lines[@]}; x++ ))
 do
    echo ${NRPE_Lines[$x]}
done

So far this seems to remove ALL the escape sequences from the file, so I guess
I'll use this one until or if/when something else goes wrong lol...



Thanks again you guys for your suggestions... Much appreciated!!


Thanks Again,
Matt

You get a useless use of cat award.

All your code amounts to is

Code:

perl -pe 's/\^\[\[(1|0|4)m//g' < file

Do you really need to store the entire file into an array? Why not just read it line-by-line?

Code:

perl -pe 's/\^\[\[(1|0|4)m//g' < file | while read LINE
do
        echo "do something"
done