Removing Colors and ^M in a log file

Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Removing Colors and ^M in a log file
# 8  
Old 02-07-2014
cat file
Bringing up loopback interface:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M
 19 Bringing up interface eth0:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M
 20 Starting portreserve: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M
 21 Starting system logger: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M
 22 Starting irqbalance: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M

awk '{gsub(/\^M|\^\[\[[0-9]*G\[|\^\[\[0;[0-9]*m]*| */,x)}1' file
Bringing up loopback interface:    OK
 19 Bringing up interface eth0:    OK
 20 Starting portreserve:   OK
 21 Starting system logger:   OK
 22 Starting irqbalance:   OK

This is copy and past from code in post #1. It may be that it has changed when you posted it here. Upload the file.
# 9  
Old 02-07-2014
I just did, waiting for the moderator to approve
# 10  
Old 02-07-2014
Try this, just to remove the escape codes.
awk '{gsub(/\^\[\[[0-9]*;*[0-9]*(G\[|m]*)/,x)}1' file

# 11  
Old 02-07-2014
Either I'm doing something really wrong but in my test here the file remains the same thing. But I did the test of pasting the file content into another file and then it works.

Probably once you get the file I uploaded you'll be able to see what is going on
# 12  
Old 02-07-2014
Please show exactly what you do. awk is not like dos2unix -- it won't modify the original file...
# 13  
Old 02-07-2014
awk '{gsub(/\^\[\[[0-9]*;*[0-9]*(G\[|m]*)/,x)}1' boottest.log > boottest_awk.log

This is the content of the boottest_awk.log file:
I'll post a png file of what is seen from within vi:
Removing Colors and ^M in a log file-boottest_awklogpng
# 14  
Old 02-07-2014
In this posting, all appearances of the string <ESC> is a visual representation of the escape control character and <NUMBER> is a string of 1 or more decimal digits.

I'm not sure what the escape sequence:

is supposed to do, but the following script removes them. The escape sequences of the form:

change the background or foreground color (only the foreground color is affected by your sample file). The following script removes them. The escape sequence:

moves the cursor to output column 60 before printing the following text. A much more complicated script could evaluate what has already been output and match this behavior. The following simple script just removes them.

And, as requested, this script removes all carriage return control characters from the file:
CR=$(printf "\r")
ESC=$(printf "\e")
sed "s/$ESC\[[^Gm]*[Gm]//g;s/$ESC%G//g;s/$CR//g" boottest.log

If you weren't aware that there were escape control characters in your file, look at it using:
od -bc boottest.log

Assuming you're on a machine where ASCII is a subset of the code set underlying your current locale, the escape character will appear as the string 033.
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help needed in sending file content with colors and borders

HI i am running a shell script in cron and storing the output of that script in a file say test.then i am copying the content of test to test1 and i will send the output of test to some email ids using mutt. Next time when the script executes i am comparing the contents of test and test1 and... (3 Replies)
Discussion started by: venkitesh
3 Replies

2. Shell Programming and Scripting

Archiving or removing few data from log file in real time

Hi, I have a log file that gets updated every second. Currently the size has grown to 20+ GB. I need to have a command/script, that will try to get the actual size of the file and will remove 50% of the data that are in the log file. I don't mind removing the data as the size has grown to huge... (8 Replies)
Discussion started by: Souvik Patra
8 Replies

3. Shell Programming and Scripting

PERL "filtering the log file removing the duplicates

Hi folks, I have a log file in the below format and trying to get the output of the unique ones based on mnemonic IN PERL. Could any one please let me know with the code and the logic ? Severity Mnemonic Log Message 7 CLI_SCHEDULER Logfile for scheduled CLI... (3 Replies)
Discussion started by: scriptscript
3 Replies

4. UNIX for Advanced & Expert Users

Removing Old log files from Linux

Dear Friends, I want to remove the 10 days old log files from paticular directory. I want to use some other command for removing the old log files other than find command. Because in our system find command is taking too much of time to remove the old files. Kindly give me the solution... (3 Replies)
Discussion started by: rekha_sri
3 Replies

5. Shell Programming and Scripting

Removing a pattern from a log file

I want to remove lines containing a tag from a log file. cat file.log | awk '!/ ${pattern} /' I want to pass a pattern as an argument to a csh script, that will then apply the removal of those lines. For example passing the pattern (DIAG) should remove all lines having (DIAG). (3 Replies)
Discussion started by: kristinu
3 Replies

6. Shell Programming and Scripting

Text file colors

Hi everyone. I want to create a text file using different colors, but i dont know how to do that. I just can set the color for the -screen- output, using. for example: printf "\033[32m" printf "%-20s\n" "Orange colour" printf "\033[mo" but if i redirect the second line output to a text file,... (1 Reply)
Discussion started by: datinksy
1 Replies

7. Shell Programming and Scripting

Removing duplicates from log file?

I have a log file with posts looking like this: -- Messages can be delivered by different systems at different times. The id number is used to sort out duplicate messages. What I need is to strip the arrival time from each post, sort posts by id number, and reattach arrival time to respective... (2 Replies)
Discussion started by: Ilja
2 Replies

8. UNIX for Dummies Questions & Answers


Is there a way with the bourne shell to have different types of files show up a different color when you do ls? (1 Reply)
Discussion started by: resullivan
1 Replies

9. UNIX Desktop Questions & Answers


Hello, I am somewhat new to linux. I just installed Red Hat 7.2 and when I try to load gnome or KDE in colors above 8bit it will kind of lock up and display some wierd scrambled cable look. I have an ATI Radeon 7000. I check out my monitor settings they are fine. Is it the graphics card? I set my... (1 Reply)
Discussion started by: Sage3k
1 Replies
Login or Register to Ask a Question