Visit Our UNIX and Linux User Community

Removing Colors and ^M in a log file

Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Removing Colors and ^M in a log file
# 1  
Old 02-07-2014
[Solved] Removing Colors and ^M in a log file


I'm trying to send a log file to mailx as a "Body Message" but since the file contains so many control and color characters it's making an attachement out of it instead of putting it in the body.

The file looks like this:
HTML Code:
Bringing up loopback interface:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 19 Bringing up interface eth0:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 20 Starting portreserve: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 21 Starting system logger: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 22 Starting irqbalance: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 23 Starting rpcbind: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 24 Starting sssd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 25 Starting RPC idmapd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 26 Starting RPC gssd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 27 Starting kdump:^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 28 Starting system message bus: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 29 Starting Avahi daemon... ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 30 Starting NFS statd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 31 Initializing OpenCT smart card terminals:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 32 ^MŽ
 33 Starting cups: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 34 Mounting other filesystems:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 35 Starting acpi daemon: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 36 Starting HAL daemon: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 37 Retrigger failed udev events^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 38 Starting PC/SC smart card daemon (pcscd): ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 39 Loading autofs4: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 40 Starting automount: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 41 Starting Hyper-V KVP daemon ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 42 Starting sshd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 43 Starting xinetd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 44 Starting ntpd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 45 Starting postfix: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 46 Starting abrt daemon: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
I've tried the following with no success.

cat boottest.log | sed -r "s/\x1B\[([0-9]{1,2}(;[0-9]{1,2})?)?[mGK]//g"

I then did a dos2unix but this remains at the beginning

^[%G▸ ▸ Welcome to CentOS·Ž
2 Starting udev: ^[%G[ OK ]^MŽ

and even after the dos2unix one ^M remains in the file because it's in the middle of the text.

Don't take into account the line numbers, this is only my text editor setup.

Any help would be appreciated.
# 2  
Old 02-07-2014
Do you have dos2unix and have you tried that?
dos2unix infile

# 3  
Old 02-07-2014
Yes As mentioned I did try that on top of the sed command with no success
# 4  
Old 02-07-2014
Try some like this:
awk '{gsub(/\^M|\^\[\[[0-9]*G\[\^\[\[0;32m|\^\[\[0;39m\]/,x)}1' file

# 5  
Old 02-07-2014
Can you upload a sample file with minimal size?

# 6  
Old 02-07-2014
Hum... sorry this one doesn't anything at all the output is exactly the same
# 7  
Old 02-07-2014
Here is the file in question

Previous Thread | Next Thread
Test Your Knowledge in Computers #90
Difficulty: Easy
If you open vi specify a path to a file that does not exist, vi will create a new, blank file at that location in the filesystem and open it.
True or False?

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help needed in sending file content with colors and borders

HI i am running a shell script in cron and storing the output of that script in a file say test.then i am copying the content of test to test1 and i will send the output of test to some email ids using mutt. Next time when the script executes i am comparing the contents of test and test1 and... (3 Replies)
Discussion started by: venkitesh
3 Replies

2. Shell Programming and Scripting

Archiving or removing few data from log file in real time

Hi, I have a log file that gets updated every second. Currently the size has grown to 20+ GB. I need to have a command/script, that will try to get the actual size of the file and will remove 50% of the data that are in the log file. I don't mind removing the data as the size has grown to huge... (8 Replies)
Discussion started by: Souvik Patra
8 Replies

3. Shell Programming and Scripting

PERL "filtering the log file removing the duplicates

Hi folks, I have a log file in the below format and trying to get the output of the unique ones based on mnemonic IN PERL. Could any one please let me know with the code and the logic ? Severity Mnemonic Log Message 7 CLI_SCHEDULER Logfile for scheduled CLI... (3 Replies)
Discussion started by: scriptscript
3 Replies

4. UNIX for Advanced & Expert Users

Removing Old log files from Linux

Dear Friends, I want to remove the 10 days old log files from paticular directory. I want to use some other command for removing the old log files other than find command. Because in our system find command is taking too much of time to remove the old files. Kindly give me the solution... (3 Replies)
Discussion started by: rekha_sri
3 Replies

5. Shell Programming and Scripting

Removing a pattern from a log file

I want to remove lines containing a tag from a log file. cat file.log | awk '!/ ${pattern} /' I want to pass a pattern as an argument to a csh script, that will then apply the removal of those lines. For example passing the pattern (DIAG) should remove all lines having (DIAG). (3 Replies)
Discussion started by: kristinu
3 Replies

6. Shell Programming and Scripting

Text file colors

Hi everyone. I want to create a text file using different colors, but i dont know how to do that. I just can set the color for the -screen- output, using. for example: printf "\033[32m" printf "%-20s\n" "Orange colour" printf "\033[mo" but if i redirect the second line output to a text file,... (1 Reply)
Discussion started by: datinksy
1 Replies

7. Shell Programming and Scripting

Removing duplicates from log file?

I have a log file with posts looking like this: -- Messages can be delivered by different systems at different times. The id number is used to sort out duplicate messages. What I need is to strip the arrival time from each post, sort posts by id number, and reattach arrival time to respective... (2 Replies)
Discussion started by: Ilja
2 Replies

8. UNIX for Dummies Questions & Answers


Is there a way with the bourne shell to have different types of files show up a different color when you do ls? (1 Reply)
Discussion started by: resullivan
1 Replies

9. UNIX Desktop Questions & Answers


Hello, I am somewhat new to linux. I just installed Red Hat 7.2 and when I try to load gnome or KDE in colors above 8bit it will kind of lock up and display some wierd scrambled cable look. I have an ATI Radeon 7000. I check out my monitor settings they are fine. Is it the graphics card? I set my... (1 Reply)
Discussion started by: Sage3k
1 Replies

Featured Tech Videos