Removing Colors and ^M in a log file Post: 302887463

Sponsored Content

Top Forums Shell Programming and Scripting Removing Colors and ^M in a log file Post 302887463 by dgtek on Friday 7th of February 2014 05:19:30 PM

02-07-2014

Registered User

[Solved] Removing Colors and ^M in a log file

Hi,

I'm trying to send a log file to mailx as a "Body Message" but since the file contains so many control and color characters it's making an attachement out of it instead of putting it in the body.

The file looks like this:

HTML Code:

Bringing up loopback interface:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 19 Bringing up interface eth0:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 20 Starting portreserve: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 21 Starting system logger: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 22 Starting irqbalance: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 23 Starting rpcbind: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 24 Starting sssd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 25 Starting RPC idmapd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 26 Starting RPC gssd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 27 Starting kdump:^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 28 Starting system message bus: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 29 Starting Avahi daemon... ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 30 Starting NFS statd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 31 Initializing OpenCT smart card terminals:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 32 ^M�
 33 Starting cups: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 34 Mounting other filesystems:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 35 Starting acpi daemon: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 36 Starting HAL daemon: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 37 Retrigger failed udev events^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 38 Starting PC/SC smart card daemon (pcscd): ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 39 Loading autofs4: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 40 Starting automount: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 41 Starting Hyper-V KVP daemon ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 42 Starting sshd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 43 Starting xinetd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 44 Starting ntpd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 45 Starting postfix: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�
 46 Starting abrt daemon: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^M�

I've tried the following with no success.

cat boottest.log | sed -r "s/\x1B\[([0-9]{1,2}(;[0-9]{1,2})?)?[mGK]//g"

I then did a dos2unix but this remains at the beginning

^[%G▸ ▸ Welcome to CentOS��
2 Starting udev: ^[%G[ OK ]^M�

and even after the dos2unix one ^M remains in the file because it's in the middle of the text.

Don't take into account the line numbers, this is only my text editor setup.

Any help would be appreciated.

dgtek

View Public Profile for dgtek

Find all posts by dgtek

9 More Discussions You Might Find Interesting

1. UNIX Desktop Questions & Answers

colors

Hello, I am somewhat new to linux. I just installed Red Hat 7.2 and when I try to load gnome or KDE in colors above 8bit it will kind of lock up and display some wierd scrambled cable look. I have an ATI Radeon 7000. I check out my monitor settings they are fine. Is it the graphics card? I set my...

2. UNIX for Dummies Questions & Answers

Colors

Is there a way with the bourne shell to have different types of files show up a different color when you do ls?

3. Shell Programming and Scripting

Removing duplicates from log file?

I have a log file with posts looking like this: -- Messages can be delivered by different systems at different times. The id number is used to sort out duplicate messages. What I need is to strip the arrival time from each post, sort posts by id number, and reattach arrival time to respective...

4. Shell Programming and Scripting

Text file colors

Hi everyone. I want to create a text file using different colors, but i dont know how to do that. I just can set the color for the -screen- output, using. for example: printf "\033[32m" printf "%-20s\n" "Orange colour" printf "\033[mo" but if i redirect the second line output to a text file,...

5. Shell Programming and Scripting

Removing a pattern from a log file

I want to remove lines containing a tag from a log file. cat file.log | awk '!/ ${pattern} /' I want to pass a pattern as an argument to a csh script, that will then apply the removal of those lines. For example passing the pattern (DIAG) should remove all lines having (DIAG).

6. UNIX for Advanced & Expert Users

Removing Old log files from Linux

Dear Friends, I want to remove the 10 days old log files from paticular directory. I want to use some other command for removing the old log files other than find command. Because in our system find command is taking too much of time to remove the old files. Kindly give me the solution...

7. Shell Programming and Scripting

PERL "filtering the log file removing the duplicates

Hi folks, I have a log file in the below format and trying to get the output of the unique ones based on mnemonic IN PERL. Could any one please let me know with the code and the logic ? Severity Mnemonic Log Message 7 CLI_SCHEDULER Logfile for scheduled CLI...

8. Shell Programming and Scripting

Archiving or removing few data from log file in real time

Hi, I have a log file that gets updated every second. Currently the size has grown to 20+ GB. I need to have a command/script, that will try to get the actual size of the file and will remove 50% of the data that are in the log file. I don't mind removing the data as the size has grown to huge...

9. Shell Programming and Scripting

Help needed in sending file content with colors and borders

HI i am running a shell script in cron and storing the output of that script in a file say test.then i am copying the content of test to test1 and i will send the output of test to some email ids using mutt. Next time when the script executes i am comparing the contents of test and test1 and...

LEARN ABOUT SUSE

ansi_code

term::ansi::code(n)						 Terminal control					       term::ansi::code(n)

__________________________________________________________________________________________________________________________________________________

NAME

       term::ansi::code - Helper for control sequences

SYNOPSIS

       package require Tcl  8.4

       package require term::ansi::code  ?0.1?

       ::term::ansi::code::esc str

       ::term::ansi::code::escb str

       ::term::ansi::code::define name escape code

       ::term::ansi::code::const name code

_________________________________________________________________

DESCRIPTION

       This package provides commands enabling the definition of control sequences in an easy manner.

       ::term::ansi::code::esc str
	      This command returns the argument string, prefixed with the ANSI escape character, "33."

       ::term::ansi::code::escb str
	      This command returns the argument string, prefixed with a common ANSI escape sequence, "33[".

       ::term::ansi::code::define name escape code
	      This  command defines a procedure name which returns the control sequence code, beginning with the specified escape sequence, either
	      esc, or escb.

       ::term::ansi::code::const name code
	      This command defines a procedure name which returns the control sequence code.

BUGS, IDEAS, FEEDBACK
       This document, and the package it describes, will undoubtedly contain bugs and other problems.  Please report such in the category term	of
       the  Tcllib  SF	Trackers [http://sourceforge.net/tracker/?group_id=12883].  Please also report any ideas for enhancements you may have for
       either package and/or documentation.

KEYWORDS

       control, declare, define, terminal

COPYRIGHT

       Copyright (c) 2006 Andreas Kupries <andreas_kupries@users.sourceforge.net>

term									0.1						       term::ansi::code(n)