Sponsored Content
Top Forums Shell Programming and Scripting Removing Colors and ^M in a log file Post 302887463 by dgtek on Friday 7th of February 2014 05:19:30 PM
Old 02-07-2014
[Solved] Removing Colors and ^M in a log file

Hi,

I'm trying to send a log file to mailx as a "Body Message" but since the file contains so many control and color characters it's making an attachement out of it instead of putting it in the body.

The file looks like this:
HTML Code:
Bringing up loopback interface:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 19 Bringing up interface eth0:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 20 Starting portreserve: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 21 Starting system logger: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 22 Starting irqbalance: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 23 Starting rpcbind: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 24 Starting sssd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 25 Starting RPC idmapd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 26 Starting RPC gssd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 27 Starting kdump:^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 28 Starting system message bus: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 29 Starting Avahi daemon... ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 30 Starting NFS statd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 31 Initializing OpenCT smart card terminals:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 32 ^MŽ
 33 Starting cups: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 34 Mounting other filesystems:  ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 35 Starting acpi daemon: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 36 Starting HAL daemon: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 37 Retrigger failed udev events^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 38 Starting PC/SC smart card daemon (pcscd): ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 39 Loading autofs4: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 40 Starting automount: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 41 Starting Hyper-V KVP daemon ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 42 Starting sshd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 43 Starting xinetd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 44 Starting ntpd: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 45 Starting postfix: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
 46 Starting abrt daemon: ^[[60G[^[[0;32m  OK  ^[[0;39m]^M^MŽ
I've tried the following with no success.

cat boottest.log | sed -r "s/\x1B\[([0-9]{1,2}(;[0-9]{1,2})?)?[mGK]//g"

I then did a dos2unix but this remains at the beginning

^[%G▸ ▸ Welcome to CentOS·Ž
2 Starting udev: ^[%G[ OK ]^MŽ

and even after the dos2unix one ^M remains in the file because it's in the middle of the text.

Don't take into account the line numbers, this is only my text editor setup.

Any help would be appreciated.
 

9 More Discussions You Might Find Interesting

1. UNIX Desktop Questions & Answers

colors

Hello, I am somewhat new to linux. I just installed Red Hat 7.2 and when I try to load gnome or KDE in colors above 8bit it will kind of lock up and display some wierd scrambled cable look. I have an ATI Radeon 7000. I check out my monitor settings they are fine. Is it the graphics card? I set my... (1 Reply)
Discussion started by: Sage3k
1 Replies

2. UNIX for Dummies Questions & Answers

Colors

Is there a way with the bourne shell to have different types of files show up a different color when you do ls? (1 Reply)
Discussion started by: resullivan
1 Replies

3. Shell Programming and Scripting

Removing duplicates from log file?

I have a log file with posts looking like this: -- Messages can be delivered by different systems at different times. The id number is used to sort out duplicate messages. What I need is to strip the arrival time from each post, sort posts by id number, and reattach arrival time to respective... (2 Replies)
Discussion started by: Ilja
2 Replies

4. Shell Programming and Scripting

Text file colors

Hi everyone. I want to create a text file using different colors, but i dont know how to do that. I just can set the color for the -screen- output, using. for example: printf "\033[32m" printf "%-20s\n" "Orange colour" printf "\033[mo" but if i redirect the second line output to a text file,... (1 Reply)
Discussion started by: datinksy
1 Replies

5. Shell Programming and Scripting

Removing a pattern from a log file

I want to remove lines containing a tag from a log file. cat file.log | awk '!/ ${pattern} /' I want to pass a pattern as an argument to a csh script, that will then apply the removal of those lines. For example passing the pattern (DIAG) should remove all lines having (DIAG). (3 Replies)
Discussion started by: kristinu
3 Replies

6. UNIX for Advanced & Expert Users

Removing Old log files from Linux

Dear Friends, I want to remove the 10 days old log files from paticular directory. I want to use some other command for removing the old log files other than find command. Because in our system find command is taking too much of time to remove the old files. Kindly give me the solution... (3 Replies)
Discussion started by: rekha_sri
3 Replies

7. Shell Programming and Scripting

PERL "filtering the log file removing the duplicates

Hi folks, I have a log file in the below format and trying to get the output of the unique ones based on mnemonic IN PERL. Could any one please let me know with the code and the logic ? Severity Mnemonic Log Message 7 CLI_SCHEDULER Logfile for scheduled CLI... (3 Replies)
Discussion started by: scriptscript
3 Replies

8. Shell Programming and Scripting

Archiving or removing few data from log file in real time

Hi, I have a log file that gets updated every second. Currently the size has grown to 20+ GB. I need to have a command/script, that will try to get the actual size of the file and will remove 50% of the data that are in the log file. I don't mind removing the data as the size has grown to huge... (8 Replies)
Discussion started by: Souvik Patra
8 Replies

9. Shell Programming and Scripting

Help needed in sending file content with colors and borders

HI i am running a shell script in cron and storing the output of that script in a file say test.then i am copying the content of test to test1 and i will send the output of test to some email ids using mutt. Next time when the script executes i am comparing the contents of test and test1 and... (3 Replies)
Discussion started by: venkitesh
3 Replies
7zr(1)							      General Commands Manual							    7zr(1)

NAME
7zr - A file archiver with highest compression ratio SYNOPSIS
7zr [adeltux] [-] [SWITCH] <ARCHIVE_NAME> <ARGUMENTS>... DESCRIPTION
7-Zip is a file archiver with the highest compression ratio. The program supports 7z (that implements LZMA compression algorithm), LZMA2, XZ, ZIP, Zip64, CAB, RAR (if the non-free p7zip-rar package is installed), ARJ, GZIP, BZIP2, TAR, CPIO, RPM, ISO, most filesystem images and DEB formats. Compression ratio in the new 7z format is 30-50% better than ratio in ZIP format. 7zr is a stand-alone executable. 7zr handles less archive formats than 7z. 7zr is a "light-version" of 7za that only handles 7z archives. FUNCTION LETTERS
a Add d Delete e Extract l List t Test u Update x eXtract with full paths SWITCHES
-ai[r[-|0]]{@listfile|!wildcard} Include archives -ax[r[-|0]]{@listfile|!wildcard} eXclude archives -bd Disable percentage indicator -i[r[-|0]]{@listfile|!wildcard} Include filenames -l don't store symlinks; store the files/directories they point to (CAUTION : the scanning stage can never end because of recursive symlinks like 'ln -s .. ldir') -m{Parameters} Set Compression Method (see /usr/share/doc/p7zip/DOCS/MANUAL/switches/method.htm for a list of methods) -mhe=on|off 7z format only : enables or disables archive header encryption (Default : off) -o{Directory} Set Output directory -p{Password} Set Password -r[-|0] Recurse subdirectories (CAUTION: this flag does not do what you think, avoid using it) -sfx[{name}] Create SFX archive -si Read data from StdIn (eg: tar cf - directory | 7zr a -si directory.tar.7z) -so Write data to StdOut (eg: 7zr x -so directory.tar.7z | tar xf -) -slt Sets technical mode for l (list) command -v{Size}[b|k|m|g] Create volumes -u[-][p#][q#][r#][x#][y#][z#][!newArchiveName] Update options -w[path] Set Working directory -x[r[-|0]]]{@listfile|!wildcard} Exclude filenames -y Assume Yes on all queries DIAGNOSTICS
7-Zip returns the following exit codes: 0 Normal (no errors or warnings detected) 1 Warning (Non fatal error(s)). For example, some files cannot be read during compressing. So they were not compressed 2 Fatal error 7 Bad command line parameters 8 Not enough memory for operation 255 User stopped the process with control-C (or similar) Backup and limitations DO NOT USE the 7-zip format for backup purpose on Linux/Unix because : - 7-zip does not store the owner/group of the file. On Linux/Unix, in order to backup directories you must use tar : - to backup a directory : tar cf - directory | 7zr a -si directory.tar.7z - to restore your backup : 7zr x -so directory.tar.7z | tar xf - If you want to send files and directories (not the owner of file) to others Unix/MacOS/Windows users, you can use the 7-zip format. example : 7zr a directory.7z directory Do not use "-r" because this flag does not do what you think. Do not use directory/* because of ".*" files (example : "directory/*" does not match "directory/.profile") EXAMPLE 1 7zr a -t7z -m0=lzma -mx=9 -mfb=64 -md=32m -ms=on archive.7z dir1 adds all files from directory "dir1" to archive archive.7z using "ultra settings" -t7z 7z archive -m0=lzma lzma method -mx=9 level of compression = 9 (Ultra) -mfb=64 number of fast bytes for LZMA = 64 -md=32m dictionary size = 32 megabytes -ms=on solid archive = on EXAMPLE 2 7zr a -sfx archive.exe dir1 add all files from directory "dir1" to SFX archive archive.exe (Remark : SFX archive MUST end with ".exe") EXAMPLE 3 7zr a -mhe=on -pmy_password archive.7z a_directory add all files from directory "a_directory" to the archive "archive.7z" (with data and header archive encryption on) SEE ALSO
7z(1), 7za(1), bzip2(1), gzip(1), zip(1) HTML Documentation /usr/share/doc/p7zip/DOCS/MANUAL/index.htm AUTHOR
Written for Debian by Mohammed Adnene Trojette. Mohammed Adnene Trojette September 1 2006 7zr(1)
All times are GMT -4. The time now is 06:33 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy