Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to remove special characters from each line?
Top Forums Shell Programming and Scripting How to remove special characters from each line? Post 302333935 by majormark on Tuesday 14th of July 2009 10:35:07 AM
Old 07-14-2009
How to remove special characters from each line?
Hello,

Is there a simpler way to remove special characters (color codes) from each lines in a log file?

I use sed like in the example below but I think there should be a more simple way to achieve the same result:

Code:
$ cat -vet file1
^[[36m20014:35:14.20232 90], [ 80|42^[[0m$
^[[34m200:35:14. 87], [ 80| ^[[0m$

$ cat -vet file1 | sed s/^\\^\\[\\[..m//g | sed s/\\^\\[\\[0m\\$//g
20014:35:14.20232 90], [ 80|42
200:35:14. 87], [ 80| 

The idea is to remove the begin-end pattern: "^[[<NR>m ..... ^[[<NR>m$"
This characters only show when using the option with cat, otherwise the text appears in color.

Maybe to convert the file somehow?

Thanks.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Remove directory that has special Characters

Hi All, I have a script written that creates a new directory within the shell program and if a parameter isn't passed in, it creates a strange directory name by mistake. So I have a directory like "-_12" and I am unable to remove it. I tried removing it using double quote and many others. I have... (12 Replies)
Discussion started by: datherriault
12 Replies

2. Shell Programming and Scripting

Remove special characters from string

Hi there, I'd like to write a script that removes any set of character from any string. The first argument would be the string, the second argument would be the characters to remove. For example: $ myscript "My name's Santiago. What's yours?" "atu" My nme's Snigo. Wh's yors? I wrote the... (11 Replies)
Discussion started by: chebarbudo
11 Replies

3. UNIX for Dummies Questions & Answers

How to Remove Special Characters

Dear Members, We have a file which contains some special characters. I need to replace these special character by a new line character(\n). The Special character is \x85. I am not sure what this character means and how we can remove it. Any inputs are greatly appreciated. Thanks... (5 Replies)
Discussion started by: sandeep_1105
5 Replies

4. Shell Programming and Scripting

remove special characters

hello all I am writing a perl code and i wish to remove the special characters for text. I wish to remove all extended ascii characters. If the list of special characters is huge, how can i do this using substitute command s/specialcharacters/null/g I really want to code like... (3 Replies)
Discussion started by: vasuarjula
3 Replies

5. Shell Programming and Scripting

Remove string between two special characters

Hi All, I have a variable like AVAIL="\ BACK:bkpstg:testdb3.iad.expertcity.com:backtest|\ #AUTH:authstg:testdb3.iad.expertcity.com:authiapd|\ TEST:authstg:testdb3.iad.expertcity.com:authiapd|\ " What I want to do here is that If a find # before any entry, remove the entire string... (5 Replies)
Discussion started by: engineermayur
5 Replies

6. Shell Programming and Scripting

Remove the special characters from field

Hi, In source data few of columns are having special charates(like *) due to this i am not able to display the data into flat file.it's displaying the some of junk data into the flat file. source dataExample: Address1="XDERFTG * HYJUYTG" how to remove the special charates in a string (2 Replies)
Discussion started by: koti_rama
2 Replies

7. Shell Programming and Scripting

Sed - remove special characters

Hi, I have a file with this line, it's always in the first line: I want to remove these special characters: ´╗┐ file1 ´╗┐\\bar\c$\test2\;3.348.118 Bytes;160 ;3 \\bar\c$\test\;35 Bytes;2 ;1 I want the same file to be only \\bar\c$\test2\;3.348.118 Bytes;160 ;3 \\bar\c$\test\;35... (4 Replies)
Discussion started by: nakaedu
4 Replies

8. Shell Programming and Scripting

How to remove some special characters in a string?

Hi, I have string like this ="Lookup Procedure" But i want the output like this Lookup Procedure =," should be removed. Please suggest me the solution. Regards, Madhuri (2 Replies)
Discussion started by: srimadhuri
2 Replies

9. Shell Programming and Scripting

How to remove special characters?

Hi Gurus, I have file which contains some unicode charachator like "ü". I want to replace it with some charactors. I searched in internet and got command sed "s/ü/-/g", but I don't know how to type ü in unix command line. Please help me for this one. Thanks in advance (7 Replies)
Discussion started by: ken6503
7 Replies

10. Shell Programming and Scripting

Remove Special Characters Within Text

Hi, I have a "|" delimited file that is exported from a database. There is one column in the file which has description/comments entered by some application user. It has "Control-M" character and "New Line" character in between the text. Hence, when i export the data, this record with the new... (4 Replies)
Discussion started by: tarun.trehan
4 Replies

LEARN ABOUT DEBIAN

xmlstarlet

XMLSTARLET(1)							 xmlstarlet Manual						     XMLSTARLET(1)

NAME

       xmlstarlet - command line XML/XSLT toolkit

SYNOPSIS

       xmlstarlet [<options>] [<command>] [<cmd-options>]

INTRODUCTION

       XMLStarlet is a set of command line utilities (tools) which can be used to transform, query, validate, and edit XML documents and files us-
       ing simple set of shell commands in similar way it is done for plain text files using UNIX grep, sed, awk, diff, patch, join, etc commands.
       This  set of command line utilities can be used by those who deal with many XML documents on UNIX shell command prompt as well as for auto-
       mated XML processing with shell scripts.

OPTIONS

       --version
	      Display the version of xmlstarlet.

       --help Display help.

COMMANDS

       Type: xmlstarlet <command> --help <ENTER> for command help

       Available commands include:

       ed (or edit)
	      Edit/update XML document(s).

       sel (or select)
	      Select data or query XML document(s) (XPATH, etc).

       tr (or transform)
	      Transform XML documents(s) using XSLT.

       val (or validate)
	      Validate XML document(s) (well-formed/DTD/XSD/RelaxNG).

       fo (or format)
	      Format XML document(s).

       el (or elements)
	      Display element structure of XML document.

       c14n (or canonic)
	      XML canonicalization.

       ls (or list)
	      List directory as XML.

       esc (or escape)
	      Escape special XML characters.

       unesc (or unescape)
	      Unescape special XML characters.

       pyx (or xmln)
	      Convert XML into PYX format (based on ESIS - ISO 8879).

       p2x (or depyx)
	      Convert PYX into XML.

REFERENCES

       XMLStarlet is a command line  toolkit  to  query/edit/check/transform  XML  documents  (for  more  information  see  http://xmlstar.source-
       forge.net/).

AUTHOR

       Mikhail Grushinskiy.

																     XMLSTARLET(1)
All times are GMT -4. The time now is 08:05 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy