Read file and remove special characters or strings Post: 302445671

Sponsored Content

Top Forums Shell Programming and Scripting Read file and remove special characters or strings Post 302445671 by vasuarjula on Tuesday 17th of August 2010 12:30:00 AM

08-17-2010

Registered User

Read file and remove special characters or strings

Hello all

I am getting data like

Code:

col1 | col2 | col3
asdafa | asdfasfa | asf*&^sg�
345./ |sdfasd23425^%^&^ | sdfsa23
�sfsfd | sf(* | sdfsasf

My requirement is like
I have to to read the file and remove all special characters and hex characters ranging form 00-1f from 1st column, remove %"' from second column and leave third columns as is and put the formatted file to new file.
How can i achive this. Each column has its own special character removal structure.

Please reply. I appreciate your response.

---------- Post updated 08-17-10 at 12:30 AM ---------- Previous update was 08-16-10 at 02:29 PM ----------

Please respond. I appreciate your help

Last edited by Franklin52; 08-17-2010 at 05:18 AM.. Reason: Placing correct code tags

vasuarjula

View Public Profile for vasuarjula

Find all posts by vasuarjula

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to Remove Special Characters

Dear Members, We have a file which contains some special characters. I need to replace these special character by a new line character(\n). The Special character is \x85. I am not sure what this character means and how we can remove it. Any inputs are greatly appreciated. Thanks...

2. Shell Programming and Scripting

Remove special characters from text file

Hi All, i am trying to remove all special charecters().,/\~!@#%^$*&^_- and others from a tab delimited file. I am using the following code. while read LINE do echo $LINE | tr -d '=;:`"<>,./?!@#$%^&(){}'|tr -d "-"|tr -d "'" | tr -d "_" done < trial.txt > output.txt Problem ...

3. Shell Programming and Scripting

remove special characters

hello all I am writing a perl code and i wish to remove the special characters for text. I wish to remove all extended ascii characters. If the list of special characters is huge, how can i do this using substitute command s/specialcharacters/null/g I really want to code like...

4. Solaris

How to remove a directory or file with special characters in Solaris

I finally figured out how to remove a file or directory with special characters in the name. It's kind of rudimentary so I thought I would share it with everyone: find .inum -exec rm -rf {} \;

5. Shell Programming and Scripting

remove the special characters and move the file into another server

6. UNIX for Advanced & Expert Users

What my puzzle file!, How to remove special characters ??

My application generate file but it have special characters in these file. I would like to clear special characters by vi editor and not use cat /dev/null > to_file I try to remove characters manually, but I'm can not! root@MyHost /tmp> ls -l puzzle.txt -rw-r--r-- 1 root system ...

7. Shell Programming and Scripting

How to remove special characters?

Hi Gurus, I have file which contains some unicode charachator like "�". I want to replace it with some charactors. I searched in internet and got command sed "s/�/-/g", but I don't know how to type � in unix command line. Please help me for this one. Thanks in advance

8. Shell Programming and Scripting

How to remove alphabets/special characters/space in the 5th field of a tab delimited file?

Thank you for 4 looking this post. We have a tab delimited file where we are facing problem in a lot of funny character. I have tried using awk but failed that is not working. In the 5th field ID which is supposed to be a integer only of that file, we are getting corrupted data as below. I...

9. UNIX for Beginners Questions & Answers

To remove any invisible and special characters from the file(exclude @!#$&*)

Hi Guys, My requirement is to remove any invisible and special characters from the file like control M(carriage return) and alt numerics and it should not replace @#!$% abc|xyz|acd�� adc|123| 12�� Please help on this. Thanks Rakesh

10. UNIX for Advanced & Expert Users

To remove any invisible and special characters from the file(exclude @#!$*)

LEARN ABOUT FREEBSD

colrm

COLRM(1)						    BSD General Commands Manual 						  COLRM(1)

NAME

     colrm -- remove columns from a file

SYNOPSIS

     colrm [start [stop]]

DESCRIPTION

     The colrm utility removes selected columns from the lines of a file.  A column is defined as a single character in a line.  Input is read
     from the standard input.  Output is written to the standard output.

     If only the start column is specified, columns numbered less than the start column will be written.  If both start and stop columns are spec-
     ified, columns numbered less than the start column or greater than the stop column will be written.  Column numbering starts with one, not
     zero.

     Tab characters increment the column count to the next multiple of eight.  Backspace characters decrement the column count by one.

ENVIRONMENT

     The LANG, LC_ALL and LC_CTYPE environment variables affect the execution of colrm as described in environ(7).

EXIT STATUS

     The colrm utility exits 0 on success, and >0 if an error occurs.

SEE ALSO

     awk(1), column(1), cut(1), paste(1)

HISTORY

     The colrm command appeared in 3.0BSD.

BSD
								  August 4, 2004							       BSD