Identifying and removing control characters in a file.

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need to strip control-A characters from a column in a file

Hi All, I currently have flat file with 32 columns. The field delimiter is cntl-A ( \x01). The file has been extracted from an oracle table using a datastage job. However, in the 6th field, the data contains additional control -A characters which came as a part of the table data. I need...

2. Red Hat

Special control characters in file

Hi Guys, We receive some huge files on to Linux server. Source system use FTP mechanism to transfer these files on our server. Occasionally one record is getting corrupted while transfer, some control characters are injecting into the file. How to fix this issue ? please advice ? Sample...

3. Shell Programming and Scripting

How to view the control characters in a file?

Hello, How can I view control and special characters of a text file?. For example, space, tabs, new line chars etc. Can I use hexdump for it? Thanks

4. Shell Programming and Scripting

Help in removing control M and Line feed in output file.

Hi All, In my output file i am getting control m character and also the line feeds at different places and with different combinations, the content of the file is supposed to be in a single line but if there is a line feed in between then from there onwards it's going into new line. I tried...

5. UNIX for Dummies Questions & Answers

[Solved] Removing control-m characters from shell script

Hi All, I need to remove control m character from a file. Steps which i am doing in shell script are: 1) We are comparing the header of the file to the database table header Here the file header has control-m characters. How do i remove it. Please help. Below are the steps i am using,...

6. Shell Programming and Scripting

Removing special characters - Control M

I have developed a small script to remove the Control M characters that get embedded when we move any file from Windows to Unix. For some reason, its not working in all scenarios. Some times I still see the ^M not being removed. Is there anything missing in the script: cd ${inputDir}...

7. Shell Programming and Scripting

Removing ^M characters from a file

Hi, I want to removing ^M characters from a file and combine the line with the next line. ex: issue i have: ABC^M^M DEF solution i need: ABCDEF I found that you by using the following command you can remove new line characters. tr -d '\r' < infile.csv > outfile.csv still...

8. Shell Programming and Scripting

display all possible control characters from .xml file in unix

Hi, I have a .xml file in unix. We are passing this file through a xml parser. But we are getting some control characters from input file and XML parser is failing for the control character in file.Now I am getting following error, Error at byte 243206625 of file filename_$.xml: Error...

9. Shell Programming and Scripting

Hidden control characters in a Unix Text File!

Can anyone seem to know how to find out whether a UNIX text file has 'hidden' control characters? Can I view them using 'vi' by some command line options? If there are control characters in a text file which are invisible/hidden.. then how do I get rid of them? Your intelletual answers are...

10. UNIX for Dummies Questions & Answers

Identifying invisible characters in Unix file

I have a file, which when you look at it, appears as if it has spaces.... But sometimes, it is has tab or Nulls or some other character which we are not able to see..... How to find what character exactly it is in the file, where ever we are seeing a space... (Iam in solaris)...

LEARN ABOUT OSX

asa

ASA(1)							    BSD General Commands Manual 						    ASA(1)

NAME

     asa -- interpret carriage-control characters.

SYNOPSIS

     asa [file ...]

DESCRIPTION

     The asa utility reads files sequentially, mapping FORTRAN carriage-control characters to line-printer control sequences, and writes them to
     the standard output.

     The first character of each line is interpreted as a carriage-control character.  The following characters are interpreted as follows:

     <space>  Output the rest of the line without change.

     0	      Output a <newline> character before printing the rest of the line.

     1	      Output a <formfeed> character before printing the rest of the line.

     +	      The trailing <newline> of the previous line is replaced by a <carriage-return> before printing the rest of the line.

     Lines beginning with characters other than the above are treated as if they begin with <space>.

EXAMPLES

     To view a file containing the output of a FORTRAN program:
	   asa file

     To format the output of a FORTRAN program and redirect it to a line-printer.
	   a.out | asa | lpr

DIAGNOSTICS

     The asa utility exit 0 on success, and >0 if an error occurs.

SEE ALSO

     f77(1)

STANDARDS

     The asa utility conforms to IEEE Std 1003.2-1992 (``POSIX.2'').

AUTHORS

     J.T. Conklin, Winning Strategies, Inc.

BSD
								September 23, 1993							       BSD

Programming