Removing Non-printable characters in unix file Post: 302551625

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Best way to search files for non-printable characters?

I need to check ftp'd incoming files for characters that are not alphanumeric,<tab>, <cr>, or <lf> characters. Each file would have 10-20,000 line with up to 3,000 characters per line. Should I use awk, sed, or grep and what would the command look like to do such a search? Thanks much to anyone...

2. Shell Programming and Scripting

grep non printable characters

Sometimes obvious things... are not so obvious. I always thought that it was possible to grep non printable characters but not with my GNU grep (5.2.1) version. printf "Hello\tWorld" | grep -l '\t' printf "Hello\tWorld" | grep -l '\x09' printf "Hello\tWorld" | grep -l '\x{09}' None of them...

3. UNIX for Dummies Questions & Answers

delete non printable characters from file

i have a file which contains non printable characters like enter,escape etc i want to delete them from the file

4. Shell Programming and Scripting

removing non-printable chars from multiple files

How do I remove non-printable characters from all txt files and output the results to one file? I've tried the following: tr -cd '\n' < *.txt > out.txt and it gives ambiguous redirect error. How can I get it to operate on all txt files in the current directory and append the output to...

5. Shell Programming and Scripting

Removing ^M characters from a file

Hi, I want to removing ^M characters from a file and combine the line with the next line. ex: issue i have: ABC^M^M DEF solution i need: ABCDEF I found that you by using the following command you can remove new line characters. tr -d '\r' < infile.csv > outfile.csv still...

6. HP-UX

Non-printable characters

I have been using OKI data Microline printers; models 590 and 591 to print a bar code using the following escape sequence: \E^PA^H^C00^D^C^A^A^A\E^PB^H The escape sequence is stored in a unix file which is edited using vi. Now, we are considering Microline printer model 395C and the bar code...

7. UNIX for Dummies Questions & Answers

removing non printable characters

Hi, in a file, i have records as below: 123|62|absnb|267629 123|267|28728|uiuip 123|567|26761|2676 i want to remove the non printable characters after the end of each record. I guess there are certain charcters but not visible. i don't know what character that is exactly. I used...

8. Shell Programming and Scripting

Unable to grep control/non printable characters

Unable to grep: Able to grep:

9. Shell Programming and Scripting

ksh check for non printable characters in a string

Hi All, I am trying to find non-printable characters in a string. The sting could have alphanumeric, puntuations and characters like (*&%$#.') but not non-printable (or that is what I think they are called) which are introduced when you copy any text from DOS to unix box. Input string1:...

10. Shell Programming and Scripting

Redirecting records with non-printable characters

Hi, I have a huge file (50 Mil rows) which has certain non-printable ASCII characters in it. I am cleaning the file by deleting those characters using the following command - tr -cd '\11\12\15\40-\176' < unclean_file > clean_file Please note that I am excluding the following - tab,...

LEARN ABOUT OPENSOLARIS

dumpcs

dumpcs(1)							   User Commands							 dumpcs(1)

NAME

       dumpcs - show codeset table for the current locale

SYNOPSIS

       dumpcs [-0123vw]

DESCRIPTION

       dumpcs  shows a list of printable characters for the user's current locale, along with their hexadecimal code values. The display device is
       assumed to be capable of displaying characters for a given locale. With no option, dumpcs displays the entire list of printable	characters
       for the current locale.

       With one or more numeric options specified, it shows EUC codeset(s) for the current locale according to the numbers specified, and in order
       of codeset number. Each non-printable character is represented by an asterisk "*" and enough ASCII space character(s) to  fill  that  code-
       set's column width.

OPTIONS

       -0     Show ASCII (or EUC primary) codeset.

       -1     Show EUC codeset 1, if used for the current locale.

       -2     Show EUC codeset 2, if used for the current locale.

       -3     Show EUC codeset 3, if used for the current locale.

       -v     "Verbose".  Normally,  ranges  of  non-printable characters are collapsed into a single line. This option produces one line for each
	      non-printable character.

       -w     Replace code values with corresponding wide character values (process codes).

ENVIRONMENT VARIABLES

       The environment variables LC_CTYPE and LANG control the character classification throughout dumpcs. On entry to dumpcs,	these  environment
       variables  are  checked in that order. This implies that a new setting for LANG does not override the setting of LC_CTYPE. When none of the
       values is valid, the character classification defaults to the POSIX.1 "C" locale.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------------------------------------+
       |ATTRIBUTE TYPE		      ATTRIBUTE VALUE		   |
       |Availability		      SUNWcsu			   |
       +-----------------------------------------------------------+

SEE ALSO

       localedef(1), attributes(5)

NOTES

       dumpcs can only handle EUC locales.

SunOS 5.11							    20 Dec 1996 							 dumpcs(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Best way to search files for non-printable characters?

Discussion started by: jvander

2. Shell Programming and Scripting

grep non printable characters

Discussion started by: ripat

3. UNIX for Dummies Questions & Answers

delete non printable characters from file

Discussion started by: alokjyotibal

4. Shell Programming and Scripting

removing non-printable chars from multiple files

Discussion started by: revax