Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Best way to search files for non-printable characters?
Top Forums Shell Programming and Scripting Best way to search files for non-printable characters? Post 68057 by jvander on Wednesday 30th of March 2005 02:41:43 PM
Old 03-30-2005
Best way to search files for non-printable characters?
I need to check ftp'd incoming files for characters that are not alphanumeric,<tab>, <cr>, or <lf> characters. Each file would have 10-20,000 line with up to 3,000 characters per line. Should I use awk, sed, or grep and what would the command look like to do such a search? Thanks much to anyone who could point me in the right direction.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Search For Control M characters in files

Hi , I have special character control M in many of my files as below ersNet-Telnet-3.03/Makefile.PL100644 21166 144 612 7113770214 135 77 0ustar jayusers## -*- Perl -*-^M ^M use ExtUtils::MakeMaker qw(WriteMakefile);^M ^M WriteMakefile(NAME => "Net::Telnet",^M ... (4 Replies)
Discussion started by: Mohammed
4 Replies

2. Shell Programming and Scripting

grep non printable characters

Sometimes obvious things... are not so obvious. I always thought that it was possible to grep non printable characters but not with my GNU grep (5.2.1) version. printf "Hello\tWorld" | grep -l '\t' printf "Hello\tWorld" | grep -l '\x09' printf "Hello\tWorld" | grep -l '\x{09}' None of them... (3 Replies)
Discussion started by: ripat
3 Replies

3. UNIX for Dummies Questions & Answers

delete non printable characters from file

i have a file which contains non printable characters like enter,escape etc i want to delete them from the file (2 Replies)
Discussion started by: alokjyotibal
2 Replies

4. HP-UX

Non-printable characters

I have been using OKI data Microline printers; models 590 and 591 to print a bar code using the following escape sequence: \E^PA^H^C00^D^C^A^A^A\E^PB^H The escape sequence is stored in a unix file which is edited using vi. Now, we are considering Microline printer model 395C and the bar code... (3 Replies)
Discussion started by: Joy Conner
3 Replies

5. Shell Programming and Scripting

Removing Non-printable characters in unix file

Hi, We have a non printable character "®" in our file , we want to remove this character, we tried tr -dc '' < oldfile> newfile but this command is removing all new line entries along with the non printable character and all the records are coming in one line(it is changing the format of the... (2 Replies)
Discussion started by: pyaranoid
2 Replies

6. UNIX for Dummies Questions & Answers

removing non printable characters

Hi, in a file, i have records as below: 123|62|absnb|267629 123|267|28728|uiuip 123|567|26761|2676 i want to remove the non printable characters after the end of each record. I guess there are certain charcters but not visible. i don't know what character that is exactly. I used... (2 Replies)
Discussion started by: pandeesh
2 Replies

7. Shell Programming and Scripting

Unable to grep control/non printable characters

Unable to grep: Able to grep: (11 Replies)
Discussion started by: proactiveaditya
11 Replies

8. Shell Programming and Scripting

Recursivley search files and replace the characters

1st_FILE.cnf Here is my sample test file . This will be replaced by . 2nd_FILE.cnf This is my 2nd test file ..This is agian a test file for purpose. variable.txt TST_FILE=1st_FILE.txt FILE_NAME=1st_FILE.txt 2ND_TST_FILE=2nd_FILE.txt REASON=test I have 2 sample config file under... (13 Replies)
Discussion started by: manas_ranjan
13 Replies

9. Shell Programming and Scripting

ksh check for non printable characters in a string

Hi All, I am trying to find non-printable characters in a string. The sting could have alphanumeric, puntuations and characters like (*&%$#.') but not non-printable (or that is what I think they are called) which are introduced when you copy any text from DOS to unix box. Input string1:... (10 Replies)
Discussion started by: dips_ag
10 Replies

10. Shell Programming and Scripting

Redirecting records with non-printable characters

Hi, I have a huge file (50 Mil rows) which has certain non-printable ASCII characters in it. I am cleaning the file by deleting those characters using the following command - tr -cd '\11\12\15\40-\176' < unclean_file > clean_file Please note that I am excluding the following - tab,... (6 Replies)
Discussion started by: rishigc
6 Replies

LEARN ABOUT SUSE

look

LOOK(1) 						    BSD General Commands Manual 						   LOOK(1)

NAME

     look -- display lines beginning with a given string

SYNOPSIS

     look [-dfa] [-t termchar] string [file]

DESCRIPTION

     The look utility displays any lines in file which contain string as a prefix.  As look performs a binary search, the lines in file must be
     sorted (where sort(1) got the same options -d and/or -f that look is invoked with).

     If file is not specified, the file /usr/share/dict/words is used, only alphanumeric characters are compared and the case of alphabetic char-
     acters is ignored.

     Options:

     -d      Dictionary character set and order, i.e. only alphanumeric characters are compared. (On by default if no file specified).

     -f      Ignore the case of alphabetic characters. (On by default if no file specified).

     -a      Use the alternate dictionary /usr/share/dict/web2

     -t      Specify a string termination character, i.e. only the characters in string up to and including the first occurrence of termchar are
	     compared.

     The look utility exits 0 if one or more lines were found and displayed, 1 if no lines were found, and >1 if an error occurred.

FILES

     /usr/share/dict/words  the dictionary
     /usr/share/dict/web2   the alternate dictionary

SEE ALSO

     grep(1), sort(1)

COMPATIBILITY

     The original manual page stated that tabs and blank characters participated in comparisons when the -d option was specified.  This was incor-
     rect and the current man page matches the historic implementation.

HISTORY

     Look appeared in Version 7 AT&T Unix.

AVAILABILITY

     The look command is part of the util-linux-ng package and is available from ftp://ftp.kernel.org/pub/linux/utils/util-linux-ng/.

BSD
								   June 14, 1993							       BSD
All times are GMT -4. The time now is 10:28 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy