UNIX for Dummies Questions & Answers

Hello,

Can any one help me in below query to search all the invalid characters that UNIX cannot recognize from a file. can we do anything with the help of grep command or any other commands.

Also, i am not sure what are the invalid characters present in the file.

Many thanks in advance.

Regards,
Chandru

I'm pretty sure you won't get any other reply to this post. You don't specify the problem, you don't post input nor output files, the query you are referring to is missing - what kind of help do you expect?

Hi,
Today i faced a problem in which the file at Unix had the characters like � and it caused the file processing failure at downstream end which is Mainframe. and it somehow identified by the Mainframe and notified to me, so i removed the above mentioned by going to the particular line and removed the characters and it got processed successfully.

Could you please help me to find these characters like non-standard characters in a file?

Hope now this makes sense and clear..!

Chandru.

Hey,

Just make a try with your input file.

Code:

perl -nle 'chomp($_);if(my @a = $_ =~ m/(\P{IsASCII})/g){print "@a";}' input_file

Cheers,
Ranga

Hi Ranga,

Thanks for your input. I will try it out and post the output of it.

Chandru.

---------- Post updated at 07:17 AM ---------- Previous update was at 06:56 AM ----------

Hi Ranga,

Thank you. It works..

It displays the output as

ï ¿ ½

is displayed the characters as i had given .

Could you please help me further in understanding your script to find out these characters from the file. Also can you please let me know what are all the non-standard characters this script includes?

- Chandru.

Hey,

What we are doing this script is, just printing the character which don't comes under ASCII standard.

It will display the characters which not comes under ASCII table.

Cheers,
Ranga

Thanks Ranga..