12-21-2012
Hi,
Today i faced a problem in which the file at Unix had the characters like � and it caused the file processing failure at downstream end which is Mainframe. and it somehow identified by the Mainframe and notified to me, so i removed the above mentioned by going to the particular line and removed the characters and it got processed successfully.
Could you please help me to find these characters like non-standard characters in a file?
Hope now this makes sense and clear..!
Chandru.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I am working on AIX. We ftp files to a database. The flat files are having thousands of records and each record is having some 50 to 60 characters(there are fields having certain character length). In addition to some valid ascii characters some invalid characters like Å, å, Ä, ä or pipes creep in which... (5 Replies)
Discussion started by: kanu_pathak
5 Replies
2. UNIX for Dummies Questions & Answers
I am working on AIX. We ftp files to a database. The flat files are having thousands of records and each record is having some 50 to 60 characters(there are fields having certain character length). In addition to some valid ascii characters some invalid characters like Å, å, Ä, ä or pipes creep in which... (15 Replies)
Discussion started by: kanu_pathak
15 Replies
3. Programming
This is a pretty straight-forward question. Within a program of mine, I have a string that's going to be used as a filename, but it might have some invalid characters in it that wouldn't be valid in a filename. If there are any invalid characters, I want to get rid of them and essentially squeeze... (4 Replies)
Discussion started by: cleopard
4 Replies
4. Shell Programming and Scripting
Hi,
I have to write s script to check an input file for invalid characters. In this script I have to find the exact line of the invalid character. If the input file contain 2 invalid character sat line 10 and 17, the script will show the value 10 and 17. Any help is appreciated. (3 Replies)
Discussion started by: beginner82
3 Replies
5. UNIX for Dummies Questions & Answers
there is a file is generated from my program due to undefined filename.
-rw-r--r-- 1 angie angie 8644055 Jun 22 09:17 Ô$ÿÿÿÿÿÆ
may i know how to delete this file..??? thanks in advance... :) (5 Replies)
Discussion started by: chxxangie
5 Replies
6. Shell Programming and Scripting
HI,
I have a source file which has the below data.
Tableid,table.txt
sourceid,1,2,3,4,5,6
targetid,1,2,3,4,5,6
Tableid,table
sourceid,1,2,3,4,5,6
targetid,1,2,3,4,5,6
Tableid,table.txt
sourceid,1,2,3,4,5,6
targetid,1,2,3,4,5,6
Tableid,table
sourceid,1,2,3,4,5,6
targetid,1,2,3,4,5,6... (6 Replies)
Discussion started by: shruthidwh
6 Replies
7. Shell Programming and Scripting
Hi All -
I'm building a script wherein it is design to remove characters that are not accepted on a non-unicode database. Examples are the following: ï,¿,½,Â,é, etc.
I can easily sed those characters one-by-one but I there's a problem when other unicode characters are found. Is there any way to... (1 Reply)
Discussion started by: Jin_
1 Replies
8. Shell Programming and Scripting
Hi All,
How to validate the 4th column,it is date column in the file, if it valid move to valid file else moved invalid file.
9f680174-cb87|20077337254|0|20120511|N
9f680174-cb88|20077337254|0|20120534|N
i want two file valid.txt and invalid.txt
Thanks, (7 Replies)
Discussion started by: bmk
7 Replies
9. Shell Programming and Scripting
My Input file is fixed length record ends with . as end of the line and the character length is 4156
Example:
12234XYZ TY^4253$+00000-00000...........
I need to check is there any control characters(like ^M,^Z)
The line will be splitted
awk
'{id=substr($0,1,5)
nm=substr($0,6,3)... (2 Replies)
Discussion started by: dineshaila
2 Replies
10. UNIX for Beginners Questions & Answers
Hello guys,
Here i am writing a script to check for a valid url from a file,i am getting the valid url & i print it in a file and i want to print the invalid url also.how to do that?
#here is my script
if
then
URL=$(grep -E -o... (2 Replies)
Discussion started by: Meeran Rizvi
2 Replies
TR(1) General Commands Manual TR(1)
NAME
tr - translate characters
SYNOPSIS
tr [ -cds ] [ string1 [ string2 ] ]
DESCRIPTION
Tr copies the standard input to the standard output with substitution or deletion of selected characters. Input characters found in
string1 are mapped into the corresponding characters of string2. When string2 is short it is padded to the length of string1 by duplicat-
ing its last character. Any combination of the options -cds may be used: -c complements the set of characters in string1 with respect to
the universe of characters whose ASCII codes are 01 through 0377 octal; -d deletes all input characters in string1; -s squeezes all strings
of repeated output characters that are in string2 to single characters.
In either string the notation a-b means a range of characters from a to b in increasing ASCII order. The character `' followed by 1, 2 or
3 octal digits stands for the character whose ASCII code is given by those digits. A `' followed by any other character stands for that
character.
The following example creates a list of all the words in `file1' one per line in `file2', where a word is taken to be a maximal string of
alphabetics. The second string is quoted to protect `' from the Shell. 012 is the ASCII code for newline.
tr -cs A-Za-z '