12-11-2013
Remove all junk characters from a text file
I am using flatfile, in that flat file we are getting the junk chars
1)I21001f<82>^Me<85>!h49 Service Charge
2) I21001f‚
e...!h49 Service Charge
please tell me how to remove all junk chars in unix scripts.
10 More Discussions You Might Find Interesting
1. Solaris
Hello All,
I have a DOS file which I run a DOS 2 UNIX utility on. When run from Solaris, I can view the file perfectly. But, when run from linux, I see a bunch of junk(^@) at the beginning of every line in the file. Does anyone know the cause of this?
COMMAND TO CONVERT:
tr -d '\015\032'... (7 Replies)
Discussion started by: vada010
7 Replies
2. Shell Programming and Scripting
Can anyone tell me how to read a file in perl having junk characters . I have only one junk character which is repeated many times in the file. While i'm reading and printing the file , it is displaying till the 1st occurence of that junk character and rest of the file is not being read. (1 Reply)
Discussion started by: k_surya
1 Replies
3. Shell Programming and Scripting
what is the sed command to remove the first two characters of every line of a text file?
each line of the text file has the same amount of characters, and they are ALL NUMERIC. there are hundreds of lines though.
for example,
>cat file1.txt
10081551
10081599
10082234
10082259
20081134... (20 Replies)
Discussion started by: ajp7701
20 Replies
4. Shell Programming and Scripting
Guys,
can you help me in removing the junk character "^S" from the below line using perl
Reference Data Not Recognised ^S Where a value is provided by the consuming system, which is not reco
Thanks,
M.Mohan (1 Reply)
Discussion started by: mohan_xunil
1 Replies
5. Shell Programming and Scripting
Hi All,
i am trying to remove all special charecters().,/\~!@#%^$*&^_- and others from a tab delimited file.
I am using the following code.
while read LINE
do
echo $LINE | tr -d '=;:`"<>,./?!@#$%^&(){}'|tr -d "-"|tr -d "'" | tr -d "_"
done < trial.txt > output.txt
Problem
... (10 Replies)
Discussion started by: kkb
10 Replies
6. UNIX for Dummies Questions & Answers
Hello sir,
I have generated XML file from VS 2005. It works well in windows but it shows some junk characters in unix.
Can any help me with this problem.
Thank you in advance.
Hema (6 Replies)
Discussion started by: hemavenkatesh
6 Replies
7. UNIX for Dummies Questions & Answers
hi guys,
I am generating a file from datastage (an etl tool).
Now the file is having some junk characters like ( Á,L´±,ñ and so on)..
I want to use the grep function to figure out all the junk characters and their location.
Can somebody help me out in finding it out.. if possible i... (1 Reply)
Discussion started by: mac4rfree
1 Replies
8. UNIX for Dummies Questions & Answers
Hi
I have to remove the junk characters from my file. Please help..
File content :
CURITY_CODE_GSD) FROM� DL_CB_SOD_EOD_VALUATION WHERE� ASOF (1 Reply)
Discussion started by: arukuku
1 Replies
9. UNIX for Dummies Questions & Answers
I would like to remove all characters starting with "%" and ending with ")" in the 4th field - please help!!
1412007819.864 /device/services/heartbeatxx 204 0.547%!i(int=0) 0.434 0.112
1412007819.866 /device/services/heartbeatxx 204 0.547%!i(int=1) 0.423 0.123... (10 Replies)
Discussion started by: snemuk14
10 Replies
10. UNIX for Beginners Questions & Answers
Hi All,
I have a issue that we are getting Junk characters from source and i am not able to load that records to Database.
Line breakers
Junk Characters (Â and different every time)
Japanese Characters
Every time I am using grep command and awk -F "\007" to find them and delete that... (1 Reply)
Discussion started by: spradeep86
1 Replies
LEARN ABOUT DEBIAN
elvfmt
ELVFMT(1) User commands ELVFMT(1)
NAME
elvfmt - adjust line-length for paragraphs of text
SYNOPSIS
elvfmt [-w width | -width] [-s] [-c] [-i chars] [-C] [-M] [file]...
VERSION
This page describes the Elvis 2.2_0 version of elvfmt. See elvis(1).
DESCRIPTION
elvfmt is a simple text formatter. It inserts or deletes newlines, as necessary, to make all lines in a paragraph be approximately the
same width. It preserves indentation and word spacing.
If you don't name any files on the command line, then elvfmt will read from stdin.
It is typically used from within vi(1) or elvis(1) to adjust the line breaks in a single paragraph. To do this, move the cursor to the top
of the paragraph, type "!}elvfmt", and hit <Return>.
OPTIONS
-w width or -width
Use a line width of width characters instead of the default of 72 characters.
-s Don't join lines shorter than the line width to fill paragraphs.
-c Try to be smarter about crown margins. Specifically, this tells elvfmt to expect the first line of each paragraph to have a differ-
ent indentation than subsequent lines. If text from the first input line is wrapped onto the second output line, then elvfmt will
scan ahead to figure out what indentation it should use for the second output line, instead of reusing the first line's indentation.
-i chars
Allow the indentation text to include any character from chars, in addition to spaces and tabs. You should quote the chars list to
protect it from the shell.
-C and -M
These are shortcuts for combinations of other flags. is short for and is useful for reformatting C/C++ comments. is short for
and is useful for reformatting email messages.
SEE ALSO
vi(1), elvis(1)
AUTHOR
Steve Kirkendall
kirkenda@cs.pdx.edu
ELVFMT(1)