Sponsored Content
Top Forums Shell Programming and Scripting Remove all junk characters from a text file Post 302879210 by Talari on Wednesday 11th of December 2013 09:36:31 AM
Old 12-11-2013
Remove all junk characters from a text file

I am using flatfile, in that flat file we are getting the junk chars

1)I21001f<82>^Me<85>!h49 Service Charge

2) I21001f‚
e...!h49 Service Charge

please tell me how to remove all junk chars in unix scripts.
 

10 More Discussions You Might Find Interesting

1. Solaris

Junk characters in file not in Solaris, but visible in linux

Hello All, I have a DOS file which I run a DOS 2 UNIX utility on. When run from Solaris, I can view the file perfectly. But, when run from linux, I see a bunch of junk(^@) at the beginning of every line in the file. Does anyone know the cause of this? COMMAND TO CONVERT: tr -d '\015\032'... (7 Replies)
Discussion started by: vada010
7 Replies

2. Shell Programming and Scripting

Reading a file having junk characters in perl

Can anyone tell me how to read a file in perl having junk characters . I have only one junk character which is repeated many times in the file. While i'm reading and printing the file , it is displaying till the 1st occurence of that junk character and rest of the file is not being read. (1 Reply)
Discussion started by: k_surya
1 Replies

3. Shell Programming and Scripting

sed to remove 1st two characters every line of text file

what is the sed command to remove the first two characters of every line of a text file? each line of the text file has the same amount of characters, and they are ALL NUMERIC. there are hundreds of lines though. for example, >cat file1.txt 10081551 10081599 10082234 10082259 20081134... (20 Replies)
Discussion started by: ajp7701
20 Replies

4. Shell Programming and Scripting

Remove junk characters using Perl

Guys, can you help me in removing the junk character "^S" from the below line using perl Reference Data Not Recognised ^S Where a value is provided by the consuming system, which is not reco Thanks, M.Mohan (1 Reply)
Discussion started by: mohan_xunil
1 Replies

5. Shell Programming and Scripting

Remove special characters from text file

Hi All, i am trying to remove all special charecters().,/\~!@#%^$*&^_- and others from a tab delimited file. I am using the following code. while read LINE do echo $LINE | tr -d '=;:`"<>,./?!@#$%^&(){}'|tr -d "-"|tr -d "'" | tr -d "_" done < trial.txt > output.txt Problem ... (10 Replies)
Discussion started by: kkb
10 Replies

6. UNIX for Dummies Questions & Answers

XML file shows Junk Characters in UNIX

Hello sir, I have generated XML file from VS 2005. It works well in windows but it shows some junk characters in unix. Can any help me with this problem. Thank you in advance. Hema (6 Replies)
Discussion started by: hemavenkatesh
6 Replies

7. UNIX for Dummies Questions & Answers

how to grep junk characters in a file

hi guys, I am generating a file from datastage (an etl tool). Now the file is having some junk characters like ( Á,L´±,ñ and so on).. I want to use the grep function to figure out all the junk characters and their location. Can somebody help me out in finding it out.. if possible i... (1 Reply)
Discussion started by: mac4rfree
1 Replies

8. UNIX for Dummies Questions & Answers

How to remove JUNK characters (FROM�)

Hi I have to remove the junk characters from my file. Please help.. File content : CURITY_CODE_GSD) FROM� DL_CB_SOD_EOD_VALUATION WHERE� ASOF (1 Reply)
Discussion started by: arukuku
1 Replies

9. UNIX for Dummies Questions & Answers

How to replace and remove few junk characters from a specific field?

I would like to remove all characters starting with "%" and ending with ")" in the 4th field - please help!! 1412007819.864 /device/services/heartbeatxx 204 0.547%!i(int=0) 0.434 0.112 1412007819.866 /device/services/heartbeatxx 204 0.547%!i(int=1) 0.423 0.123... (10 Replies)
Discussion started by: snemuk14
10 Replies

10. UNIX for Beginners Questions & Answers

Need to remove Junk characters

Hi All, I have a issue that we are getting Junk characters from source and i am not able to load that records to Database. Line breakers Junk Characters (Â and different every time) Japanese Characters Every time I am using grep command and awk -F "\007" to find them and delete that... (1 Reply)
Discussion started by: spradeep86
1 Replies
io_lib(3erl)						     Erlang Module Definition						      io_lib(3erl)

NAME
io_lib - IO Library Functions DESCRIPTION
This module contains functions for converting to and from strings (lists of characters). They are used for implementing the functions in the io module. There is no guarantee that the character lists returned from some of the functions are flat, they can be deep lists. lists:flatten/1 can be used for flattening deep lists. DATA TYPES
chars() = [char() | chars()] EXPORTS
nl() -> chars() Returns a character list which represents a new line character. write(Term) -> write(Term, Depth) -> chars() Types Term = term() Depth = int() Returns a character list which represents Term . The Depth (-1) argument controls the depth of the structures written. When the specified depth is reached, everything below this level is replaced by "...". For example: 1> lists:flatten(io_lib:write({1,[2],[3],[4,5],6,7,8,9})). "{1,[2],[3],[4,5],6,7,8,9}" 2> lists:flatten(io_lib:write({1,[2],[3],[4,5],6,7,8,9}, 5)). "{1,[2],[3],[...],...}" print(Term) -> print(Term, Column, LineLength, Depth) -> chars() Types Term = term() Column = LineLenght = Depth = int() Also returns a list of characters which represents Term , but breaks representations which are longer than one line into many lines and indents each line sensibly. It also tries to detect and output lists of printable characters as strings. Column is the starting column(1), LineLength the maximum line length(80), and Depth (-1) the maximum print depth. fwrite(Format, Data) -> format(Format, Data) -> chars() | UnicodeList Types Format = atom() | string() | binary() Data = [term()] UnicodeList = [Unicode] Unicode = int() representing valid unicode codepoint Returns a character list which represents Data formatted in accordance with Format . See io:fwrite/1,2,3 for a detailed description of the available formatting options. A fault is generated if there is an error in the format string or argument list. If (and only if) the Unicode translation modifier is used in the format string (i.e. ~ts or ~tc), the resulting list may contain characters beyond the ISO-latin-1 character range (in other words, numbers larger than 255). If so, the result is not an ordinary Erlang string(), but can well be used in any context where Unicode data is allowed. fread(Format, String) -> Result Types Format = String = string() Result = {ok, InputList, LeftOverChars} | {more, RestFormat, Nchars, InputStack} | {error, What} InputList = chars() LeftOverChars = string() RestFormat = string() Nchars = int() InputStack = chars() What = term() Tries to read String in accordance with the control sequences in Format . See io:fread/3 for a detailed description of the available formatting options. It is assumed that String contains whole lines. It returns: {ok, InputList, LeftOverChars} : The string was read. InputList is the list of successfully matched and read items, and LeftOverChars are the input characters not used. {more, RestFormat, Nchars, InputStack} : The string was read, but more input is needed in order to complete the original format string. RestFormat is the remaining for- mat string, NChars the number of characters scanned, and InputStack is the reversed list of inputs matched up to that point. {error, What} : The read operation failed and the parameter What gives a hint about the error. Example: 3> io_lib:fread("~f~f~f", "15.6 17.3e-6 24.5"). {ok,[15.6,1.73e-5,24.5],[]} fread(Continuation, String, Format) -> Return Types Continuation = see below String = Format = string() Return = {done, Result, LeftOverChars} | {more, Continuation} Result = {ok, InputList} | eof | {error, What} InputList = chars() What = term()() LeftOverChars = string() This is the re-entrant formatted reader. The continuation of the first call to the functions must be [] . Refer to Armstrong, Vird- ing, Williams, 'Concurrent Programming in Erlang', Chapter 13 for a complete description of how the re-entrant input scheme works. The function returns: {done, Result, LeftOverChars} : The input is complete. The result is one of the following: {ok, InputList} : The string was read. InputList is the list of successfully matched and read items, and LeftOverChars are the remaining charac- ters. eof : End of file has been encountered. LeftOverChars are the input characters not used. {error, What} : An error occurred and the parameter What gives a hint about the error. {more, Continuation} : More data is required to build a term. Continuation must be passed to fread/3 , when more data becomes available. write_atom(Atom) -> chars() Types Atom = atom() Returns the list of characters needed to print the atom Atom . write_string(String) -> chars() Types String = string() Returns the list of characters needed to print String as a string. write_char(Integer) -> chars() Types Integer = int() Returns the list of characters needed to print a character constant in the ISO-latin-1 character set. indentation(String, StartIndent) -> int() Types String = string() StartIndent = int() Returns the indentation if String has been printed, starting at StartIndent . char_list(Term) -> bool() Types Term = term() Returns true if Term is a flat list of characters in the ISO-latin-1 range, otherwise it returns false . deep_char_list(Term) -> bool() Types Term = term() Returns true if Term is a, possibly deep, list of characters in the ISO-latin-1 range, otherwise it returns false . printable_list(Term) -> bool() Types Term = term() Returns true if Term is a flat list of printable ISO-latin-1 characters, otherwise it returns false . Ericsson AB stdlib 1.17.3 io_lib(3erl)
All times are GMT -4. The time now is 11:44 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy