Remove all junk characters from a text file Post: 302879213

10 More Discussions You Might Find Interesting

1. Solaris

Junk characters in file not in Solaris, but visible in linux

Hello All, I have a DOS file which I run a DOS 2 UNIX utility on. When run from Solaris, I can view the file perfectly. But, when run from linux, I see a bunch of junk(^@) at the beginning of every line in the file. Does anyone know the cause of this? COMMAND TO CONVERT: tr -d '\015\032'...

2. Shell Programming and Scripting

Reading a file having junk characters in perl

Can anyone tell me how to read a file in perl having junk characters . I have only one junk character which is repeated many times in the file. While i'm reading and printing the file , it is displaying till the 1st occurence of that junk character and rest of the file is not being read.

3. Shell Programming and Scripting

sed to remove 1st two characters every line of text file

what is the sed command to remove the first two characters of every line of a text file? each line of the text file has the same amount of characters, and they are ALL NUMERIC. there are hundreds of lines though. for example, >cat file1.txt 10081551 10081599 10082234 10082259 20081134...

4. Shell Programming and Scripting

Remove junk characters using Perl

Guys, can you help me in removing the junk character "^S" from the below line using perl Reference Data Not Recognised ^S Where a value is provided by the consuming system, which is not reco Thanks, M.Mohan

5. Shell Programming and Scripting

Remove special characters from text file

Hi All, i am trying to remove all special charecters().,/\~!@#%^$*&^_- and others from a tab delimited file. I am using the following code. while read LINE do echo $LINE | tr -d '=;:`"<>,./?!@#$%^&(){}'|tr -d "-"|tr -d "'" | tr -d "_" done < trial.txt > output.txt Problem ...

6. UNIX for Dummies Questions & Answers

XML file shows Junk Characters in UNIX

Hello sir, I have generated XML file from VS 2005. It works well in windows but it shows some junk characters in unix. Can any help me with this problem. Thank you in advance. Hema

7. UNIX for Dummies Questions & Answers

how to grep junk characters in a file

hi guys, I am generating a file from datastage (an etl tool). Now the file is having some junk characters like ( �,L��,� and so on).. I want to use the grep function to figure out all the junk characters and their location. Can somebody help me out in finding it out.. if possible i...

8. UNIX for Dummies Questions & Answers

How to remove JUNK characters (FROMï¿½)

Hi I have to remove the junk characters from my file. Please help.. File content : CURITY_CODE_GSD) FROMï¿½ DL_CB_SOD_EOD_VALUATION WHEREï¿½ ASOF

9. UNIX for Dummies Questions & Answers

How to replace and remove few junk characters from a specific field?

I would like to remove all characters starting with "%" and ending with ")" in the 4th field - please help!! 1412007819.864 /device/services/heartbeatxx 204 0.547%!i(int=0) 0.434 0.112 1412007819.866 /device/services/heartbeatxx 204 0.547%!i(int=1) 0.423 0.123...

10. UNIX for Beginners Questions & Answers

Need to remove Junk characters

Hi All, I have a issue that we are getting Junk characters from source and i am not able to load that records to Database. Line breakers Junk Characters (� and different every time) Japanese Characters Every time I am using grep command and awk -F "\007" to find them and delete that...

LEARN ABOUT DEBIAN

tmx2tmx

TMX2TMX(1p)						User Contributed Perl Documentation					       TMX2TMX(1p)

NAME

       tmx2tmx - utility to convert and filter TMX files

SYNOPSYS

	 tmx2tmx -cat file1.tmx ... filen.tmx > file.tmx

	 tmx2tmx -toTrados file1.tmx > file2.tmx

	 tmx2tmx -clean file1.tmx > file2.tmx

	 tmx2tmx -select=PT,EN multilingual.tmx > pt-en.tmx

DESCRIPTION

       This utility processes TMX documents and return TMX documents. Tasks done with this utility include conversion between TMX versions and TMX
       cleaning.

   TRADOS conversion
       As you maybe know, TRADOS is a company producing computer software for translators. It includes WorkBench which imports TMX files.
       Unfortunately, the version I used do not import TMX version 1.4.

       This process is done using the switch "-toTrados":

	 tmx2tmx -toTrados file.tmx > trados.tmx

   TMX Cleaning
       Specially when translation memories are created from anotated text, or extracted directly from the Internet using any automatic method.
       This switch is used to remove junk in translation units.

       This option tries to remove junk from TMX files, like empty pairs where one of the sides is empty, or removing other junk type.

       Use it this way:

	  tmx2tmx -clean file.tmx > file2.tmx

   Concatenating TMX
	  tmx2tmx -cat file1.tmx ... filen.tmx > file.tmx
	  ls | grep '.tmx$' | tmx2tmx -cat > file.tmx

   Select languages
       Select a bunch of languages:

	   tmx2tmx -select=PT,EN,FR huge.tmx > pt-en-fr.tmx

SEE ALSO

       tmx2html, po2tmx, XML::TMX

AUTHOR

       Alberto Simo~es, <albie@alfarrabio.di.uminho.pt>

COPYRIGHT AND LICENSE

       Copyright 2004 by Projecto Natura

       This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

perl v5.14.2							    2012-06-05							       TMX2TMX(1p)

10 More Discussions You Might Find Interesting

1. Solaris

Junk characters in file not in Solaris, but visible in linux

Discussion started by: vada010

2. Shell Programming and Scripting

Reading a file having junk characters in perl

Discussion started by: k_surya

3. Shell Programming and Scripting

sed to remove 1st two characters every line of text file

Discussion started by: ajp7701

4. Shell Programming and Scripting

Remove junk characters using Perl

Discussion started by: mohan_xunil