|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
sed to remove 1st two characters every line of text file
Post 302252539 by radoulov on Wednesday 29th of October 2008 07:16:44 PM
10-29-2008
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
hello experts,
I need a sed command that remove last 10 characters of a line start from 3rd line.
any suggestions?
Thanks you (7 Replies)
Discussion started by: minifish
7 Replies
2. Shell Programming and Scripting
sed 's/^..//' file1.txt > file2.txt
this will remove the first two characters of each line of a text file, what sed command will remove the last two characters? This is a similar post to my other....sry if I'm being lazy....
I need a file like this (same as last post)
>cat file1.txt
10081551... (1 Reply)
Discussion started by: ajp7701
1 Replies
3. Shell Programming and Scripting
Hi All,
i am trying to remove all special charecters().,/\~!@#%^$*&^_- and others from a tab delimited file.
I am using the following code.
while read LINE
do
echo $LINE | tr -d '=;:`"<>,./?!@#$%^&(){}'|tr -d "-"|tr -d "'" | tr -d "_"
done < trial.txt > output.txt
Problem
... (10 Replies)
Discussion started by: kkb
10 Replies
4. UNIX for Advanced & Expert Users
Problem: I have a lot of files, the files first line should always have 4 spaces before any text. Occasionally some of the files will miss the leading spaces and it's a problem. This is only in the first line.
So if there are 4 spaces then text, do nothing. If there are not 4 spaces, add 4... (2 Replies)
Discussion started by: Vryali
2 Replies
5. UNIX Desktop Questions & Answers
I tried using below command
tr -cd "" < InputFile.xml > output.txt ============= This removes all the tabs/newline/extra spaces from a file
it successfully removed all the extra spaces,tabs and new line characters but then the complete file become one record. I want to retain one new line... (1 Reply)
Discussion started by: saini
1 Replies
6. Shell Programming and Scripting
I am using flatfile, in that flat file we are getting the junk chars
1)I21001f<82>^Me<85>!h49 Service Charge
2) I21001f‚
e...!h49 Service Charge
please tell me how to remove all junk chars in unix scripts. (1 Reply)
Discussion started by: Talari
1 Replies
7. Shell Programming and Scripting
I have test.xml XML file like
<Report account="123456" start_time="2014-09-08T00:00:00+00:00" end_time="2014-09-10T23:59:59+00:00" user="Dollar Tree" limit="1000000" more_sessions="some text ">
<Session ......rest of xml...............
I need output like
<Report>
<Session ......rest of... (3 Replies)
Discussion started by: kumars1331@gmai
3 Replies
8. Shell Programming and Scripting
I want to remove 1st and last two characters of each line of the file
Ex: file1
zzfile1ee
@xfile2:y
qfile3>>
@ file4yy
and redirect to the file called new
Basically file will have any charcter including space, spical character...
Please help.... (7 Replies)
Discussion started by: shell1509
7 Replies
9. Shell Programming and Scripting
Trying to use sed to, in-place, remove specific text from a file. Since there are / in the text I use | to escape that character. Thank you :).
sed -i -e 's|xxxx://www.xxx.com/xx/xx/xxx/.*/|' /home/cmccabe/list
sed: -e expression #1, char 51: unterminated `s' command (4 Replies)
Discussion started by: cmccabe
4 Replies
10. Shell Programming and Scripting
I have a file as below
Emp1|FirstName|MiddleName|LastName|Address|Pincode|PhoneNumber
1234|FirstName1|MiddleName2|LastName3| Add1 || ADD2|123|000000000
2345|FirstName2|MiddleName3|LastName4|
Add1 || ADD2|
234|000000000
OUTPUT :
... (1 Reply)
Discussion started by: styris
1 Replies
LEARN ABOUT HPUX
tconv
tconv(1) HP-UX tconv(1) NAME
tconv - HP 9000 Traditional-Chinese code converter SYNOPSIS
tconv tconv 1 tconv 1 num infile outfile tconv 1 -n num -f file_of_namelist tconv 2 [-r] [-ps] [-rs number] -m method -i infile -o outfile tconv 3 tconv 3 num infile outfile tconv 3 -n num -f file_of_namelist tconv 4 tconv 4 num infile outfile tconv 4 -n num -f file_of_namelist tconv 5 tconv 5 num infile outfile tconv 5 -n num -f file_of_namelist DESCRIPTION
tconv is a code converter to do code conversion from CCDC/Big5/EUC-CNS(locale: zh_TW.ccdc/zh_TW.big5/zh_TW.eucTW) internal code to another local Taiwanese 2-byte or 3-byte Traditional-Chinese internal code, or to Unicode in UCS2 or UTF8 format; as well the conversion of Big5 code(Traditional-Chinese) to GB code(Simplified-Chinese) (locale:zh_CN.hp15CN) or GBK code. It provides fourteen processing modes. Mode (1) : tconv The first one is an interactive menu mode. Just invoke the command. It will display the main menu, and prompt you for which kind of code conversion you need(whether it is between 2-byte and 2-byte, 3-byte and 2-byte, 4-byte and 2-byte, Traditional-Chinese code and Sim- plified-Chinese code or even Unicode). After you choose, if it's 2-byte and 2-byte, it will display the 2-byte code code conversion sub- menu and prompt you what type of code conversion you need and then ask you your input filename and output filename. If it's 3-byte and 2-byte, it will show the usage of it and ends. If it's 4-byte and 2-byte, it will display the 4-byte code code conversion sub-menu and prompt you what type of code conversion you need and then ask you your input filename and output filename. And then, if it's Traditional- Chinese and Simplified-Chinese, it will display the Traditional-Chinese and Simplified-Chinese code code-conversion sub-menu and prompt you what type of code conversion you need and then ask you your input filename and output filename. Finally, if it is Unicode, it will display the Unicode code conversion sub-menu and prompt you what type of code conversion you need and then ask you your input and output filenames. Mode (2) : tconv 1 The second is also a menu mode. If you invoke the command. It will go directly to the 2-byte code code conversion sub-menu. Mode (3) : tconv 1 num infile outfile The third is used to convert one 2-byte code text file to another code type text file in command mode. The infile stands for the input filename, outfile for output filename. And num is the selection number you can find out from the interactive menu mode. Below is the description of them : num = 1 : From HP Big5 code to IBM 5550 code. 2 : From HP Big5 code to CDC code. 3 : From HP Big5 code to National Standard code. 4 : From HP Big5 code to HP CCDC code. 5 : From HP Big5 code to Shift-Big5 code. 6 : From HP Big5 code to Taipei Computer Association code. 7 : From HP Big5 code to Tien-Lon code. 8 : From HP CCDC code to IBM 5550 code. 9 : From HP CCDC code to ETen code. 10 : From HP CCDC code to National Standard code. 11 : From HP CCDC code to Shift-Big5 code. 12 : From HP CCDC code to Taipei Computer Association code. 13 : From HP CCDC code to HP VECTRA PC code. 14 : From HP CCDC code to 2-byte WANG PC code. 15 : From Tandem internal code to HP CCDC code. 16 : From IBM 5550 code to HP Big5 code. 17 : From CDC code to HP Big5 code. 18 : From National Standard code to HP Big5 code. 19 : From HP CCDC code to HP Big5 code. 20 : From Shift-Big5 code to HP Big5 code. 21 : From Taipei Computer Assocoation code to HP Big5 code. 22 : From Tien-Lon code to HP Big5 code. 23 : From IBM 5550 code to HP CCDC code. 24 : From ETen code to HP CCDC code. 25 : From National Standard code to HP CCDC code. 26 : From Shift-Big5 code to HP CCDC code. 27 : From Taipei Computer Association code to HP CCDC code. 28 : From HP VECTRA PC code to HP CCDC code. 29 : From 2-byte WANG PC code to HP CCDC code. 30 : From HP CCDC code to Tandem internal code. Mode (4) : tconv 1 -n num -f file_of_namelist The fourth is used to convert many files with one tconv 1 command. You have to create a file with all the filenames you want to convert. Let the file name be file_of_namelist , and the format of the file is : <file1> <file2> <file3> . . . <EOF> Then use the command to convert all those files in batch mode. Also, same as Mode (3), num is the selection number you can find from the interactive menu mode. Notice that you can only do one kind of conversion to all the files in file_of_namelist , and there is no output filenames, all the files will be put into original file names which you specify in file_of_namelist. Mode (5) : tconv 2 [-r] [-ps] [-rs number] -m method -i infile -o outfile The fifth is the command tconv 2 , it is for code conversion between WANG's 3-byte internal code and HP's CCDC or Big5 code. It only supports batch mode procssing. Each tconv 2 command will convert one text file. Options Options for tconv 2 are interpreted as follows: -r this option means fixed record length. Default is free format. This option is useful to text file. -rs number this option is used to specify the record size of the file. For example '-rs 80' means that the record size is 80. The range of number is between 0 and 10240. -ps while converting from WANG to CCDC or Big5. Each 3-byte code will be converted to one 2-byte code and one 1-byte space. It implies fixed record length. -m wang_hp convert from WANG's 3-byte code to HP's 2-byte CCDC code -m wang_big5 convert from WANG's 3-byte code to 2-byte Big5 code -m hp_wang convert from HP's 2-byte CCDC code to WANG's 3-byte code -m big5_wang convert from 2-byte Big5 code to WANG's 3-byte code -i infile specify the input text file name -o outfile specify the output text file name Mode (6) : tconv 3 The sixth mode is also a menu mode. If you invoke the tconv 3 command. It will go directly to the 4-byte code code conversion sub- menu. The description is as follow : (1). From 4-byte Extended Unit Code(EUC) to HP Big5 code. (2). From 4-byte Extended Unit Code(EUC) to HP CCDC code. (3). From EUC to New Host Code(Traditional Chinese EBCDIC). (4). From HP Big5 code to 4-byte Extended Unit Code(EUC). (5). From HP CCDC code to 4-byte Extended Unit Code(EUC). (6). From New Host Code(Traditional Chinese EBCDIC) to EUC. Mode (7) : tconv 3 num infile outfile The seventh is used to convert one 4-byte code text file to another code type text file in command mode. The infile stands for the input filename, outfile for output filename. And num is the selection number you can find out from the interactive menu mode. Below is the description of them : num = 1 : From 4-byte Extended Unit Code(EUC) to HP Big5 code. 2 : From 4-byte Extended Unit Code(EUC) to HP CCDC code. 3 : From EUC to New Host Code(Traditional Chinese EBCDIC). 4 : From HP Big5 code to 4-byte Extended Unit Code(EUC). 5 : From HP CCDC code to 4-byte Extended Unit Code(EUC). 6 : From New Host Code(Traditional Chinese EBCDIC) to EUC. Mode (8) : tconv 3 -n num -f file_of_namelist The eighth is used to convert many files with one tconv 3 command. You have to create a file with all the filenames you want to con- vert. Let the file name be file_of_namelist , and the format of the file is : <file1> <file2> <file3> . . . <EOF> Then use the command to convert all those files in batch mode. Also, same as Mode (7), num is the selection number you can find from the interactive menu mode. Notice that you can only do one kind of conversion to all the files in file_of_namelist , and there is no output filenames, all the files will be put into original file names which you specify in file_of_namelist. Mode (9) : tconv 4 The ninth mode is a menu mode too. If you invoke the tconv 4 command. It will go directly to the Traditional-Chinese and Simplified- Chinese code-conversion sub-menu. The description is as follow : (1). From HP Big5 code to HP GB code. (2). From HP Big5 code to GBK code. (3). From HP GB code to HP Big5 code. (4). From GBK code to HP Big5 code. Mode (10) : tconv 4 num infile outfile The tenth is used to convert one Big5 or GB code text file to the other code type text file in command mode. The infile stands for the input filename, outfile for output filename. And num is the selection number you can find out from the interactive menu mode. Below is the description of them : num = 1 : From Big5 code to GB code. 2 : From Big5 code to GBK code. 3 : From GB code to Big5 code. 4 : From GBK code to Big5 code. Mode (11) : tconv 4 -n num -f file_of_namelist The eleventh is used to convert many files with one tconv 4 command. You have to create a file with all the filenames you want to convert. Let the file name be file_of_namelist , and the format of the file is : <file1> <file2> <file3> . . . <EOF> Then use the command to convert all those files in batch mode. Also, same as Mode (10), num is the selection number you can find from the interactive menu mode. Notice that you can only do one kind of conversion to all the files in file_of_namelist , and there is no output filenames, all the files will be put into original file names which you specify in file_of_namelist. Mode (12) : tconv 5 The twelfth mode is a menu mode too. If you invoke the tconv 5 command. It will go directly to the Unicode code-conversion sub-menu. The description is as follow : ( 1). From HP Big5 code to Unicode's Canonical Form(UCS2). ( 2). From HP EUC code to Unicode's Canonical Form(UCS2). ( 3). From HP CCDC code to Unicode's Canonical Form(UCS2). ( 4). From Unicode's Canonical Form(UCS2) to HP Big5 code. ( 5). From Unicode's Canonical Form(UCS2) to HP EUC code. ( 6). From Unicode's Canonical Form(UCS2) to HP CCDC code. ( 7). From HP Big5 code to Universal Trans. Format-8(UTF8). ( 8). From HP EUC code to Universal Trans. Format-8(UTF8). ( 9). From HP CCDC code to Universal Trans. Format-8(UTF8). (10). From Universal Trans. Format-8(UTF8) to HP Big5 code. (11). From Universal Trans. Format-8(UTF8) to HP EUC code. (12). From Universal Trans. Format-8(UTF8) to HP CCDC code. Mode (13) : tconv 5 num infile outfile The thirteenth is used to convert one Unicode code text file to the other code type text file in command mode. The infile stands for the input filename, outfile for output filename. And num is the selection number you can find out from the interactive menu mode. Below is the description of them : num = 1 : From HP Big5 code to Unicode's Canonical Form(UCS2). 2 : From HP EUC code to Unicode's Canonical Form(UCS2). 3 : From HP CCDC code to Unicode's Canonical Form(UCS2). 4 : From Unicode's Canonical Form(UCS2) to HP Big5 code. 5 : From Unicode's Canonical Form(UCS2) to HP EUC code. 6 : From Unicode's Canonical Form(UCS2) to HP CCDC code. 7 : From HP Big5 code to Universal Trans. Format-8(UTF8). 8 : From HP EUC code to Universal Trans. Format-8(UTF8). 9 : From HP CCDC code to Universal Trans. Format-8(UTF8). 10 : From Universal Trans. Format-8(UTF8) to HP Big5 code. 11 : From Universal Trans. Format-8(UTF8) to HP EUC code. 12 : From Universal Trans. Format-8(UTF8) to HP CCDC code. Mode (14) : tconv 5 -n num -f file_of_namelist The fourteenth is used to convert many files with one tconv 5 command. You have to create a file with all the filenames you want to convert. Let the file name be file_of_namelist , and the format of the file is : <file1> <file2> <file3> . . . <EOF> Then use the command to convert all those files in batch mode. Also, same as Mode (13), num is the selection number you can find from the interactive menu mode. Notice that you can only do one kind of conversion to all the files in file_of_namelist , and there is no output filenames, all the files will be put into original file names which you specify in file_of_namelist. EXAMPLE
tconv 1 4 file_in file_out , converts a text file from Big5 to CCDC tconv 1 -n 4 -f file_list , converts all the files in file_list from Big5 to CCDC tconv 2 -m wang_big5 -i file_in -o file_out , converts a text file from WANG to Big5 tconv 2 -r -m wang_big5 -i file_in -o file_out , converts a text file from WANG to Big5 and retain the record length tconv 2 -ps -m wang_big5 -i file_in -o file_out , converts a text file from WANG to Big5, pad space at each character tconv 2 -rs 80 -m wang_big5 -i file_in -o file_out , converts a text file from WANG to Big5, record size is 80. tconv 3 4 file_in file_out , converts a text file from Big5 to EUC tconv 3 -n 4 -f file_list , converts all the files in file_list from Big5 to EUC tconv 4 1 file_in file_out , converts a text file from Big5 to GB tconv 4 -n 1 -f file_list , converts all the files in file_list from Big5 to GB tconv 5 1 file_in file_out , converts a text file from Big5 to Unicode(UCS2) tconv 5 -n 1 -f file_list , converts all the files in file_list from Big5 to Unicode(UCS2) NOTICE
By default, tconv maps non-mapped characters to spaces. LOG FILE
/tmp/tconv.log AUTHOR
tconv was developed by AAA/TC-ESG, HP Taiwan. tconv(1)