08-18-2011
Quote:
Originally Posted by
alister
That question doesn't really make much sense. Unicode is not an encoding; it is a character set. UTF-8 is one of many ways to encode the Unicode character set. This means you have yet to state the source's encoding.
In any case, you probably want to take a look at iconv for the transcoding aspect of the task.
Regards,
Alister
Interesting. When I open Notepad in Windows and click on save as, there are 4 options for encoding: ANSI, Unicode, Unicode big endian, UTF-8.
The logs I am referring to are encoded, at least according to Notepad, in Unicode. I'm able to change them to UTF-8 and they look right with the cat command in cygwin.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
How do I convert unix text files into readable text for windows.
Dave (1 Reply)
Discussion started by: nucca
1 Replies
2. UNIX for Dummies Questions & Answers
Hi all,
I have a print control file (dflt) for Oracle which is in binary. As I am going to develope an application in Window environment, I would like to reference the dflt file. But it is in binary format and I cannot access it. Anyone can suggest me how to convert the file into text or... (5 Replies)
Discussion started by: user12345
5 Replies
3. UNIX for Dummies Questions & Answers
Hiiiii....
how to convert all *. c files to *.cpp files , in a directory given using shell script.
:pThnaking u.:p (10 Replies)
Discussion started by: krishnampkkm
10 Replies
4. Shell Programming and Scripting
Hi,
Your great help is very appreciated. I am looking for any Unix command or tool for doing Stress/Load test of php files at command prompt.
I tried torture.pl but it is not working after20 concurrent threads/users.
as it is very urgent for me..please suggest ur ideas asap.
thanks (5 Replies)
Discussion started by: Malleswari
5 Replies
5. UNIX for Dummies Questions & Answers
Hello All,
I have a scenario to read a file containing text like this:(say file name is Dummy.txt)
/home/abc/test1/ | file1
/home/abc/test2/ | file2
I used a variable to store the content from file like this (say for line1):
File=`head -1 Dummy.txt | cut -f1 -d "|"`
Dir=`head -1 Dummy.txt... (2 Replies)
Discussion started by: Quesemail
2 Replies
6. UNIX for Dummies Questions & Answers
Hi Unix Gurus,
I need to list all files in a Unix Directory which either end with a
.pdf or .rtf and they should be case insensitive ie .Pdf , .pDF , .RtF etc are also possible.
How can i accomplish this with with a ls command ? If not then a find command. (6 Replies)
Discussion started by: pchegoor
6 Replies
7. Windows & DOS: Issues & Discussions
Hmmm I think I found the correct subforum to ask my question...
I have some text files that I prepared in vi some time ago, and now I want to open and edit them with Windows Notepad. I don't have a Unix terminal at the moment so I need to do the conversion in Windows. Is there a way to do this?... (1 Reply)
Discussion started by: frys_hp
1 Replies
8. UNIX for Dummies Questions & Answers
Hi all,
I have some text files that I prepared in vi some time ago, and now I want to open and edit them with Windows Notepad. I don't have a Unix terminal at the moment so I need to do the conversion in Windows. Is there a way to do this? Or just reinsert thousands of line breaks again :eek: ? (2 Replies)
Discussion started by: frys_hp
2 Replies
9. Shell Programming and Scripting
Hi
This is my first post and I'm just a beginner. So please be nice to me.
I have a couple of html files where a pattern beginning with "http://www.site.com" and ending with "/resource.dat" is present on every 241st line. How do I extract this to a new text file?
I have tried sed -n 241,241p... (13 Replies)
Discussion started by: dejavo
13 Replies
10. Shell Programming and Scripting
Hi all,
Is there other way to Add text at start and ending of every line?
here my script:
cat file.txt |awk '{print "<p align=\"justify\">"$0"</p>"}'
but the problem they put including white spaces, I only need those line have a sentence or text not an skip all have empty string or have... (7 Replies)
Discussion started by: lxdorney
7 Replies
LEARN ABOUT OPENDARWIN
encoding
encoding(n) Tcl Built-In Commands encoding(n)
__________________________________________________________________________________________________________________________________________________
NAME
encoding - Manipulate encodings
SYNOPSIS
encoding option ?arg arg ...?
_________________________________________________________________
INTRODUCTION
Strings in Tcl are encoded using 16-bit Unicode characters. Different operating system interfaces or applications may generate strings in
other encodings such as Shift-JIS. The encoding command helps to bridge the gap between Unicode and these other formats.
DESCRIPTION
Performs one of several encoding related operations, depending on option. The legal options are:
encoding convertfrom ?encoding? data
Convert data to Unicode from the specified encoding. The characters in data are treated as binary data where the lower 8-bits of
each character is taken as a single byte. The resulting sequence of bytes is treated as a string in the specified encoding. If
encoding is not specified, the current system encoding is used.
encoding convertto ?encoding? string
Convert string from Unicode to the specified encoding. The result is a sequence of bytes that represents the converted string.
Each byte is stored in the lower 8-bits of a Unicode character. If encoding is not specified, the current system encoding is used.
encoding names
Returns a list containing the names of all of the encodings that are currently available.
encoding system ?encoding?
Set the system encoding to encoding. If encoding is omitted then the command returns the current system encoding. The system encod-
ing is used whenever Tcl passes strings to system calls.
EXAMPLE
It is common practice to write script files using a text editor that produces output in the euc-jp encoding, which represents the ASCII
characters as singe bytes and Japanese characters as two bytes. This makes it easy to embed literal strings that correspond to non-ASCII
characters by simply typing the strings in place in the script. However, because the source command always reads files using the current
system encoding, Tcl will only source such files correctly when the encoding used to write the file is the same. This tends not to be true
in an internationalized setting. For example, if such a file was sourced in North America (where the ISO8859-1 is normally used), each
byte in the file would be treated as a separate character that maps to the 00 page in Unicode. The resulting Tcl strings will not contain
the expected Japanese characters. Instead, they will contain a sequence of Latin-1 characters that correspond to the bytes of the original
string. The encoding command can be used to convert this string to the expected Japanese Unicode characters. For example,
set s [encoding convertfrom euc-jp "xA4xCF"]
would return the Unicode string "u306F", which is the Hiragana letter HA.
SEE ALSO
Tcl_GetEncoding(3)
KEYWORDS
encoding
Tcl 8.1 encoding(n)