Dear Scrutinizer,
The mapper file has the following structure:
The Input file is all in 8 bit Non Unicode i.e. Upper ASCII Range
The aim of the script would be to convert a non-Unicode 8 bit file into Unicode using the search and replace mappings stored in the mapper file.
I hope the explanation is clear.
Many thanks for your query and interest.
Hi, I am trying something like this: Let's say I have a file called File1 with contents:
x=-0.3
y=2.1
z=9.0
I have another file, File2, with contents:
xx=
yy=
zz=
(nothing after "="). What I want to do is get the value of x in File1 and set it to xx in File2, i.e., xx=-0.3. And the... (3 Replies)
script is as below
v_process_run=5
typeset -i p_cnt=0
pdata=/home/proc_data.log
while
do
# execute script in background
dummy_test.sh "a1" "a2" &
p_cnt=$p_cnt+1
echo "data : $p_cnt : Y" >> $pdata
done
file created with following data in... (1 Reply)
I have a text file with following content (3 lines)
filename : output.txt
first line:12/12/2008
second line:12/12/2008
third line:Y
I would like to know how we can replace 'Y' with 'N' in the 3rd line keeping 1st and 2nd lines same as what it was before.
I tried using cat output.txt... (4 Replies)
i am very new to UNIX
plz help me in this scenario
i have two text files as below
file1.txt
name=Rajakumar.
Discipline=Electronics and communication.
Designation=software Engineer.
file2.txt
name=Kannan.
Discipline=Mechanical.
Designation=CADD Design Engineer.
... (6 Replies)
Hi all,
I have a requirement where i have to search data between strings 'SELECT' and ';' and replace this text as "SELECT.....;" so that i can export this extracted string into a excel cell.
Please suggest on this. (5 Replies)
hello all
greeting for the day
i have a text file as the following
text.xml
abcd<FIELD>123.456</FIELD>efgh
i need to replace the value between <FIELD> and </FIELD> by using awk command.
please throw some light on this.
thank you very very much
Erik (5 Replies)
Hello friends!
Help me pls to write correct awk and grep statements for my task:
I have got files with name filename.txt
It has such structure:
Start of file
FROM: address@domen.com (12...890) abc
DATE: 11/23/2009 on Std
SUBJECT: any subject
End of file
So, I must check,
if this file... (4 Replies)
Hi There...
I need to serach and replace a strings in a text file.
My file has; books.amazon='Let me read' and the output needed is
books.amazon=NONFOUND
pls if anybody know this can be done in script sed or awk.. i have a list of different strings to be repced by NONFOUND.... (7 Replies)
Hi,
I have gigabytes of text files that I need to search for "&" and replace with "&". Is there a way to do this efficiently (like sed command)?
Hope you could help.
Thanks. (17 Replies)
Hi there,
First of all this is my first post here. Thank you in advance for your help.
What I am trying to do is the following. I have a text file where each field of each row is separated by a tabulator.
Looks like this:
ATOM 1 N HSE A 26 3.033 -10.429 -2.262 1.00 17.07 ... (8 Replies)
Discussion started by: doom4
8 Replies
LEARN ABOUT DEBIAN
unidesc
unidesc(1) General Commands Manual unidesc(1)NAME
unidesc - Describe the contents of a Unicode text file
SYNOPSIS
unidesc ([option flags]) (<file name>)
If no input file name is supplied, unidesc reads from the standard input.
DESCRIPTION
unidesc describes the content of a Unicode text file by reporting the character ranges to which different portions of the text belong. The
ranges reported include both official Unicode ranges and the constructed language ranges within the Private Use Areas registered with the
Conscript Unicode Registry (http://www.evertype.com/standards/csur/). For each range of characters, unidesc prints the character or byte
offset of the beginning of the range, the character or byte offset of the end of the range, and the name of the range. Offsets start from
0.
Since the ASCII digits, punctuation, and whitespace characters are frequently used by other writing systems, by default these characters
are treated as neutral, that is, as not belonging exclusively to any particular character range. These characters are treated as belonging
to the range of whatever characters precede them.
If the input begins with neutral characters, they are treated as belonging to the range of whatever characters follow them. If the file
consists entirely of neutral characters, the range is identified as Neutral followed by Basic Latin in square brackets.
A magic number identifying the Unicode encoding is not part of the Unicode standard, so pure Unicode files do not contain a magic number.
However, informal conventions have arisen for this purpose. If the command line flag -m is given, unidesc will attempt to identify the
Unicode subtype by examining the first few bytes of the input. If the input is identified as one of the two acceptable types, UTF-8 or
native order UTF-32, it will then proceed to describe the contents of the input. Otherwise, it will report what it has learned and exit.
Note that if the file does contain a magic number, you must use the -m flag. Without this flag unidesc assumes that the input consists of
pure Unicode with the character data beginning immediately. It will therefore be thrown off by the magic number.
By default, input is expected to be UTF-8. Native order UTF-32 is also acceptable. UTF-32 may be specified via the command line flag -u
or, if the command line flag -m is given, via the magic number.
COMMAND LINE FLAGS -b Give file offsets in bytes rather than characters.
-d Treat the ASCII digits as belonging exclusively to the Basic Latin range.
-h Print usage information.
-L List the Unicode ranges alphabetically.
-l List the Unicode ranges by codepoint.
-m Check the file's magic number to determine the Unicode subtype.
-p Treat ASCII punctuation as belonging exclusively to the Basic Latin range.
-r Instead of listing ranges as they are encountered, just list the ranges detected after all input has been read.
-u Input is native order UTF-32.
-v Print version information.
-w Treat ASCII whitespace as belonging exclusively to the Basic Latin range.
SEE ALSO
uniname
REFERENCES
Unicode Standard, version 5.0
AUTHOR
Bill Poser
billposer@alum.mit.edu
LICENSE
GNU General Public License
June, 2007 unidesc(1)