03-18-2019
Does not surprise me...
iconv purpose is not to remove char when not in a supposed charset, but to convert one charset to another...
How can you assume non ascii char in UTF8 like you are doing?
And if UTF8, yes converted to ASCII record length will will not be the same ASCII is sure shorter...
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi all ,
please explain the following command :
perl -e 'select(undef,undef,undef,.15)'
Thanks and Regards
Navatha (2 Replies)
Discussion started by: Navatha
2 Replies
2. UNIX for Dummies Questions & Answers
Specifically what is the purpose of sed?
What is f?
Why is the 'cp f $phonefile' line needed when the script ‘goes live'?
Why might that two commands following sed be commented out at the present time ( i.e., during development)?
Thanks in... (2 Replies)
Discussion started by: knp808
2 Replies
3. Shell Programming and Scripting
find . -type f -ctime +3 -exec mv {} /somedirectory/ \;
in particular "-ctime v/s -mtime" and "difference between +3 and -3" (5 Replies)
Discussion started by: Rambo
5 Replies
4. Shell Programming and Scripting
Hi ,
I am using iconv command to convert a file in UTF-16 format to UTF-8 format. This command will work for few files but for some showing an error as bad input character.
But if i copy the contents of the file for which it is showing "bad input character" to a new file and perform the... (0 Replies)
Discussion started by: Shruthi8818
0 Replies
5. UNIX for Dummies Questions & Answers
Hi ,
I am using iconv command to convert a file in UTF-16 format to UTF-8 format. This command will work for few files but for some showing an error as bad input character.
But if i copy the contents of the file for which it is showing "bad input character" to a new file and perform the... (2 Replies)
Discussion started by: Shruthi8818
2 Replies
6. Shell Programming and Scripting
Hi Friends,
I am not able to conver character set from UTF-8 to IBM-284 throwing an error "cannot open convertor" . Could you please help me how to get out of this error.
Below command is working fine
iconv -f ISO8859-15 -t UTF-8 fromfile.txt > tofile.txt
But the below command is... (2 Replies)
Discussion started by: sivakumarl
2 Replies
7. Shell Programming and Scripting
I need to convert a utf16 file to utf8. When i use the iconv command to do so it gives an error saying invalid function.
When I ran the iconv -l function it did not list the utf16 and utf8 as part of its internal table. Is there anyway I can add these encodings in the library? Is there any other... (3 Replies)
Discussion started by: gaun
3 Replies
8. UNIX for Dummies Questions & Answers
Hi,
I saw this. But I don't know why we need this?
ls mydir > foo.txt ## I know what this will do, it will take the results and write to the file called foo.txt
ls mydir > foo.txt 2>&1 ## Don't know why we need 2>&1
Thanks. (2 Replies)
Discussion started by: samnyc
2 Replies
9. Shell Programming and Scripting
Hi ,
i am new to unix i need a small clarification regarding this
sqlplus -s $USER_NAME/$PASSWD@$ORA_SID<< EOF >> SQL_CONN_LOG.log
In the above command what is the meaning of <<EOF>>
Thanks,
krishna. (2 Replies)
Discussion started by: rams_krishna
2 Replies
10. Red Hat
su - keibatch -c ""date ; /usr/local/kei/batch/apb/bin/JKEIKYK4140.sh -run "&$C$6&" WSUKE100201""
Not clear about : date ; /usr/local/kei/batch/apb/bin/JKEIKYK4140.sh -run "&$C$6&" WSUKE100201
Please help (2 Replies)
Discussion started by: honda_city
2 Replies
LEARN ABOUT DEBIAN
yaz-iconv
YAZ-ICONV(1) Commands YAZ-ICONV(1)
NAME
yaz-iconv - YAZ Character set conversion utility
SYNOPSIS
yaz-iconv [-f from] [-t to] [-v] [file...]
DESCRIPTION
yaz-iconv converts data in file in character set specified by from to output in character set as specified by to.
This yaz-iconv utility similar to the iconv found on many POSIX systems (Glibc, Solaris, etc).
If no file is specified, yaz-iconv reads from standard input.
OPTIONS
-ffrom]
Specify the character set from of the input file. Should be used in conjunction with option -t.
-tto]
Specify the character set of of the output. Should be used in conjunction with option -f.
-v
Print more information about the conversion process.
ENCODINGS
The yaz-iconv command and the API as defined in yaz/yaz-iconv.h is a wrapper for the library system call iconv. But YAZ' iconv utility also
implements conversions on its own. The table below lists characters sets (or encodings). that are supported by YAZ. Each character set is
marked with either encode or decode. If an encoding is encode-enabled YAZ may convert to to the designated encoding. If an encoding is
decode-enabled, YAZ may convert from the designated encoding.
marc8 (encode, decode)
The MARC8[1] encoding as defined by the Library of Congress. Most MARC21/USMARC records usees this encoding.
marc8s (encode, decode)
Like MARC8 but with conversion prefers non-combined characters in the Latin-1 plane over combined characters.
marc8lossy (encode)
Lossy encoding of MARC-8.
marc8lossless (encode)
Lossless encoding of MARC8.
utf8 (encode, decode)
The most commonly used UNICODE encoding on the Internet.
iso8859-1 (encode, decode)
ISO-8859-1, AKA Latin-1.
iso5426 (decode)
ISO 5426. Some MARC records (UNIMARC) uses this encoding.
iso5428:1984 (encode, decode)
ISO 5428:1984.
advancegreek (encode, decode)
An encoding for Greek used by some vendors (Advance).
danmarc (decode)
Danmarc (in danish)[2] is an encoding based on UNICODE which is used for DanMARC2 records.
EXAMPLES
The following command converts from ISO-8859-1 (Latin-1) to UTF-8.
yaz-iconv -f ISO-8859-1 -t UTF-8 -X <input.lst >output.lst
FILES
prefix/bin/yaz-iconv
prefix/include/yaz/yaz-iconv.h
SEE ALSO
yaz(7) iconv(1)
NOTES
1. MARC8
http://www.loc.gov/marc/specifications/speccharmarc8.html
2. Danmarc (in danish)
http://www.kat-format.dk/danMARC2/Danmarc2.4.htm#felt+Indl.+4
YAZ 4.2.30 04/16/2012 YAZ-ICONV(1)