12-16-2008
why "iconv" didn't convert myfile.csv to ASCII?
(it seems that this post is best put here, where shell programming people use "iconv" and "file" all the time. it was posted in the Linux Application and got no replies)
Dear there, I tried to use iconv to convert myfile.csv to ASCII and failed. Any ideas? myfile.csv contains only ASCII characters.
here is the log:
---------------------------------------------------------
sychen@sychen-laptop:/tmp$ file myfile.csv
myfile.csv: Bio-Rad .PIC Image File 13619 x 12339, 13618 images in file
sychen@sychen-laptop:/tmp$ iconv -f UTF-16 -t ASCII//IGNORE myfile.csv -omyfile_iconv.csv
iconv: illegal input sequence at position 16320
sychen@sychen-laptop:/tmp$ file myfile_iconv.csv
myfile_iconv.csv: empty
sychen@sychen-laptop:/tmp$ iconv -f UTF-8 -t ASCII//IGNORE myfile.csv -omyfile_iconv.csv
sychen@sychen-laptop:/tmp$ file myfile_iconv.csv
myfile_iconv.csv: Bio-Rad .PIC Image File 13619 x 12339, 13618 images in file
sychen@sychen-laptop:/tmp$ head -n 2 myfile.csv
353025450,AUD/JPY,2007-10-14 17:00:06,106.320000,106.390000,D
353025553,AUD/JPY,2007-10-14 17:01:23,106.330000,106.400000,D
sychen@sychen-laptop:/tmp$ head -n 2 myfile_iconv.csv
353025450,AUD/JPY,2007-10-14 17:00:06,106.320000,106.390000,D
353025553,AUD/JPY,2007-10-14 17:01:23,106.330000,106.400000,D
sychen@sychen-laptop:/tmp$ iconv --list
9 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Is there a way with HP-UX Release 10.20 (but going to HP-UX 11) to convert a regular "text" file to a packed data format (such as is created by a Cobol program)? (2 Replies)
Discussion started by: HuskyJim
2 Replies
2. Programming
i have a program using the select function but i want to convert it to poll... how can i do this? thanks in advance... :) (1 Reply)
Discussion started by: rbolante
1 Replies
3. UNIX for Dummies Questions & Answers
Hi Friends,
Can any of you explain me about the below line of code?
mn_code=`env|grep "..mn"|awk -F"=" '{print $2}'`
Im not able to understand, what exactly it is doing :confused:
Any help would be useful for me.
Lokesha (4 Replies)
Discussion started by: Lokesha
4 Replies
4. Shell Programming and Scripting
Using AIX 5.3 and /user/bin/ksh.
Anyone have a quick way to convert the string date
Nov 9 11:35:28 2009 to 200911091135
I know I could create a table of months and find the month number by searching the list, but I was hoping there was some handy little known command to do this... (15 Replies)
Discussion started by: troym72
15 Replies
5. Shell Programming and Scripting
Hi,
I have line in input file as below:
3G_CENTRAL;INDONESIA_(M)_TELKOMSEL;SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL
My expected output for line in the file must be :
"1-Radon1-cMOC_deg"|"LDIndex"|"3G_CENTRAL|INDONESIA_(M)_TELKOMSEL"|LAST|"SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL"
Can someone... (7 Replies)
Discussion started by: shis100
7 Replies
6. UNIX for Dummies Questions & Answers
How to use "mailx" command to do e-mail reading the input file containing email address, where column 1 has name and column 2 containing “To” e-mail address
and column 3 contains “cc” e-mail address to include with same email.
Sample input file, email.txt
Below is an sample code where... (2 Replies)
Discussion started by: asjaiswal
2 Replies
7. Shell Programming and Scripting
Hello.
System : opensuse leap 42.3
I have a bash script that build a text file.
I would like the last command doing :
print_cmd -o page-left=43 -o page-right=22 -o page-top=28 -o page-bottom=43 -o font=LatinModernMono12:regular:9 some_file.txt
where :
print_cmd ::= some printing... (1 Reply)
Discussion started by: jcdole
1 Replies
8. Windows & DOS: Issues & Discussions
So, I have a folder, containing subdirs like this:
52334d50
52365245
524b4450
524f3350
52533950
52535050
52555550
now I want to go ahead and rename all those folder:
hex -> ascii (8 Replies)
Discussion started by: pasc
8 Replies
9. AIX
Hi 2 all,
i have had AIX 7.2
:/# /usr/IBMAHS/bin/apachectl -v
Server version: Apache/2.4.12 (Unix)
Server built: May 25 2015 04:58:27
:/#:/# /usr/IBMAHS/bin/apachectl -M
Loaded Modules:
core_module (static)
so_module (static)
http_module (static)
mpm_worker_module (static)
... (3 Replies)
Discussion started by: penchev
3 Replies
LEARN ABOUT DEBIAN
unaccent
unaccent(1) General Commands Manual unaccent(1)
NAME
unaccent - remove accents from input stream or a string
SYNOPSIS
unaccent [--debug_low] [--debug_high] [-h] charset [string] [expected]
DESCRIPTION
With a single argument, unaccent reads data from stdin, replaces accented letters by their unaccented equivalent and writes the result on
stdout. If the second argument ('string') is provided unaccent transforms it by replacing accented letters by their unaccented equivalent.
The result is printed on the standard output. The charset of the input string or the data read from stdin is specified by the 'charset'
argument (ISO-8859-15 for instance). The output is printed using the same charset.
If the 'expected' argument is provided, the output string is compared to it. If they are not equal unaccent exits on error.
unaccent relies on the iconv(3) library to convert from the specified charset to UTF-16BE (or UTF-16 if UTF-16BE is not available). You
should check the manual pages for available charsets. On GNU/Linux the command
iconv -l
shows all available charsets.
OPTIONS
--debug_low
Prints human readable information about the unaccentuation process. See unac(3) for more information.
--debug_high
Prints very detailed information about the unaccentuation process. See unac(3) for more information.
--help -h
Prints a short usage and exits.
EXAMPLES
Remove accents from the string ete and check that the result is ete.
unaccent ISO-8859-1 ete ete
Remove accents from file myfile and put the result in file myfile.unaccent
unaccent ISO-8859-1 < myfile > myfile.unaccent
SEE ALSO
unac(3), iconv(3)
AUTHOR
Loic Dachary loic@senga.org
http://www.senga.org/unac/
local unaccent(1)