Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Accent words file from windows
Operating Systems AIX Accent words file from windows Post 302839483 by jockx on Thursday 1st of August 2013 06:02:59 PM
Old 08-01-2013
Question Accent words file from windows
Hi guys, I'm having a issue with a windows file from, at first the file is readed like one big and extense line and the famous "Ctrl+V Ctrl+R" or "^M return carriage"... fixed with:

Code:
perl -pe 'if ( s/\r\n?/\n/g ) { $f=1 }; if ( $f || ! $m ) { s/([^\n])\z/$1\n/ }; $m=1' $file_input > file_output

before, the file assembly the columns... fixed too:

Code:
sed -r 's/(.{11})/\1 /'

Here the ".{11}" is the positional new field separator.

But.. I'm not so good with locale and chartset in aix (is cuckoo for my... sometimes Smilie )

my question this:
mi file contains latin1 characteres, like "ñ, é, ü, etc" im looked for iconv but doesnt work for me at moment, i tried next lines:

Knowing the charset charset=iso-8859-1 moving the file to ubuntu and running "file -i".

Code:
iconv -f ISO-8859-1 -t UTF-8 file_input > file_output

but.. nothing

then
Code:
iconv -f ISO-8859-1 -t ISO-8859-15 file_input > file output

Neither...

I tried with an ubuntu distro and the results are seems... So, ayone has had this problem before? i did browse the entire network today and the answer are allways with iconv or vim, but vim doesn't have ":set filesetting" or ":set codesetting"

Any idea or suggestions?

Thanks and regards!
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

accent in emacs

Hello, I try to insert charcheters with accent with emacs. It doesn't work. How can I do ? Thank you in advance (2 Replies)
Discussion started by: annemar
2 Replies

2. Shell Programming and Scripting

Sed accent

Hi everyone ! I'd like to write a unix command for correcting all european accent errors in a document (spanish, german, french, danisch, etc )! i need to do this for correcting my document : sed -e 's/%2B/\ /g' -e 's/%25C9/É/g' doc1 > doc2 The first command is ok and change "%2B" into... (3 Replies)
Discussion started by: Tomat75
3 Replies

3. Shell Programming and Scripting

Spanish accent symbol removed by sed

Hello All in a text file I have to replace some numeric code by a string. This is an exemple of the file: 000000001 LDR L ^^^^^nam^^2200169Ia^45e0 000000001 008 L 100604s9999^^^^xx^^^^^^^^^^^^000^0^und^d 000000001 022 L $$a0365-6675 000000001 090 L $$aBMA 1934-1937. 000000001 245... (1 Reply)
Discussion started by: ldiaz2106
1 Replies

4. Shell Programming and Scripting

Splitting Concatenated Words in Input File with Words from a Master File

Hello, I have a complex problem. I have a file in which words have been joined together: Theboy ranslowly I want to be able to correctly split the words using a lookup file in which all the words occur: the boy ran slowly slow put child ly The lookup file which is meant for look up... (21 Replies)
Discussion started by: gimley
21 Replies

5. Shell Programming and Scripting

Remove spanish accent from file name

Hello All hope all fine, I have a question about spanish accents... I have in a redhat server, a lot of files with Ñ or Ú accent into the NAME of the file. So my question is: Is it possible to change this name but with a script...to change all the occurence in one shot. Exemple: cd... (2 Replies)
Discussion started by: ldiaz2106
2 Replies

6. Shell Programming and Scripting

Splitting concatenated words in input file with words from the same file

Dear all, I am working with names and I have a large file of names in which some words are written together (upto 4 or 5) and their corresponding single forms are also present in the word-list. An example would make this clear annamarie mariechristine johnsmith johnjoseph smith john smith... (8 Replies)
Discussion started by: gimley
8 Replies

7. HP-UX

Problem with sftp for accent character files

Hi All, Following are the problems i am facing.Resolution for these would be highly commendable: a)I am trying to transfer files from my local C: directory to unix server using sftp. The problem is coming when files with accent characters are picked for transfer.These files are not... (6 Replies)
Discussion started by: destinykrishan
6 Replies

8. Shell Programming and Scripting

How count the number of two words associated with the two words occurring in the file?

Hi , I need to count the number of errors associated with the two words occurring in the file. It's about counting the occurrences of the word "error" for where is the word "index.js". As such the command should look like. Please kindly help. I was trying: grep "error" log.txt | wc -l (1 Reply)
Discussion started by: jmarx
1 Replies

9. UNIX for Dummies Questions & Answers

Replace the words in the file to the words that user type?

Hello, I would like to change my setting in a file to the setting that user input. For example, by default it is ONBOOT=ON When user key in "YES", it would be ONBOOT=YES -------------- This code only adds in the entire user input, but didn't replace it. How do i go about... (5 Replies)
Discussion started by: malfolozy
5 Replies

10. Shell Programming and Scripting

Replace particular words in file based on if finds another words in that line

Hi All, I need one help to replace particular words in file based on if finds another words in that file . i.e. my self is peter@king. i am staying at north sydney. we all are peter@king. How to replace peter to sham if it finds @king in any line of that file. Please help me... (8 Replies)
Discussion started by: Rajib Podder
8 Replies

LEARN ABOUT SUNOS

iconv

iconv(5)						Standards, Environments, and Macros						  iconv(5)

NAME

       iconv - code set conversion tables

DESCRIPTION

       The following code set conversions are supported:

		      Code Set Conversions Supported

       Code	      Symbol   Target Code    Symbol   Target Output

       ISO 646	      646      ISO 8859-1     8859     US ASCII
       ISO 646de      646de    ISO 8859-1     8859     German
       ISO 646da      646da    ISO 8859-1     8859     Danish
       ISO 646en      646en    ISO 8859-1     8859     English ASCII
       ISO 646es      646es    ISO 8859-1     8859     Spanish
       ISO 646fr      646fr    ISO 8859-1     8859     French
       ISO 646it      646it    ISO 8859-1     8859     Italian
       ISO 646sv      646sv    ISO 8859-1     8859     Swedish
       ISO 8859-1     8859     ISO 646	      646      7 bit ASCII
       ISO 8859-1     8859     ISO 646de      646de    German
       ISO 8859-1     8859     ISO 646da      646da    Danish
       ISO 8859-1     8859     ISO 646en      646en    English ASCII
       ISO 8859-1     8859     ISO 646es      646es    Spanish
       ISO 8859-1     8859     ISO 646fr      646fr    French
       ISO 8859-1     8859     ISO 646it      646it    Italian
       ISO 8859-1     8859     ISO 646sv      646sv    Swedish
       ISO 8859-16    iso16    ISO 8859-2     iso2     ISO Latin 2
       ISO 8859-2     iso2     ISO 8859-16    iso16    ISO Latin 10
       ISO 8859-16    iso16    IBM 850	      ibm850   IBM 850 code page
       ISO 8859-16    iso16    IBM 870	      ibm870   IBM 870 code page
       ISO 8859-2     iso2     MS 1250	      win2     Windows Latin 2
       ISO 8859-2     iso2     MS 852	      dos2     MS-DOS Latin 2
       ISO 8859-2     iso2     Mazovia	      maz      Mazovia
       IBM 850	      ibm850   ISO 8859-16    iso16    ISO Latin 10
       IBM 870	      ibm870   ISO 8859-16    iso16    ISO Latin 10
       MS 1250	      win2     DHN	      dhn      Dom Handlowy Nauki
       MS 852	      dos2     ISO 8859-2     iso2     ISO Latin 2
       MS 852	      dos2     MS 1250	      win2     Windows Latin 2
       MS 852	      dos2     Mazovia	      maz      Mazovia
       MS 852	      dos2     DHN	      dhn      Dom Handlowy Nauki
       Mazovia	      maz      ISO 8859-2     iso2     ISO Latin 2
       Mazovia	      maz      MS 1250	      win2     Windows Latin 2
       Mazovia	      maz      MS 852	      dos2     MS-DOS Latin 2
       Mazovia	      maz      DHN	      dhn      Dom Handlowy Nauki
       DHN	      dhn      ISO 8859-2     iso2     ISO Latin 2
       DHN	      dhn      MS 1250	      win2     Windows Latin 2
       DHN	      dhn      MS 852	      dos2     MS-DOS Latin 2
       DHN	      dhn      Mazovia	      maz      Mazovia
       ISO 8859-5     iso5     KOI8-R	      koi8     KOI8-R
       ISO 8859-5     iso5     PC Cyrillic    alt      Alternative PC Cyrillic
       ISO 8859-5     iso5     MS 1251	      win5     Windows Cyrillic
       ISO 8859-5     iso5     Mac Cyrillic   mac      Macintosh Cyrillic
       KOI8-R	      koi8     ISO 8859-5     iso5     ISO 8859-5 Cyrillic
       KOI8-R	      koi8     PC Cyrillic    alt      Alternative PC Cyrillic
       KOI8-R	      koi8     MS 1251	      win5     Windows Cyrillic
       KOI8-R	      koi8     Mac Cyrillic   mac      Macintosh Cyrillic
       PC Cyrillic    alt      ISO 8859-5     iso5     ISO 8859-5 Cyrillic
       PC Cyrillic    alt      KOI8-R	      koi8     KOI8-R
       PC Cyrillic    alt      MS 1251	      win5     Windows Cyrillic
       PC Cyrillic    alt      Mac Cyrillic   mac      Macintosh Cyrillic
       MS 1251	      win5     ISO 8859-5     iso5     ISO 8859-5 Cyrillic
       MS 1251	      win5     KOI8-R	      koi8     KOI8-R
       MS 1251	      win5     PC Cyrillic    alt      Alternative PC Cyrillic
       MS 1251	      win5     Mac Cyrillic   mac      Macintosh Cyrillic
       Mac Cyrillic   mac      ISO 8859-5     iso5     ISO 8859-5 Cyrillic
       Mac Cyrillic   mac      KOI8-R	      koi8     KOI8-R
       Mac Cyrillic   mac      PC Cyrillic    alt      Alternative PC Cyrillic
       Mac Cyrillic   mac      MS 1251	      win5     Windows Cyrillic

CONVERSIONS

       The conversions are performed according to the tables contained in the manual pages cross-referenced in the Index of Conversion Code Tables
       below.

       +--------------------------------------------------------------+
       |	       Index of Conversion Code Tables		      |
       +--------------------+--------------------+--------------------+
       |       Code	    |	 Target Code	 |  See Manual Page   |
       +--------------------+--------------------+--------------------+
       |ISO 646 	    |ISO 8859-1 	 | iconv_646(5)      |
       +--------------------+--------------------+--------------------+
       |ISO 646de	    |ISO 8859-1 	 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 646da	    |ISO 8859-1 	 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 646en	    |ISO 8859-1 	 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 646es	    |ISO 8859-1 	 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 646fr	    |ISO 8859-1 	 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 646it	    |ISO 8859-1 	 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 646sv	    |ISO 8859-1 	 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-1	    |ISO 646		 | iconv_8859-1(5)   |
       +--------------------+--------------------+--------------------+
       |ISO 8859-1	    |ISO 646de		 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-1	    |ISO 646da		 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-1	    |ISO 646en		 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-1	    |ISO 646es		 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-1	    |ISO 646fr		 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-1	    |ISO 646it		 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-1	    |ISO 646sv		 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-2	    |MS 1250		 | iconv_8859-2(5)   |
       +--------------------+--------------------+--------------------+
       |ISO 8859-2	    |MS 852		 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-2	    |Mazovia		 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-2	    |DHN		 |		      |
       +--------------------+--------------------+--------------------+
       |MS 1250 	    |ISO 8859-2 	 | iconv_1250(5)     |
       +--------------------+--------------------+--------------------+
       |MS 1250 	    |MS 852		 |		      |
       +--------------------+--------------------+--------------------+
       |MS 1250 	    |Mazovia		 |		      |
       +--------------------+--------------------+--------------------+
       |MS 1250 	    |DHN		 |		      |
       +--------------------+--------------------+--------------------+
       |MS 852		    |ISO 8859-2 	 | iconv_852(5)      |
       +--------------------+--------------------+--------------------+
       |MS 852		    |MS 1250		 |		      |
       +--------------------+--------------------+--------------------+
       |MS 852		    |Mazovia		 |		      |
       +--------------------+--------------------+--------------------+
       |MS 852		    |DHN		 |		      |
       +--------------------+--------------------+--------------------+
       |Mazovia 	    |ISO 8859-2 	 | iconv_maz(5)      |
       +--------------------+--------------------+--------------------+
       |Mazovia 	    |MS 1250		 |		      |
       +--------------------+--------------------+--------------------+
       |Mazovia 	    |MS 852		 |		      |
       +--------------------+--------------------+--------------------+
       |Mazovia 	    |DHN		 |		      |
       +--------------------+--------------------+--------------------+

       +--------------------------------------------------------------+
       |	       Index of Conversion Code Tables		      |
       +--------------------+--------------------+--------------------+
       |       Code	    |	 Target Code	 |  See Manual Page   |
       +--------------------+--------------------+--------------------+
       |DHN		    |ISO 8859-2 	 |  iconv_dhn(5)     |
       +--------------------+--------------------+--------------------+
       |DHN		    |MS 1250		 |		      |
       +--------------------+--------------------+--------------------+
       |DHN		    |MS 852		 |		      |
       +--------------------+--------------------+--------------------+
       |DHN		    |Mazovia		 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-5	    |KOI8-R		 |  iconv_8859-5(5)  |
       +--------------------+--------------------+--------------------+
       |ISO 8859-5	    |PC Cyrillic	 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-5	    |MS 1251		 |		      |
       +--------------------+--------------------+--------------------+
       |ISO 8859-5	    |Mac Cyrillic	 |		      |
       +--------------------+--------------------+--------------------+
       |KOI8-R		    |ISO 8859-5 	 | iconv_koi8-r(5)   |
       +--------------------+--------------------+--------------------+
       |KOI8-R		    |PC Cyrillic	 |		      |
       +--------------------+--------------------+--------------------+
       |KOI8-R		    |MS 1251		 |		      |
       +--------------------+--------------------+--------------------+
       |KOI8-R		    |Mac Cyrillic	 |		      |
       +--------------------+--------------------+--------------------+
       |PC Cyrillic	    |ISO 8859-5 	 | iconv_pc_cyr(5)   |
       +--------------------+--------------------+--------------------+
       |PC Cyrillic	    |KOI8-R		 |		      |
       +--------------------+--------------------+--------------------+
       |PC Cyrillic	    |MS 1251		 |		      |
       +--------------------+--------------------+--------------------+
       |PC Cyrillic	    |Mac Cyrillic	 |		      |
       +--------------------+--------------------+--------------------+
       |MS 1251 	    |ISO 8859-5 	 | iconv_1251(5)     |
       +--------------------+--------------------+--------------------+
       |MS 1251 	    |KOI8-R		 |		      |
       +--------------------+--------------------+--------------------+
       |MS 1251 	    |PC Cyrillic	 |		      |
       +--------------------+--------------------+--------------------+
       |MS 1251 	    |Mac Cyrillic	 |		      |
       +--------------------+--------------------+--------------------+
       |Mac Cyrillic	    |ISO 8859-5 	 | iconv_mac_cyr(5)  |
       +--------------------+--------------------+--------------------+
       |Mac Cyrillic	    |KOI8-R		 |		      |
       +--------------------+--------------------+--------------------+
       |Mac Cyrillic	    |PC Cyrillic	 |		      |
       +--------------------+--------------------+--------------------+
       |Mac Cyrillic	    |MS 1251		 |		      |
       +--------------------+--------------------+--------------------+

FILES

       /usr/lib/iconv/*.so

	   conversion modules

       /usr/lib/iconv/*.t

	   Conversion tables.

       /usr/lib/iconv/geniconvtbl/binarytables/*.bt

	   Conversion binary tables.

       /usr/lib/iconv/iconv_data

	   List of conversions supported by conversion tables.

SEE ALSO

       iconv(1),  iconv(3C),  iconv_1250(5),  iconv_1251(5),  iconv_646(5),  iconv_852(5),  iconv_8859-1(5),   iconv_8859-2(5),   iconv_8859-5(5),
       iconv_dhn(5), iconv_koi8-r(5), iconv_mac_cyr(5), iconv_maz(5), iconv_pc_cyr(5), iconv_unicode(5)

SunOS 5.10							    5 Dec 2001								  iconv(5)
All times are GMT -4. The time now is 07:03 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy