Sponsored Content
Top Forums Shell Programming and Scripting Converting Unicode file to UTF8 format Post 302339588 by vfrg on Friday 31st of July 2009 02:35:34 AM
Old 07-31-2009
Converting Unicode file to UTF8 format

Hi,

I have a file in my desktop which is a unicode format. After this file is transferred to Unix using FTP, we are seeing some special character (like rectangle box type) at the first line. The same file is saved as UTF8 (using textpad tool, selecting encode to UTF-8 option) on my desktopand and then FTP to Unix. We could see proper data content.

I tried using the following command in Unix server (We use IBM AIX), but i got error message "Converter can not open"
iconv -f <iso89> -t <utf8> oldfile > newfile

Could you please let us know how we can automatically convert the file to UTF-8 in Unix server itself.

Thanks in advance for any help.

Thanks,
Venkat
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Converting the File Creation Date to a new format

I need to capture a file's creation/modification date and time and convert this to a different format, whilst I can easily get the existing format from a ls -l | awk ' { print $......}' or a cut command I do not know how to convert it to a desired format? I should add that at present the ls -l... (1 Reply)
Discussion started by: barney_clough
1 Replies

2. Shell Programming and Scripting

converting string to unicode

How can I can convert a string in a shell script that looks something like: ]] to unicode equivalent? thanks a lot, webtekie (1 Reply)
Discussion started by: webtekie
1 Replies

3. UNIX for Advanced & Expert Users

Convert UTF8 Format file to ANSI format

:) Hi i am trying to convert a file which is in UTF8 format to ANSI format i tried to use the function ICONV but it is throwing error Function i used it as $ iconv -f UTF8 -t ANSI filename Error iam getting is NOT Supported UTF8 to ANSI please some help me out on this.........Let me... (1 Reply)
Discussion started by: rajreddy
1 Replies

4. UNIX for Dummies Questions & Answers

Convert UTF8 Format file to ANSI format

:confused: Hi i am trying to convert a file which is in UTF8 format to ANSI format i tried to use the function ICONV but it is throwing error Function i used it as $ iconv -f UTF8 -t ANSI filename Error iam getting is NOT Supported UTF8 to ANSI please some help me out on... (9 Replies)
Discussion started by: rajreddy
9 Replies

5. Shell Programming and Scripting

converting config file to csv format

Hello, For 2 days now i've been searching for a solution to this. I am now beginning to doubt this is even possible. It's even harder when you don't know how to search for it. (which keywords generate enough relevancy etc..) I need to parse a config file to generate a CSV file in return. It... (7 Replies)
Discussion started by: zer0dvide
7 Replies

6. Shell Programming and Scripting

Converting file format

My input file is Pipe delimited with 10 fields, I am trying to create a tab delimited output file with 6 fields from the provided input file. Below is sample data Input file abc||2|PIN|num||||www.123.com|abc@123.com| bcd||2|PIN|num|||||abc@123.com|... (3 Replies)
Discussion started by: pasupuleti81
3 Replies

7. Shell Programming and Scripting

Converting windows format file to unix format using script

Hi, I am having couple of files which i used to copy from windows to Linux, so now in case of text files (CTRL^M) appears at end of line. I know i can convert this windows format file to unix format file by running dos2unix. My requirement here is that i want to do it automatically using a... (5 Replies)
Discussion started by: sarbjit
5 Replies

8. Shell Programming and Scripting

Help with Converting UTF-8 data to Unicode

How can I get an error when converting 3rd line, since it has invalid characters abcde a®cdée a�cd� Unicode for ® = ® é = é I used "iconv -f UTF-8 -t ISO-8859-15 in.txt > out.txt" (2 Replies)
Discussion started by: arunbs
2 Replies

9. Shell Programming and Scripting

Need help in converting the file format

Hi All, I need help in converting the mentioned file format into desired output format using awk. Could anyone help me in this? Below is the input.. Date Account Campaign AdGroup Keyword Conversion Revenue Var1 Var2 Var3 Var4 Var5 10 20 30 ... (8 Replies)
Discussion started by: Ravi S M
8 Replies

10. UNIX for Dummies Questions & Answers

help required in converting a file format

My file format: -------------------------------------------------- Complete Consistency Check Valid Area : VALID:VALID Started by : esanwad Started at : Thu Dec 11 16:04:46 2014 CNA version : R21H04_EC08 Check range : AREA VALID/VALID ... (4 Replies)
Discussion started by: Gautam Banerjee
4 Replies
tofrodos(1)						      General Commands Manual						       tofrodos(1)

NAME
tofrodos - Converts text files between DOS and Unix formats. SYNOPSIS
fromdos [ options ] [file...] todos [ options ] [file...] DESCRIPTION
DOS text files traditionally have carriage return and line feed pairs as their newline characters while Unix text files have the line feed as their newline character. fromdos converts text files from the DOS format to the Unix format, while todos converts text files from the Unix format to the DOS format. The programs accept multiple filenames and wildcards as their arguments. You may also use them in a pipe. If either program finds its input redirected, it will process stdin and place the output on stdout. OPTIONS
-a Always convert. If converting from DOS to Unix, this option will cause the program to remove ALL carriage returns. The default is to remove carriage returns only if they are followed by line feeds. If converting from Unix to DOS, this option will cause the program to convert ALL linefeeds to carriage return pairs. The default is to convert linefeeds only if they are not already preceded by a carriage return. -b Make a backup of original file. The original file is renamed with the original filename and a .bak extension. For example, a file called "filename.ext" becomes "filename.ext.bak". Important: the program behaves differently if it is compiled for DOS (as compared to being compiled for Windows, Linux, Mac OS X or other systems). In view of the filename restrictions present on DOS, the DOS exe- cutable will strip the original file extension, if any, from the file before appending the .bak extension. For example, "file- name.ext" becomes "filename.bak". -d Convert from DOS to Unix. This forces the program to convert the file in a particular direction. By default, if the program is named fromdos or dos2unix, it will assume that the input file is in a DOS format and convert it to a Unix format. If the program is named todos or unix2dos, it will assume that the input file is in a Unix format and convert it to a DOS format. Using the -d option forces the program to convert from a DOS format to a Unix format regardless of how the program is named. Likewise, using the -u option forces the program to convert from a Unix format to a DOS format regardless of the name of the program. -e Abort processing on any error in any file. Normally, the program will simply skip to process the next file on the command line when it encounters any errors. This option causes it to abort on errors. -f Force: convert even if the file is not writeable (read-only). By default, if fromdos or todos finds that the file does not have write permission, it will not process that file. This option forces the conversion even if the file is read-only. -h Display a short help screen on the program usage and quit. -l<logfile> Log error messages to <logfile>. Note that if your command line has an error, such as when you specify an unknown option, the error message for the command line option error will be issued to stderr instead and not logged. -o Overwrite the original file (no backup). This is the default. -p Preserve file ownership and time. On systems like Linux, the file ownership will only be preserved if the user is root, otherwise it will just set the file time and silently fail the change of file ownership. If you want a warning message when the file ownership cannot be changed, use -v. -u Convert from Unix to DOS. See the -d option above for more information. -v Verbose. -V Show version message and quit. AUTHOR
The program and its documentation are copyrighted (c) 1996-2008 by Christopher Heng. All rights reserved. They are distributed under the terms of the GNU General Public License Version 2. The latest version of tofrodos can be obtained from http://www.thefreecountry.com/tofrodos/index.shtml 2011 Version 1.7.9 tofrodos(1)
All times are GMT -4. The time now is 11:22 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy