Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Reading/Viewing an Unicode file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Reading/Viewing an Unicode file
# 1  
Old 02-11-2013
Reading/Viewing an Unicode file
WE have a file coming from a server that has characters for 4-5 languages. If I download the file to my windows PC and open in Notepad ++, I can clearly see the text in different languages. Notepad++ is able to reder text that is in Portugese, French, Thai etc. My objective it to do the following:
1. Move it to a folder on the Unix box
2. Use an ETL tool like Informatica and dump it into an Oracle DB. Both the Oracle and Informatica servers are configured for Unicode.

When I move it to a Unix folder and if I try to open it in VI, I see all junk characters and becasue of this the data in Oracle is also pretty garbled. Can you pls assist me on how to handle this file on the Unix box. THank you.

Kumar
# 2  
Old 02-11-2013
The user settings on the Unix box needs to be set to the right locale. See
Code:
man locale

# 3  
Old 02-11-2013
Code:
locale -a

lists all your available locales.
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Viewing XLSB file in Unix

Hello, Does anyone know how to view an XLSB file in unix? Thank you. (1 Reply)
Discussion started by: narachaid
1 Replies

2. Shell Programming and Scripting

Unicode file validation

I don't want HTML_CONTENT,RICH_CONTENT,TEXT_CONTENT columns data in the file and reset of data we need to extract. Find the attached file. Need to extract date in between DI_UX_ROW_END tag. Can help me using unix command using AWK. Thanks, (2 Replies)
Discussion started by: bmk
2 Replies

3. UNIX for Dummies Questions & Answers

Viewing a large file

Sometime I have to deal with very large log files and I cannot view them for analysis using more or vi. The attempts to open the files error out saying there is not enough memory. Is there any tool or method with which I can go through huge files? (2 Replies)
Discussion started by: rcchume
2 Replies

4. Shell Programming and Scripting

sed replacement in unicode file

Hi there, I have a file generated by a windows registry (it's unicode) and can't get to do some replacements on it. I want to join lines that end with backslash with the next one. santiago@ks354286:~$ cat win.reg ÿþWindows Registry Editor Version 5.00 ... (10 Replies)
Discussion started by: chebarbudo
10 Replies

5. Shell Programming and Scripting

Find Unicode Character in File

I have a very large file in Unix that I would like to search for all instances of the unicode character 0x17. I need to remove these characters because the character is causing my SAX Parser to throw an exception. Does anyone know how to find a unicode character in a file? Thank you for your... (1 Reply)
Discussion started by: azelinsk
1 Replies

6. UNIX for Dummies Questions & Answers

grep and UNICODE (utf-16) file

I'm using shell scripting in Applescript. When searching a file with the ANSEL character set (for GEDCOM files) using (grep '1 CHAR ANSEL' filepath) gives the expected result. When searching a UNICODE formatted file (utf-16), searching for text known to exist in the file using (grep '1 CHAR... (4 Replies)
Discussion started by: Whiterock
4 Replies

7. Shell Programming and Scripting

Viewing the cron file

Hi All, I am trying to look into the crontab file present in /var/spool/cron/crontab. A file with the name of the superuser name is present there with the -r-------- permission. Even I am logged in using the same superuser id. But while am trying to cat that, its prompting permission denied. ... (2 Replies)
Discussion started by: rinku11
2 Replies

8. Programming

How to display unicode characters / unicode string

I have a stream of characters like "\u8BBE\u5907\u7BA1" and i want to display it. I tried following things already without any luck. 1) printf("%s",L("\u8BBE\u5907\u7BA1")); 2) printf("%lc",0x8BBE); 3) setlocale followed by fwide followed by wprintf 4) also changed the local manually... (3 Replies)
Discussion started by: jackdorso
3 Replies

9. UNIX for Dummies Questions & Answers

viewing are .tar.gz file

I have a dilema. We have a .tar.gz file that is 2.2 GB. I can't xfer to another machine with ftp, because ftp chokes on the 2 gb size. We can't uncompress the tarball either because it will blow any filesystem we have on this Sun box. Is there a way to view or even extract certain files from... (2 Replies)
Discussion started by: lawadm1
2 Replies
Login or Register to Ask a Question