Visit Our UNIX and Linux User Community


PuTTY displaying "special" characters


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers PuTTY displaying "special" characters
# 1  
Old 05-01-2013
PuTTY displaying "special" characters

I'm not really sure which forum this question should go into, so I'm posting it here.

I work with AIX and RHEL systems using PuTTY (Release 0.60_q1.129) from a Windows 7 workstation.

Some of the files we get from z/OS use "special" characters as delimiters. These characters include Hex 18 or Hex 19.

If I "cat" the files in the PuTTY terminal window, the characters are not displayed (on either AIX or RHEL.) However, if I open the files using UltraEdit sftp, I see the characters represented as an up-arrow for the x18 and a bar with a line for the x19. (If I copy and paste the text from the terminal window into UltraEdit, the delimiters are simply missing.)

I would like to be able to see the special characters in the terminal window itself so I can quickly see what the file has is delimited with. However, being a UNIX Dummy, I don't know if it's an issue with PuTTY's terminal settings, or an issue or limitation with the Linux/AIX box itself. I've tried changing font, terminal and character set settings that I could find in PuTTY's configuration, but haven't had any luck. I've Googled for a solution, and find a lot of stuff related to displaying Asian languages corretly, but nothing seems directly applicable to this situation.

Since I can open the file in UltraEdit to see the delimiters, I do have a viable work-around, so this isn't a huge issue for me, but it's annoying enough that I thought I'd ask and see if anyone has any suggestions.

(As a side note, I work in an environment where the desktop is very tightly controlled, so the particular version of PuTTY I'm using is my only option for terminal emulation. I can't install or try different software or versions to see if this issue is common to any terminal client or specific to PuTTY.)

Thanks!
# 2  
Old 05-01-2013
convert from EBCDIC to ASCII:
Code:
dd if=your-ebcdic-file conv=ascii

# 3  
Old 05-01-2013
Characters below 0x20 are nonprinting characters, some of them have meaning to terminals, some of them have meaning to flow-control, some have no particular meaning.

Try cat -v to convert them to the sequence "^X" and the like when displayed.
This User Gave Thanks to Corona688 For This Post:
# 4  
Old 05-01-2013
Thanks Corona688,

The cat -v is helpful to at least see where the nonprinting characters are in the file. It doesn't show me which character it actually is, but it is still helpful to see where they are located.

It's also useful to know that the correct term for these characters is "nonprinting characters." I wasn't even searching for the correct term... that helps.

---------- Post updated at 03:56 PM ---------- Previous update was at 03:47 PM ----------

Quote:
Originally Posted by vgersh99
convert from EBCDIC to ASCII:
Code:
dd if=your-ebcdic-file conv=ascii

Thank you for the reply vgersh99.

Unless I'm misunderstanding your reply, I don't think that will work for what I'm trying to accomplish. I don't want to actually modify the file at all, i just want to see what delimiters were used in the file (so that I can specify the correct delimiter in a bulk load statement for a db.)

They use these strange nonprinting characters as delimiters because they aren't likely to show up anywhere in the middle of a long unstructured text field.

I guess by definition if they are nonprinting characters, they won't display in the terminal window though... so I think my question has been answered.

Thanks again!
# 5  
Old 05-01-2013
Normally, cat -v does show what the non-printing character is.

Hex 18 shows as ^X
Hex 19 shows as ^Y
This User Gave Thanks to hanson44 For This Post:
# 6  
Old 05-01-2013
Quote:
Originally Posted by hanson44
Normally, cat -v does show what the non-printing character is.

Hex 18 shows as ^X
Hex 19 shows as ^Y
Oh, I misunderstood Corona688's reply. I thought all non-printing characters would display as ^X. This is even better. Smilie
# 7  
Old 05-01-2013
Quote:
This is even better.
Yes, it is. Smilie cat -v is really great.

There is also -T option to show tabs as ^I.

And adding -E option shows end of lines (with $).
 

Previous Thread | Next Thread
Test Your Knowledge in Computers #1
Difficulty: Medium
The UNIX and Linux Forums (UNIX.com) was founded in 1985.
True or False?

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Unable to identify the special characters beyond the range of "[\x80-\xFF]"

I want to filter out the special character whose ascii value doesn't fall within the range "" . Example:� or Ć. So in that case is there any defined range which will filter out this characters. I can filter those which falls withing "" . Need to filter those special chracter which doesn't... (14 Replies)
Discussion started by: Abhijit Sen
14 Replies

2. UNIX for Advanced & Expert Users

"Network error: No route to host" While connecting guest RHEL4 using putty

Hi, I have installed RHEL4 using vmware workstation.. Host OS: Windows XP Guest OS: RHEL4 Pls refer step 17 & 18 in below link... ORACLE-BASE - Red Hat Enterprise Linux 4 and Centos 4 Installation 1) If i choose to assign IP automatically (using DHCP) means, i am able to connect RHEL4... (3 Replies)
Discussion started by: thomasraj87
3 Replies

3. Shell Programming and Scripting

finding the strings beween 2 characters "/" & "/" in .txt file

Hi all. I have a .txt file that I need to sort it My file is like: 1- 88 chain0 MASTER (FF-TE) FFFF 1962510 /TCK T FD2TQHVTT1 /jtagc/jtag_instreg/updateinstr_reg_1 dff1 (TI,SO) 2- ... (10 Replies)
Discussion started by: Behrouzx77
10 Replies

4. Shell Programming and Scripting

Need HELP with AWK split. Need to check for "special characters" in string before splitting the file

Hi Experts. I'm stuck with the below AWK code where i'm trying to move the records containing any special characters in the last field to a bad file. awk -F, '{if ($NF ~ /^|^/) print >"goodfile";else print >"badfile"}' filename sample data 1,abc,def,1234,A * 2,bed,dec,342,* A ... (6 Replies)
Discussion started by: shell_boy23
6 Replies

5. Shell Programming and Scripting

awk command to replace ";" with "|" and ""|" at diferent places in line of file

Hi, I have line in input file as below: 3G_CENTRAL;INDONESIA_(M)_TELKOMSEL;SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL My expected output for line in the file must be : "1-Radon1-cMOC_deg"|"LDIndex"|"3G_CENTRAL|INDONESIA_(M)_TELKOMSEL"|LAST|"SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL" Can someone... (7 Replies)
Discussion started by: shis100
7 Replies

6. Shell Programming and Scripting

Question about special variables: "-" and "$_"

both ksh/bash support this 2 special variables, Is there any document for reference? 1) "-" is $OLDPWD 2) "$_" is last argument of previous command. (4 Replies)
Discussion started by: honglus
4 Replies

7. UNIX for Advanced & Expert Users

The "PS" command was displaying*terminals named as "SYSCON"

Hi, When typing the command ps -fe.the system is showing a process called SYSCON:confused:.... I am not sure what process is that.I hava a script that kills all command staring with 'sys' but i don't want to kill syscon:( since i think it is some system process:confused: .Please help me to find... (1 Reply)
Discussion started by: kiranjose85
1 Replies

8. Shell Programming and Scripting

How to remove "New line characters" and "spaces" at a time

Dear friends, following is the output of a script from which I want to remove spaces and new-line characters. Example:- Line1 abcdefghijklmnopqrstuvwxyz Line2 mnopqrstuvwxyzabcdefghijkl Line3 opqrstuvwxyzabcdefdefg Here in above example, at every starting line there is a “tab” &... (4 Replies)
Discussion started by: anushree.a
4 Replies

9. Shell Programming and Scripting

how to split special characters "|" using awk

Hi friends I need to splict special character "|" here. Here is my script which giving error LINE=INVTRAN|cd /home/msgGoogle TraxFolderType=`awk -F"|" '{print $1}' $LINE` filePath=`awk -F"|" '{print $2}' $LINE` echo "TraxFolderType: "$TraxFolderType echo "filePath :"$filePath ... (3 Replies)
Discussion started by: krishna9
3 Replies

Featured Tech Videos