09-25-2008
This sounds like a locale issue. I understand what HPUX does, but I do not know much Tru64 and locale. If you review the localeconv, localedef, langinfo, and NLS man pages for HPUX it has information on how to construct a "locale". When you build a locale, one of the things that is defined is what characters are punctuation. Offhand I would guess the locales you are using has a definition problem. IF you need portabilty between your environments you have to find or define matching locale defintions for each environment
Actually not only cut but also every unix tool and library calls like strftime() will do odd things under a poorly set up locale.
Last edited by jim mcnamara; 09-25-2008 at 07:08 AM..
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I try to get tr to replace multibytes characters by ascii equivalent. For example
"Je vais ŕ l'école" ---> 'Je vais a l'ecole"
But my version of tr (5.97) doesn't seem to support multibyte sets.
$ locale charmap; echo "Je vais ŕ l'école" | tr éŕ ea
UTF-8
Je vais aa l'aacole
I try to... (2 Replies)
Discussion started by: ripat
2 Replies
2. Shell Programming and Scripting
Hi All,
I have a CSV file in which some fields contains special character for ex:-
my file is file 1
cat file1
abcd,bgfht,ngbht,abvc ****
hdlld,hsgdt,bhfy,knht ****
whenever i am trying to put a 4th feild in a variable its giving me list of all the files i have in current... (6 Replies)
Discussion started by: sam25
6 Replies
3. Shell Programming and Scripting
When I open a file in vi, I see the following characters:
\302\240
Can someone explain what these characters mean. Is it ASCII format? I need to trim those characters from a file.
I am doing the following:
tr -d '\302\240'
---------- Post updated at 08:35 PM ---------- Previous... (1 Reply)
Discussion started by: sid1982
1 Replies
4. Shell Programming and Scripting
Hey guys,
I'm trying to replace "]Facebook" from the text
but
sed 's/]Facebook/Johan/g'
is not working
could you please help me with that? (6 Replies)
Discussion started by: Johanni
6 Replies
5. Shell Programming and Scripting
i need to replace the any special characters with escape characters like below.
test!=123-> test\!\=123
!@#$%^&*()-= to be replaced by
\!\@\#\$\%\^\&\*\(\)\-\= (8 Replies)
Discussion started by: laknar
8 Replies
6. Shell Programming and Scripting
Trying to use code that I found to send only new lines out of a log file by doing:
while :; do
temp=$(tail -1 logfile.out)
awk "/$last/{p=1}p" logfile.out #pipe this to log analyzer program
last="$temp"
sleep 10
done
Script works fine when logfile is basic text, but when it contains... (2 Replies)
Discussion started by: moo72moo
2 Replies
7. Shell Programming and Scripting
Hi,
I am facing a below problem. Inorder to mak sure the below file is fixed width i am using the following command
awk '{printf("%-375s\n", $0) } so as to add trailing spaces at the end for records of length less than 375.
Input file > inp.txt
1©1234
1234
123©1
The output file is... (1 Reply)
Discussion started by: marcus_kosaman
1 Replies
8. Shell Programming and Scripting
grep -i "$line,$opline" COMBO_JUNK|awk -F, '
{
C4+=$4
}
{
}
END {
print C4
}
' OFS=,`
when i run this command in the script.... it o/p all the value as 0 if $line contains any special parameters.....
but the same script if i run in command prompt... it shows... (4 Replies)
Discussion started by: nikhil jain
4 Replies
9. Linux
Hi,
I have tried to convert a UTF-8 file to windows UTF-16 format file as below from unix machine
unix2dos < testing.txt | iconv -f UTF-8 -t UTF-16 > out.txt
and i am getting some chinese characters as below which l opened the converted file on windows machine.
LANG=en_US.UTF-8... (3 Replies)
Discussion started by: phanidhar6039
3 Replies
10. Shell Programming and Scripting
I am trying to develop a script which will work on a source UTF-8 file and perform one or more of the following
It will accept the target encoding as an argument e.g. US-ASCII or ISO-8859-1, etc
1. It should replace all occurrences of characters outside target character set by " " (space) or... (3 Replies)
Discussion started by: hemkiran.s
3 Replies
LEARN ABOUT MOJAVE
base64
base64(n) Text encoding & decoding binary data base64(n)
__________________________________________________________________________________________________________________________________________________
NAME
base64 - base64-encode/decode binary data
SYNOPSIS
package require Tcl 8
package require base64 ?2.4.2?
::base64::encode ?-maxlen maxlen? ?-wrapchar wrapchar? string
::base64::decode string
_________________________________________________________________
DESCRIPTION
This package provides procedures to encode binary data into base64 and back.
::base64::encode ?-maxlen maxlen? ?-wrapchar wrapchar? string
Base64 encodes the given binary string and returns the encoded result. Inserts the character wrapchar every maxlen characters of
output. wrapchar defaults to newline. maxlen defaults to 76.
Note well: If your string is not simple ascii you should fix the string encoding before doing base64 encoding. See the examples.
The command will throw an error for negative values of maxlen, or if maxlen is not an integer number.
::base64::decode string
Base64 decodes the given string and returns the binary data. The decoder ignores whitespace in the string.
EXAMPLES
% base64::encode "Hello, world"
SGVsbG8sIHdvcmxk
% base64::encode [string repeat xyz 20]
eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6
eHl6eHl6eHl6
% base64::encode -wrapchar "" [string repeat xyz 20]
eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6eHl6
# NOTE: base64 encodes BINARY strings.
% set chemical [encoding convertto utf-8 "Cu2088Hu2081u2080Nu2084Ou2082"]
% set encoded [base64::encode $chemical]
Q+KCiEjigoHigoBO4oKET+KCgg==
% set caffeine [encoding convertfrom utf-8 [base64::decode $encoded]]
BUGS, IDEAS, FEEDBACK
This document, and the package it describes, will undoubtedly contain bugs and other problems. Please report such in the category base64
of the Tcllib SF Trackers [http://sourceforge.net/tracker/?group_id=12883]. Please also report any ideas for enhancements you may have for
either package and/or documentation.
KEYWORDS
base64, encoding
CATEGORY
Text processing
COPYRIGHT
Copyright (c) 2000, Eric Melski
Copyright (c) 2001, Miguel Sofer
base64 2.4.2 base64(n)