11-11-2016
I'm afraid it's not that easy - in UTF8 (and other) encoded files, characters above the ASCII set are represented by more than one byte, of which every single one will be replaced by a space when running above command. Using the -s option, on the other hand, will squeeze any count of adjacent non-ASCII chars into one single byte.
Last edited by RudiC; 11-11-2016 at 07:15 AM..
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
hello
I have this output
ifspeed 100000000
ifspeed 100000000
collisions 413
collisions 10
duplex full
duplex ... (1 Reply)
Discussion started by: melanie_pfefer
1 Replies
2. Shell Programming and Scripting
Hi,
i have the log attached. Actually i want the long space just become 1 space left
like this :
Rgds, (12 Replies)
Discussion started by: justbow
12 Replies
3. Shell Programming and Scripting
I've got a file (numbers.txt) filled with numbers and I want to replace each one of those numbers with a new random number between 0 and 9. This is my script so far:
#!/bin/bash
rand=$(($RANDOM % 9))
sed -i s//$rand/g numbers.txtThe problem that I have is that it replaces each number with just... (2 Replies)
Discussion started by: hellocatfood
2 Replies
4. Shell Programming and Scripting
Input:
Youcaneasilydothisbyhighlightingyourcode.
Putting space after three characters.
You can eas ily dot his byh igh lig hti ngy our cod e.
How can i do this using sed? (10 Replies)
Discussion started by: cola
10 Replies
5. Shell Programming and Scripting
i need to replace the any special characters with escape characters like below.
test!=123-> test\!\=123
!@#$%^&*()-= to be replaced by
\!\@\#\$\%\^\&\*\(\)\-\= (8 Replies)
Discussion started by: laknar
8 Replies
6. UNIX for Advanced & Expert Users
I created a awk state to calculate the number of success however when the query runs it has a leading zero. Any ideas on how to remove the leading zero from the calculation?
Here is my query:
cat myfile.log | grep | awk '{print $2,$3,$7,$11,$15,$19,$23,$27,$31,$35($19/$15*100)}'
02:00:00... (1 Reply)
Discussion started by: bizomb
1 Replies
7. Shell Programming and Scripting
Thank you for 4 looking this post.
We have a tab delimited file where we are facing problem in a lot of funny character. I have tried using awk but failed that is not working.
In the 5th field ID which is supposed to be a integer only of that file, we are getting corrupted data as below.
I... (12 Replies)
Discussion started by: Srithar
12 Replies
8. UNIX for Dummies Questions & Answers
I would like to remove all characters starting with "%" and ending with ")" in the 4th field - please help!!
1412007819.864 /device/services/heartbeatxx 204 0.547%!i(int=0) 0.434 0.112
1412007819.866 /device/services/heartbeatxx 204 0.547%!i(int=1) 0.423 0.123... (10 Replies)
Discussion started by: snemuk14
10 Replies
9. Shell Programming and Scripting
here's what im trying to do.
i have a file containing lines similar to this:
data.txt:
1hsRmRsbHRiSFZNTTA1dlEyMWFkbU5wUW5CSlIyeDFTVU5SYjJOSFRuWmpia0ZuWXpKV2FHTnRU
1lKUnpWMldrZFZaMG95V25oYQpSelEyWTBka2QyRklhSHBrUjA1b1kwUkJkd3BOVXpWM1lVaG5k... (5 Replies)
Discussion started by: SkySmart
5 Replies
10. UNIX for Beginners Questions & Answers
Hi Folks -
I need help manipulating a file.
For column 2, I need to replace the first 3 leading zeros with spaces.
The file looks like such:
00098|00011250000003|00000000000.0200|D|1|07|51|04INDP |04|00820|CS|000000|092717|000000000000.0000|000|... (3 Replies)
Discussion started by: SIMMS7400
3 Replies
LEARN ABOUT DEBIAN
vt-is-utf8
VT-IS-UTF8(1) Linux User's Manual VT-IS-UTF8(1)
NAME
vt-is-UTF8 - check whether current VT is in UTF8- or byte-mode.
SYNOPSIS
vt-is-UTF8 [-h|--help] [-V|--version] [-q|--quiet]
DESCRIPTION
vt-is-UTF8 checks whether the current VT is in UTF8 mode, by writing (and erasing afterwards) a 3-byte-long UTF8 sequence, and looking how
much chars where displayed by the console driver.
A message telling in which mode the console is is then written to stdout (except if the --quiet option was given).
If the --quiet option is not given, the value returned is 1 if an error occurs, else 0.
OPTIONS
-h --help
display version number, a short help message and exit.
-V --version
display version number and exit.
-q --quiet
do not print on stdout in with mode we are, but return the state as exit-status 1 if in UTF8-mode, 0 if in byte-mode. In case of
error, 0 is returned and a message is displayed on stderr.
BUGS
The check should be done by directly asking the kernel, which is not possible as of kernels 2.0.x.
As of kernel 2.0.35, the byte-mode is sometimes erroneously detected as UTF8-mode, after switching from a 512-chars font to a 256-chars
font. This is probably a console-driver bug.
SEE ALSO
unicode_start(1), unicode_stop(1).
Console tools 10 Aug 1998 VT-IS-UTF8(1)