Detect lines beginning with double-byte characters (Japanese) and delete - Page 2

ubbeauty · #8 (**permalink**) 3 Days Ago

Thanks guys, that worked great! I ran "diff" and the outputs of both the awk and perl commands are identical for my working file.

I'm new at this - but I used the command like this:

awk 'substr($0,1,1) < "\200"' file1 > file2

Question: How to interpret the "\200"?

Ygor · #9 (**permalink**) 2 Days Ago

The string "\200" represents a single character with octal value 200, which in binary is 10000000, i.e. the most significant bit is set to 1.
So, the supplied awk code prints lines where the first character's most significant bit is not set.

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
Email a File from UNIX which has Japanese characters in it	jainkirti	Shell Programming and Scripting	4	09-07-2009 08:22 AM
delete beginning field.	daveisme	Shell Programming and Scripting	2	08-28-2009 12:11 PM
delete zero byte file	dsdev_123	Shell Programming and Scripting	2	04-29-2009 12:21 PM
Add new lines with a space in beginning	Aejaz	UNIX for Advanced & Expert Users	8	05-01-2008 12:21 PM
delete lines from file2 beginning w/file1	michieka	Shell Programming and Scripting	13	06-24-2003 01:42 PM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread: