Sponsored Content
Top Forums Shell Programming and Scripting Search and Replace Extended Ascii Characters Post 302923219 by jim mcnamara on Friday 31st of October 2014 09:04:29 AM
Old 10-31-2014
What we are getting at: your choice of the C locale does not "work" with the file.
So, is the file from an external source like a vendor or is it corrupted?

Because if a line has 100 bytes of characters used in a given locale, the output of your sed will be 100 bytes of data, not 101. So something is going on with the data in the file.

This uses cat as UUOC to simplify the example. You know the fixed record length of your file. For this example assume it is 100.
Code:
 
fsize=$(cat yourfile | wc -c)
echo $((  $fsize % 100   ))

This should produce the answer of zero, meaning all records are the same, correct size. Try it to make sure the file not corrupt. And we are not barking up the wrong tree.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

search and replace in ASCII file

Greetings.... I'm looking for the command and syntax to search files, several actually, that will find the string pattern "\0;" and delete it. I have over 200 files to change :o Thanx (2 Replies)
Discussion started by: karpolu
2 Replies

2. Programming

Extended ascii

Hi all, I would like to change the extended ascii code ( 128 - 255). I tried to change LC_ALL and LANG in current session ( values from locale -a) and for no good. Thanks. (0 Replies)
Discussion started by: avis
0 Replies

3. Shell Programming and Scripting

Replace characters in a string using their ascii value

Hi All, In the HP Unix that i'm using when i initialise a string as Stalled="'30¬G'" Stalled=$Stalled" '30¬C'", it is taking the character ¬ as a comma. I need to grep for 30¬G 30¬C in a file and take its count. But since this character ¬ is not being understood, the count returns a zero. The... (2 Replies)
Discussion started by: roops
2 Replies

4. Shell Programming and Scripting

extended ascii problem

hi i would like to check text files if they contain extended ascii characters within or not. i really dont have any idea how to start your kind help would be very much appreciated thanks. (7 Replies)
Discussion started by: smooth
7 Replies

5. AIX

Printing extended ASCII

Hi All, I'm trying to send extended ascii characters to my HP2055 as part of PCL printer control codes. What I want to do is select a bar code font, print the bar code and reset the printer to the default font. Selecting the bar code font works good. Printing the bar code goes almost ok too. ... (5 Replies)
Discussion started by: petervg
5 Replies

6. Shell Programming and Scripting

Identify extended ascii characters in a file

Hi, Is there a way to identify the lines in a file having extended ascii characters and display the same? For instance I have a file abc.txt having below data aaa|bbb|111|This is first line aaa|bbb|222|This is secõnd line aaa|bbb|333|This is third line aaa|bbb|444|This is foùrth line... (3 Replies)
Discussion started by: decci_7
3 Replies

7. Programming

How to read extended ASCII characters from stdin?

Hi, I want to read extended ASCII characters from keyboard using c language on unix/linux. How to read extended characters from keyboard or by copy-paste in terminal irrespective of locale set in the system. I want to read the input characters from keyboard, store it in an array or some local... (3 Replies)
Discussion started by: sanzee007
3 Replies

8. Shell Programming and Scripting

Removal Extended ASCII using awk

Hi All, I am trying to remove (SELECTIVE - passed as argument) Extended ASCII using Awk based on adhoc basis. Can you please let me know how to do it. I have to implement this using awk only. Thanks & Regads (14 Replies)
Discussion started by: tostay2003
14 Replies

9. Shell Programming and Scripting

Extended ASCII Characters keep on getting reintroduced to text files

I am working with a log file that I am trying to clean up by removing non-English ASCII characters. I am using Bash via Cygwin on Windows. Before I start I set: export LC_ALL=C I clean it up by removing all non-English ASCII characters with the following command; grep -v $''... (4 Replies)
Discussion started by: lewk
4 Replies

10. Shell Programming and Scripting

Convert UTF-8 file to ASCII/ISO8859-1 OR replace characters

I am trying to develop a script which will work on a source UTF-8 file and perform one or more of the following It will accept the target encoding as an argument e.g. US-ASCII or ISO-8859-1, etc 1. It should replace all occurrences of characters outside target character set by " " (space) or... (3 Replies)
Discussion started by: hemkiran.s
3 Replies
YAGI(5) 							File Formats Manual							   YAGI(5)

NAME
yagi - yagi binary output format DESCRIPTION
This manual page describes the output format of the file created by the Yagi-Uda project's yagi program. The file is a binary file with a header of 100 bytes. The header consists of: offset(bytes) information data-type 0 elements int 4 driven int 8 parasitic int 12 min_frequency double 20 max_frequency double 28 design frequency double 36 step_frequency double 44 angular_step double 52 0 double 92 0 double Following the header, there starts the coordinates(x,y,l) of each element and the voltage applied to each element. Then we write the element currents one after the other, at each frequency. Hence the element currents will be written 12,000 times with a 3 element yagi analysed at 4,000 different frequencies. All complex data is stored in a structure of type fcomplex, defined as: struct fcomplex {double real, double imaginary}; offset(bytes) information data-type 100 x1 double /* coordinates */ 108 y1 double 116 l1 double 100+(n-1)*24 x_n double 100+(n-1)*24+8 y_n double 100+(n-1)*24+16 l_n double -------------- Repeated for each element. 100+24*elements Voltage1 fcomplex /* voltage */ 100+24*elements+(n-1)*16 Voltage_n fcomplex -------------- Repeated for each element n at each frequency step f. 100+40*elements Current1@f1 fcomplex /* current */ 100+40*elements+(n-1)*16 Current_n@f1 fcomplex 100+56*elements Current@f2 fcomplex 100+40*elements+(n-1)*16 Current_n@f2 fcomplex FILES
filename.out binary file SEE ALSO
yagi(1), output(1), input(1), optimise(1), first(1) and input(5). AUTHORS
Dr. David Kirkby G8WRB (david.kirkby@onetel.net), with help with converting to DOS from Dr. Joe Mack NA3T (mack@fcrfv2.ncifcrf.gov). Yagi version 1.16 24th October 2000 YAGI(5)
All times are GMT -4. The time now is 05:21 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy