help with file processing


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting help with file processing
# 1  
Old 03-08-2011
help with file processing

Hi ,

I have a memory file like this with two columns:
Code:
@C010   AA
@C011   AA
@C012   FE
@C013   FF
@C014   F7
@C015   FF

first is memory add, second is the data.
I wan to convert into a serial sequence starting from '00000' all the way to 'FFFFF' with those fields from the above file filled in. The rest will be filled with '00'.
Any help would be greatly appreciated.

Best Regards.

Last edited by Franklin52; 03-09-2011 at 04:28 AM.. Reason: Please use code tags, thank you
# 2  
Old 03-08-2011
Please show us an example of what the output is like?
This User Gave Thanks to yinyuemi For This Post:
# 3  
Old 03-08-2011
What should be the output of the above sample?
# 4  
Old 03-09-2011
Code:
awk -F"[@ ]" '{a[$2]=$3}END{for (i=0;i<=66535;i++) {t=sprintf ("%04X",i);print "@" t,(t in a)? a[t]:"00"}}' infile

....
@C007 00
@C008 00
@C009 00
@C00A 00
@C00B 00
@C00C 00
@C00D 00
@C00E 00
@C00F 00
@C010 AA
@C011 AA
@C012 FE
@C013 FF
@C014 F7
@C015 FF
@C016 00
@C017 00
@C018 00
@C019 00
....

# 5  
Old 03-09-2011
Thanks for all your replies. Sorry forgot to provide the output format.

Address should start from '00000' and go to 'FFFFF' in the first column and grab the values from the input file for the data. For the missing address/data in the input file it should put a '00' in the data field.

Example input:
********begin*****
Code:
C010   AA
C011   AA
C012   FE
C013   FF
C014   F7
C015   FF

********end*********
Example output:
*************begin***********
Code:
00000 00
00001 00
00002 00
...
...
0C009 00
0C010 AA
0C011 AA
0C012 FE
0C013 FF
0C014 F7
0C015 FF
0C016 00
..
..
FFFFE 00
FFFFF 00

*************end***********
Moderator's Comments:
Mod Comment
Please use code tags when posting data and code samples!

Last edited by vgersh99; 03-09-2011 at 02:13 PM.. Reason: code tags, please!
# 6  
Old 03-09-2011
Quote:
Originally Posted by rdcwayx
Code:
for (i=0;i<=66535;i++)

Assuming that's intended to be the decimal equivalent of the 0x0000-0xFFFF range, there's a typo in the upper value. It should be 65535 instead of 66535.

However, I believe the original problem spans up to 0xFFFFF, 2^20-1, 1048575.

Regards,
Alister
# 7  
Old 03-09-2011
Thanks for the help but this:
Code:
 
awk -F"[@ ]" '{a[$2]=$3}END{for (i=0;i<=66535;i++) {t=sprintf ("%04X",i);print "@" t,(t in a)? a[t]:"00"}}' infile

actually replaced all the second columns in my output files with '00' instead of the values from my input file.

Please help.
Thank you.

Last edited by Franklin52; 03-09-2011 at 03:14 PM.. Reason: Correcting code tags
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

awk - Rename output file, after processing, same as input file

I have one input file ABC.txt and one output DEF.txt. After the ABC is processed and created output, I want to rename ABC.txt to ABC.orig and DEF to ABC.txt. Currently when I am doing this, it does not process the input file as it cannot read and write to the same file. How can I achieve this? ... (12 Replies)
Discussion started by: High-T
12 Replies

2. Programming

awk processing / Shell Script Processing to remove columns text file

Hello, I extracted a list of files in a directory with the command ls . However this is not my computer, so the ls functionality has been revamped so that it gives the filesizes in front like this : This is the output of ls command : I stored the output in a file filelist 1.1M... (5 Replies)
Discussion started by: ajayram
5 Replies

3. Shell Programming and Scripting

Recursive file processing from a path and printing output in a file

Hi All, The script below read the path and searches for the directories/subdirectories and for the files. If files are found in the sub directories then read the content of the all files and put the content in csv(comma delimted) format and the call the write to xml function to write the std... (1 Reply)
Discussion started by: Optimus81
1 Replies

4. Shell Programming and Scripting

File Processing

i am having the input file as below 123456789: xxxxx12xxxxxxxxxxxxxxxxxx a_cnt 123456789: xxxxxxxxxxxxxxxxxxxxxxx a_cnt 123456789: a_cnt xxxxaq1wsxxxxxxxxxxxx12xxxxxxxxxx 123456789: xxxxxxxxxxxxasxxxx a_cnt i need the numbers in the backets of a_cnt O/p required as below 1 2 3 4... (2 Replies)
Discussion started by: expert
2 Replies

5. Shell Programming and Scripting

How to make parallel processing rather than serial processing ??

Hello everybody, I have a little problem with one of my program. I made a plugin for collectd (a stats collector for my servers) but I have a problem to make it run in parallel. My program gathers stats from logs, so it needs to run in background waiting for any new lines added in the log... (0 Replies)
Discussion started by: Samb95
0 Replies

6. Shell Programming and Scripting

How to processing the log file within certain dates based on the file name

Hi I am working on the script parsing specific message "TEST" from multiple file. The log file name looks like: N3.2009-11-26-03-05-02.console.log.tar.gz N4.2009-11-29-00-25-03.console.log.tar.gz N6.2009-12-01-10-05-02.console.log.tar.gz I am using the following command: zgrep -a --text... (1 Reply)
Discussion started by: shyork2001
1 Replies

7. Shell Programming and Scripting

how to change the current file processing to some other random file in awk ?

Hello, say suppose i am processing an file emp.dat the field of which are deptno empno empname etc now say suppose i want to change the file to emp.lst then how can i do it? Here i what i attempted but in vain BEGIN{ system("sort emp.dat > emp.lst") FILENAME="emp.lst" } { print... (2 Replies)
Discussion started by: salman4u
2 Replies

8. Shell Programming and Scripting

Checking for a control file before processing a data file

Hi All, I am very new to Shell scripting... I got a requirement. I will have few text files(data files) in a particular directory. they will be with .txt extension. With same name, but with a different extension control files also will be there. For example, Sample_20081001.txt is the data... (4 Replies)
Discussion started by: purna.cherukuri
4 Replies

9. Shell Programming and Scripting

Have a shell script check for a file to exist before processing another file

I have a shell script that runs all the time looking for a certain type of file and then it processes the file through a series of other scripts. The script is watching a directory that has files uploaded to it via SFTP. It already checks the size of the file to make sure that it is not still... (3 Replies)
Discussion started by: heprox
3 Replies
Login or Register to Ask a Question