Awk formatting of a data file - nested for loops?


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Awk formatting of a data file - nested for loops?
# 1  
Old 07-04-2008
Awk formatting of a data file - nested for loops?

Hello - is there any way in awk I can do...


4861 x(1) y(1) z(1)
4959 x(1) y(1) z(1)
5007 x(1) y(1) z(1)
4861 x(2) y(2) z(2)
4959 x(2) y(2) z(2)
5007 x(2) y(2) z(2)
4861 x(3) y(3) z(3)
4959 x(3) y(3) z(3)
5007 x(3) y(3) z(3)

to become...
4861 x(1) y(1) z(1) 4861 x(2) y(2) z(2) 4861 x(3) y(3) z(3)
4959 x(1) y(1) z(1) 4959 x(2) y(2) z(2) 4959 x(3) y(3) z(3)
5007 x(1) y(1) z(1) 5007 x(2) y(2) z(2) 5007 x(3) y(3) z(3)

In order to do this I've tried printing all lines associated with the 4861 measurement first, and then the same with 4959 and 5007, and was then going to merge them. For the first part, this is what I've got so far...

{for (k=1;k<4;k++) {
for (j=1+k;j<11;j=j+3) {
if (NR == j)
printf("%s\n", $0)
}
}}

..but this just prints out the lines in their original order. Is the reason why I can't do this because awk processes on a line by line basis rather than being able to dictate which lines I want to print out in a set order?

The only other thing I can think to do is merge all lines in this array, and then print the various fields I want to be on the same line.

Cheers Smilie
# 2  
Old 07-04-2008
You could accumulate the data in an array indexed by the first field, then print them out at the end, e.g.

Code:
awk '
        { a[$1]=a[$1]$0" " }
        END { for (i in a) { print a[i] } }
' inputfile > outputfile

# 3  
Old 07-04-2008
Ok that's brilliant thanks.

But what if the initial wavelengths sometimes varied, so you might get:

4862 x(1) y(1) z(1)
4958 x(1) y(1) z(1)
5007 x(1) y(1) z(1)
4860 x(2) y(2) z(2)
4959 x(2) y(2) z(2)
5007 x(2) y(2) z(2)
4861 x(3) y(3) z(3)
4959 x(3) y(3) z(3)
5008 x(3) y(3) z(3)

for example. So you couldn't match the lines based on the homogeneity of the value in $1, and therefore had to on the line number. Could you do it this way?
# 4  
Old 07-04-2008
In that case index the array by NR%3, or by pulling out the first value in brackets.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Nested Loops for text file

Hi A text file containing data something likeVehicle: BMW Class checkin_note: Tyre : Four path_id : 11 vault_file_size: -1 Vehicle: Toyota Class checkin_note: Tyre : Four path_id : 11 vault_file_size: -1 Vehicle: Chevrolet Class checkin_note: Tyre : Five path_id :... (7 Replies)
Discussion started by: vipinHasija
7 Replies

2. Shell Programming and Scripting

two while nested loops

for server in $(echo `cat /tmp/ScanHosts_${USERSNAME}.TXT`) do for portnumber in $(echo `cat /tmp/ScanPorts_${USERSNAME}.TXT`) do #echo ${server} ${portnumber} ... (3 Replies)
Discussion started by: SkySmart
3 Replies

3. Shell Programming and Scripting

Two variables in output file name nested for loops

I am trying to use two nested for loops to process some files and then create a new file using both variables in the output file name. I have several files in this naming style: S1_L3_all_R1.fastq S1_L3_all_R2.fastq S1_L4_all_R1.fastq S1_L4_all_R2.fastq . . S1_L8_all_R1.fastq... (3 Replies)
Discussion started by: aminards
3 Replies

4. Shell Programming and Scripting

AWK/Shell script for formatting data in a file

Hi All, Need an urgent help to convert a unix file in to a particular format: **source file:** 1111111 2d2f2h2 3dfgsd3 ........... 1111111 <-- repeats in every nth line. remaining all lines will be different 123ss41 432ff45 ........... 1111111 <-- repetition qwe1234 123weq3... (1 Reply)
Discussion started by: rajivnairfis
1 Replies

5. Shell Programming and Scripting

Nested for loops

Greetings All, The following script attempts to enumerate all users in all groups in the group file(GROUP) and echo the following information: GROUP ---> USER The script is as follows: IFS="," for GROUP in `ypcat -k group | cut -d" " -f1` do for USER in `ypcat -k group... (13 Replies)
Discussion started by: jacksolm
13 Replies

6. Shell Programming and Scripting

KSH nested loops?

KSH isn't my strong suit but it's what my company has to offer. I've got a script with two nested loops, a FOR and UNTIL, and that works fine. When I add a CASE into the mix I end up getting "Unexpected 'done' at line xx" errors. Any suggestions on this? for divi in at ce ci cm co de di fl... (9 Replies)
Discussion started by: mrice
9 Replies

7. Shell Programming and Scripting

formatting data file with awk or sed

Hi, I have a (quite large) data file which looks like: _____________ header part.. more header part.. x1 x2 x3 x4 x5 x6 x7 x8 x9 x10 x11 x12 x13 ... ... x59 x60 y1 y2 y3 y4... ... y100 ______________ where x1, x2,...,x60 and y1, y2,...y100 are numbers of 10 digits (so each line... (5 Replies)
Discussion started by: lego
5 Replies

8. Shell Programming and Scripting

nested for loops

I need help getting over this bump on how nested for loops work in shell. Say i was comparing files in a directory in any other language my for loop would look like so for(int i=0;to then end; i++) for(int y = i+1; to the end; y++) I can't seem to understand how i can translate that... (5 Replies)
Discussion started by: taiL
5 Replies

9. Shell Programming and Scripting

file reading in nested loops

I have to to read files simultaneously in two nested loops,but am getting error can anyone do the needful. useridFile=userIds.txt fname=kiran.txt exec<$useridFile while read line do echo "User IDs are..$line" USER_ID=$line REMOTE_DIR_LOCATION="/home/test/$USER_ID" SOURCE_DIR=$USER_ID... (1 Reply)
Discussion started by: KiranKumarKarre
1 Replies

10. Shell Programming and Scripting

Grepping within nested for loops

Good morning - I have publication lists from 34 different faculty members. I need to end up with the numbers of publications in common across all 34 faculty. I need to grep person1 (last name) in list2, person1 in list3, person1 in list 4, etc., then person2 in list3, person 2 in list4, etc.,... (2 Replies)
Discussion started by: Peggy White
2 Replies
Login or Register to Ask a Question