Reformatting data in matrix form Post: 302609823

Sponsored Content

Top Forums Shell Programming and Scripting Reformatting data in matrix form Post 302609823 by Corona688 on Tuesday 20th of March 2012 12:57:30 PM

03-20-2012

Registered User

I have a way to do this, but it will need to be told what the columns are, since it can't go backwards and insert the first line after it's collated everything.

Code:

$ cat rotarr.awk

BEGIN {
        if(!COLS)       COLS="|A|B|C|D"

        split(COLS, C, "|");
        for(N=2; C[N]; N++)     printf("\t%s", C[N]);
        printf("\n");
}

!LASTROW { LASTROW=$2 }

$2 != LASTROW {
        printf("%s", LASTROW);
        for(N=2; C[N]; N++)
        {
                if(!DATA[C[N]]) DATA[C[N]]=DEF;
                printf("\t%s", DATA[C[N]]);
        }

        printf("\n");
        for(X in DATA)  delete DATA[X];
        LASTROW=$2
}

{
        DATA[$1]=$4
        DEF=$3
}

END {
        printf("%s", LASTROW);
        for(N=2; C[N]; N++)
        {
                if(!DATA[C[N]]) DATA[C[N]]=DEF;
                printf("\t%s", DATA[C[N]]);
        }

        printf("\n");
        for(X in DATA)  delete DATA[X];
}

$ awk -v COLS="|A|B|C|D" -f rotarr.awk data

        A       B       C       D
pos1    2       3       4       5
pos2    6       7       9       8
pos3    7       9       7       7

$

This User Gave Thanks to Corona688 For This Post:

Corona688

View Public Profile for Corona688

Visit Corona688's homepage!

Find all posts by Corona688

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

changing data into matrix form

Hi, I have a file whose structure is like this 7 7 1 2 3 4 5 1 3 4 8 6 1 4 5 6 0 2 6 8 3 8 2 5 7 8 0 5 7 9 4 1 3 8 0 2 2 3 5 6 8 basically first two row tell the number of rows and column but the data following them are not arranged in that format. now i want to create another...

2. Shell Programming and Scripting

Reformatting Data in AWK

Dear AWK Users, I have a data set that is so large (Gigabytes) that it cannot be opened in the vi editor in its entirety. But I can manipulate the entire thing in AWK. It is formatted in a regular manner such that it has the variable descriptions or listings preceeding the variables. The latter...

3. Shell Programming and Scripting

extract data from a data matrix with filter criteria

Here is what old matrix look like, IDs X1 X2 Y1 Y2 10914061 -0.364613333 -0.362922333 0.001691 -0.450094667 10855062 0.845956333 0.860396667 0.014440333 1.483899333...

4. Shell Programming and Scripting

Cut and paste data in matrix form

I have large formatted data file with five columns. This has to be rearranged in lower order matrix form as shown below for sample data. 1 2 3 4 5 1.0 3.0 2.0 5.0 3.0 2.0 4.0 3.0 1.0 6.0 2.0 3.0 4.0 5.0 1.0 1.0 4.0 2.0 3.0 5.0 3.0 5.0 4.0 2.0 8.0 1.0 3.0 2.0 4.0 5.0 2.0...

5. Ubuntu

How to convert full data matrix to linearised left data matrix?

Hi all, Is there a way to convert full data matrix to linearised left data matrix? e.g full data matrix Bh1 Bh2 Bh3 Bh4 Bh5 Bh6 Bh7 Bh1 0 0.241058 0.236129 0.244397 0.237479 0.240767 0.245245 Bh2 0.241058 0 0.240594 0.241931 0.241975 ...

6. Shell Programming and Scripting

convert data into matrix- awk

is it possible to count the number of keys based on state and cell and output it as a simple matrix. Ex: cell1-state1 has 2 keys cell3-state1 has 4 keys. Note: Insert 0 if no data available. input key states cell key1 state1 cell1 key1 state2 cell1 key1 ...

7. Shell Programming and Scripting

Transpose Data form Different form

HI Guys, I have data in File A.txt RL03 RL03_A_1 RL03_B_1 RL03_C_1 RL03 -119.8 -119.5 -119.5 RL07 RL07_A_1 RL07_B_1 RL07_C_1 RL07 -119.3 -119.5 -119.5 RL15 RL15_A_1 RL15_C_1 RL15 -120.5 -119.4 RL16...

8. Shell Programming and Scripting

How order a data matrix using awk?

is it possible to order the following row clusters from ascending to descending. thanx in advance input 1 2 4 0 1 2 4 0 3 3 3 3 1 5 1 0 1 5 1 0 6 0 0 0 5 1 1 1...

9. UNIX for Dummies Questions & Answers

Form balanced matrix by filtering data

I need to form a matrix out of unbalanced set of records. First eliminate the sample that do not have at least 3 variables (col2). So, in the example, samples 4 and 5 get eliminated. Then form a matrix of values (col3) from the samples using only variables that are present accross all samples....

10. Shell Programming and Scripting

Match child with parents and form matrix

thank you for letting me join this forum, lots of learning opportunities looks like. Myself a biologist, very new into unix, so please excuse if I use incorrect language. I am using cygwin on windows, it can run perl, awk , sed etc. I have 2 files, the first sample sheet, tells which parent...

LEARN ABOUT XFREE86

glmatrixmode

GLMATRIXMODE(3G)														  GLMATRIXMODE(3G)

NAME

       glMatrixMode - specify which matrix is the current matrix

C SPECIFICATION

       void glMatrixMode( GLenum mode )

PARAMETERS

       mode  Specifies which matrix stack is the target for subsequent matrix operations.  Three values are accepted: GL_MODELVIEW, GL_PROJECTION,
	     and GL_TEXTURE.  The initial value is GL_MODELVIEW.

	     Additionally, if the GL_ARB_imaging extension is supported, GL_COLOR is also accepted.

DESCRIPTION

       glMatrixMode sets the current matrix mode.  mode can assume one of four values:

       GL_MODELVIEW		Applies subsequent matrix operations to the modelview matrix stack.

       GL_PROJECTION		Applies subsequent matrix operations to the projection matrix stack.

       GL_TEXTURE		Applies subsequent matrix operations to the texture matrix stack.

       GL_COLOR 		Applies subsequent matrix operations to the color matrix stack.

       To find out which matrix stack is currently the target of all matrix operations, call glGet with argument GL_MATRIX_MODE. The initial value
       is GL_MODELVIEW.

ERRORS

       GL_INVALID_ENUM is generated if mode is not an accepted value.

       GL_INVALID_OPERATION is generated if glMatrixMode is executed between the execution of glBegin and the corresponding execution of glEnd.

ASSOCIATED GETS

       glGet with argument GL_MATRIX_MODE

SEE ALSO

       glLoadMatrix(3G), glPushMatrix(3G)

																  GLMATRIXMODE(3G)