Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

convert columns into rows with respect to first column

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting convert columns into rows with respect to first column
# 1  
Old 04-20-2011
Bug convert columns into rows with respect to first column
Hello All,

Please help me with this file.

My input file (Tab separated) is like:

Code:
 
Abc-01    pc1    -0.69
Abc-01    E2cR    0.459666666666667
Abc-01    5ez.2   1.2265625
Xyz-01    pc1     -0.153
Xyz-01    E2cR    1.7358
Xyz-01    5ez.2   2.0254
Ced-02    pc1    -0.5714
Ced-02    E2cR    0.815
Ced-02    5ez.2  -0.94222222
Tac-01    pc1     4.5556677
Tac-01    E2cR   0.74532
Tac-01    5ez.2  -0.65432233

where order of second col repeats itself when the id(Col 1) changes.

I want an output file (Tab separated) like:

Code:
 
            pc1      E2cR      5ez.2
Abc-01    -0.69    0.459666666666667     1.2265625
Xyz-01    -0.153   1.7358      2.0254
Ced-02    -0.5714    0.815     -0.94222222
Tac-01    4.5556677     0.74532     -0.65432233

where each row present all the data for each Id(Col 1).

I'll be really thankful for your help.
Last edited by mira; 04-20-2011 at 06:07 PM.. Reason: formating
# 2  
Old 04-20-2011
Select UNION Select?
# 3  
Old 04-20-2011
Assuming the values of the second field repeat in the same order as $1 changes...
Code:
nawk '{a[$1]=($1 in a)?a[$1] OFS $3:$3}END{for(i in a) print i,a[i]}' OFS='\t' myFile

This User Gave Thanks to vgersh99 For This Post:
mira
# 4  
Old 04-21-2011
Thanks! vgersh for your post, its working fine but it is not displaying the new headings of the columns which are the values of second col of the input file.

I'll be grateful to you if you can explain " a[$1]=($1 in a)?a[$1] OFS $3:$3 " this part of the code. Thanks again. Smilie
# 5  
Old 04-21-2011
adjust the 'w=15' (width of the column) to your liking/needs.
Code:
nawk -v w=15 '{a[$1]=($1 in a)?a[$1] OFS sprintf("%-*s",w,$3):sprintf("%-*s",w,$3);h[$2]}END{for(i in h) printf("\t%-*s", w,i);print "";for(i in a) print i,a[i]}' OFS='\t' myFile

# 6  
Old 04-22-2011
Code:
a[$1]=($1 in a)?a[$1] OFS $3:$3

checks whether first field ($1) is present in array 'a'; if yes, it appends the third column to it; if not, assign third column.
It's a ternary operator, just like in C, combined with assignment:
Code:
a=(condition)?pass:fail

that can be re-written like this:
Code:
if ($1 in a) 
  a[$1]=a[$1] OFS $3
else
  a[$1]=$3

This User Gave Thanks to mirni For This Post:
mira
# 7  
Old 04-24-2011
Thanks a lot mirni for such a nice explanation. If I have understood clearly then first it checks if $1 is there or not, in a way to check when it reaches end of file. But, I am not clear what is the purpose of assigning third column to $1?

and also its not clear to me which part of the code actually checks when the value of $1 changes?

I'll really thankful if you or vgersh can explain this.

Thanks! again.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Convert rows to columns

I am looking to print the data in columns and after every 3 words it should be a new row. cat example.out | awk 'END { for (i = 0; ++i < m;) print _;print _ }{ _ = _ x ? _ OFS $1 : $1}' m=1| grep -i INNER I am looking to print in a new line after every 3 words. ... (2 Replies)
Discussion started by: lazydev
2 Replies

2. Shell Programming and Scripting

Convert Rows to Columns

Hi Everyone, Could someone shed some lights on how to convert the records in rows form into column basis. 172.29.59.12 IBM,8255-E8B 102691P 8 65536 MB 6100-04-11-1140 172.29.59.15 IBM,8255-E8B 102698P 4 45056 MB 6100-04-11-1140 IP SYS MODEL ... (6 Replies)
Discussion started by: ckwan
6 Replies

3. Shell Programming and Scripting

How to Convert rows in to columns?

Hi Gurus, How to convert rows in to columns using linux shell scripting Input is like (sample.txt) ABC DEF GHI JKL MNO PQR STU VWX YZA BCD output should be (sampleoutput.csv) ABC,DEF,GHI,JKL,MNO PQR,STU,VWX,YZA,BCD (2 Replies)
Discussion started by: infasriniit
2 Replies

4. Shell Programming and Scripting

Convert few columns to rows

Hi! Does anybody help me in converting following data: INPUT looks like this: 20. 100. 30 200. 40. 400. 50. 100. 60. 200. 70. 400. 80. 200. 150. 210. 30. 100. OUTPUT should look like this: 20. 100. 30 200. 40. 400. 50. 100. 60. 200. 70.... (5 Replies)
Discussion started by: lovelinux
5 Replies

5. Shell Programming and Scripting

convert row to column with respect of first column.

Input file A.txt :- C2062 -117.6 -118.5 -117.5 C5145 0 0 0 C5696 0 0 0 Output file B.txt C2062 X -117.6 C2062 Y -118.5 C2062 Z -117.5... (4 Replies)
Discussion started by: asavaliya
4 Replies

6. Shell Programming and Scripting

convert rows to columns

hi, i have the file as below: abc def ghi jkl i want the output as abc,def,ghi,jki please reply, Thanks (4 Replies)
Discussion started by: namitai
4 Replies

7. Shell Programming and Scripting

convert columns into rows

hi, Apologies if this has been covered. I have requirement where i have to convert a single column into multiple column. My data will be like this - 2 3 4 5 6 Output required - 2 3 4 5 6 (1 Reply)
Discussion started by: Nishithinfy
1 Replies

8. Shell Programming and Scripting

convert rows into columns

Hi guys Could anyone advise me how to convert my rows into columns from a file My file would be similar to this: A11 A12 A13 A14 A15 ... A1n A21 A22 A23 A31 A41 A51 ... Am1 Am2 Am3 Am4 Am5 ... Amn The number of rows is not the same to the number of columns Thanks in advance (2 Replies)
Discussion started by: loperam
2 Replies

9. Shell Programming and Scripting

how to convert columns to rows

Hi, I need a shell script for below requirement Input file P1 - 173310 P2 - 173476 P3 - 173230 P4 - 172737 P1 - 173546 P2 - 173765 P3 - 173876 P4 - 172989 Out put file P1 173310 173546 P2 173476 173765 P3 173230 173876 P4 172737 172989 Suresh (6 Replies)
Discussion started by: suresh3566
6 Replies

10. UNIX for Dummies Questions & Answers

How to convert a single column into several rows and columns?

I have a program which gives me the output as a single column with hundreds of rows like: 213 314 324 324 123 I want to be able to create a new file from this file which allows me to set the number of rows and columns in the new file, i.e. for this example, if I specify 3 rows and 2... (5 Replies)
Discussion started by: ashton_smith
5 Replies
Login or Register to Ask a Question