Visit Our UNIX and Linux User Community


Columns to Rows - Transpose - Special Condition


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Columns to Rows - Transpose - Special Condition
# 1  
Old 11-13-2013
Columns to Rows - Transpose - Special Condition

Hi Friends,

Hope all is well.

I have an input file like this

Code:
a gene1 10
b gene1 2
c gene2 20
c gene3 10
d gene4 5
e gene5 6

Steps to reach output.

1. Print unique values of column1 as column of the matrix, which will be

Code:
a
b
c
d
e



2. Print unique values of column2 as row of the matrix, which will be

Code:
gene1 gene2 gene3 gene4 gene5

3. Now print column3 values in the matrix, which will be my final output

Code:
     gene1 gene2 gene3 gene4 gene5
a   10      0        0       0        0
b   2        0        0       0        0
c   0        20      10      0        0
d   0        0        0       5        0
e   0        0        0       0        6

My special condition is nothing but, if there is no value for a combination, print that value to be 0. My input file has more than 50K records. Please let me know if you have any questions. Thanks in advance.

The spacing is messed up while posting this thread. But, my output columns are separated by a tab.
# 2  
Old 11-13-2013
With over 280 posts, we'd expect at least a hint of trying to resolve the issue.
Have you searched the forums for similar questions/issues?
Where exactly are you stuck?

Last edited by vgersh99; 11-13-2013 at 01:06 PM..
This User Gave Thanks to vgersh99 For This Post:
# 3  
Old 11-13-2013
Yes, search and adapt. Has been solved before!
# 4  
Old 11-13-2013
I have tried to make the matrix so far using the following commands.

Code:
awk '{print $2}' input.txt | awk '!x[$0]++' | tr '\n' '\t' > 1.temp

awk '{print $1}' input.txt | awk '!x[$0]++' > 2.temp

cat 1.temp 2.temp > matrix

I am unsure on how you match the row values to column values and print a zero when there is no match. Thanks for provoking to try. Smilie
# 5  
Old 11-13-2013
I'm not sure you really really searched these fora - you might have come across this and the one above it by vgersh99...
This User Gave Thanks to RudiC For This Post:
# 6  
Old 11-13-2013
Quote:
Originally Posted by RudiC
I'm not sure you really really searched these fora - you might have come across this and the one above it by vgersh99...
Thanks Rudic. I was searching online and not in these forums. I will make it a point to do so from next time. It worked. Thank you again.

Previous Thread | Next Thread
Test Your Knowledge in Computers #152
Difficulty: Easy
In 1995, Novell transferred the Unix trademarks to the ACME Computing Company.
True or False?

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Transpose rows to certain columns

Hello, I have the following data and I want to use awk to transpose each value to a certain column , so in case the value is not available the column should be empty. Example: Box Name: BoxA Weight: 1 Length :2 Depth :3 Color: red Box Name: BoxB Weight: 3 Length :4 Color: Yellow... (5 Replies)
Discussion started by: rahman.ahmed
5 Replies

2. Shell Programming and Scripting

Transpose comma delimited data in rows to columns

Hello, I have a bilingual database with the following structure a,b,c=d,e,f The right half is in a Left to right script and the second is in a Right to left script as the examples below show What I need is to separate out the database such that the first word on the left hand matches the first... (4 Replies)
Discussion started by: gimley
4 Replies

3. Shell Programming and Scripting

Transpose rows to columns complex

Input: IN,A,1 IN,B,3 IN,B,2 IN,C,7 BR,A,1 BR,A,5 BR,C,9 AR,C,9 Output: CNTRY,A,B,C IN,1,5,7 BR,6,0,9 AR,0,0,9 (7 Replies)
Discussion started by: unme
7 Replies

4. Shell Programming and Scripting

awk to transpose every 7 rows into columns

input: a1 a2 a3 a4 a5 a6 a7 b1 b2 b3 .. b7 .. z1 .. z7 (12 Replies)
Discussion started by: ux4me
12 Replies

5. Shell Programming and Scripting

Transpose Data from Columns to rows

Hello. very new to shell scripting and would like to know if anyone could help me. I have data thats being pulled into a txt file and currently have to manually transpose the data which is taking a long time to do. here is what the data looks like. Server1 -- Date -- Other -- value... (7 Replies)
Discussion started by: Mikes88
7 Replies

6. Shell Programming and Scripting

transpose rows to columns

Any tips on how I can awk the input data to display the desired output per below? Thanking you in advance. input test data: 2 2010-02-16 10:00:00 111111111111 bytes 99999999999 bytes 90% 4 2010-02-16 12:00:00 333333333333 bytes 77777777777 bytes 88% 5 2010-02-16 11:00:00... (4 Replies)
Discussion started by: ux4me
4 Replies

7. Shell Programming and Scripting

Transpose columns to Rows

I have a data A 1 B 2 C 3 D 4 E 5 i would like to change the data A B C D E 1 2 3 4 5 Pls suggest how we can do it in UNIX. Start using code tags, thanks. Also start reading your PM's you get from Mods as well read the Forum Rules. That might not do any harm. (24 Replies)
Discussion started by: aravindj80
24 Replies

8. Shell Programming and Scripting

Transpose Rows Into Columns

I'm aware there are a lot of resources dedicated to the question of transposing rows and columns, but I'm a total newbie at this and the task appears to be beyond me. I have 40 text files with content that looks like this: Dokument 1 von 146 Orange County Register (California) June 26, 2010... (2 Replies)
Discussion started by: spindoctor
2 Replies

9. Shell Programming and Scripting

Transpose columns to Rows : Big data

Hi, I did read a few posts on the subjects, tried out a few solutions, but did not solve my problem. https://www.unix.com/302121568-post11.html https://www.unix.com/shell-programming-scripting/137953-large-file-columns-into-rows-etc-4.html Please help. Problem very similar to the second link... (15 Replies)
Discussion started by: genehunter
15 Replies

10. Shell Programming and Scripting

Rows to Columns - File Transpose

Hi I have an input file and I want to transpose it but I need to take care that if any field is missing for a record it should be popoulated with space for that field - using a shell script INFILE ---------- emp=1 sal=2 loc=abc emp=2 sal=21 sal=22 loc=xyz emp=5 loc=abc OUTFILE... (10 Replies)
Discussion started by: 46019
10 Replies

Featured Tech Videos