Concatenating column values with unique id into single row


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Concatenating column values with unique id into single row
# 15  
Old 08-20-2009
Code:
awk -F "          " 'NR>2{t[$1]?t[$1]=t[$1]","$2:t[$1]=$2;next}1 END{for (i in t){print i FS t[i]}}' file

# 16  
Old 08-21-2009
Quote:
Originally Posted by thanhdat
Reuse the code of Tytalus with a little modification:
Code:
awk -F "          " '{t[$1]?t[$1]=t[$1]","$2:t[$1]=$2}END{for (i in t){print i,t[i]}}'  yourfile.txt

Thanks thanhdat, but for few cases the space was less between 2 fields.
I used Danmero code and it was resolved

---------- Post updated at 07:17 AM ---------- Previous update was at 06:17 AM ----------

Quote:
Originally Posted by danmero
Code:
awk -F "          " 'NR>2{t[$1]?t[$1]=t[$1]","$2:t[$1]=$2;next}1 END{for (i in t){print i FS t[i]}}' file

Thanks Danmero!

The output is as desired Smilie

Last edited by jsaravana; 08-21-2009 at 09:16 AM..
# 17  
Old 08-26-2009
Quote:
Originally Posted by jsaravana
Thanks thanhdat, but for few cases the space was less between 2 fields.
I used Danmero code and it was resolved

---------- Post updated at 07:17 AM ---------- Previous update was at 06:17 AM ----------


Thanks Danmero!

The output is as desired Smilie
Hi Danmero,

I have another need based on this output.
Instead of space between 2 columns I need any delimeted like "|" character.
Because I need to insert these values into another table so it will be useful.
Is that possible?

Thanks in advance!

---------- Post updated at 02:29 AM ---------- Previous update was at 01:49 AM ----------

Quote:
Originally Posted by jsaravana
Hi Danmero,

I have another need based on this output.
Instead of space between 2 columns I need any delimeted like "|" character.
Because I need to insert these values into another table so it will be useful.
Is that possible?

Thanks in advance!
I have edited the command as below:
Code:
awk -F " " 'NR>2{t[$1]?t[$1]=t[$1]","$2:t[$1]=$2;next}1 END{for (i in t){print i"|"FS t[i]}}' prod_data.out > res1.out

I got the output fine.

I just noticed that the first few values of prod_data file have not got concatenated

why do they get skipped?
# 18  
Old 08-26-2009
The code will skip(print only) the first 2 lines base on your data sample from https://www.unix.com/shell-programmin...#post302345773
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Find unique values but only in column 1

Hi All, Does anyone have any suggestions/examples of how i could show only lines where the first field is not duplicated. If the first field is listed more than once it shouldnt be shown even if the other columns make it unique. Example file : 876,RIBDA,EC2 876,RIBDH,EX7 877,RIBDF,E28... (4 Replies)
Discussion started by: mutley2202
4 Replies

2. Shell Programming and Scripting

Bring values in the second column into single line (comma sep) for uniq value in the first column

I want to bring values in the second column into single line for uniq value in the first column. My input jvm01, Web 2.0 Feature Pack Library jvm01, IBM WebSphere JAX-RS jvm01, Custom01 Shared Library jvm02, Web 2.0 Feature Pack Library jvm02, IBM WebSphere JAX-RS jvm03, Web 2.0 Feature... (10 Replies)
Discussion started by: kchinnam
10 Replies

3. Shell Programming and Scripting

awk to filter out lines containing unique values in a specified column

Hi, I have multiple files that each contain four columns of strings: File1: Code: 123 abc gfh 273 456 ddff jfh 837 789 ghi u4u 395 File2: Code: 123 abc dd fu 456 def 457 nd 891 384 djh 783 I want to compare the strings in Column 1 of File 1 with each other file and Print in... (3 Replies)
Discussion started by: owwow14
3 Replies

4. UNIX for Dummies Questions & Answers

Unique values in a row sum the next column in UNIX

Hi would like to ask you guys any advise regarding my problem I have this kind of data file.txt 111111111,20 111111111,50 222222222,70 333333333,40 444444444,10 444444444,20 I need to get this file1.txt 111111111,70 222222222,70 333333333,40 444444444,30 using this code I can... (6 Replies)
Discussion started by: reks
6 Replies

5. Shell Programming and Scripting

Print every 5 4th column values as separate row with different first column

Hi, I have the following file, chr1 100 200 20 chr1 201 300 22 chr1 220 345 23 chr1 230 456 33.5 chr1 243 567 90 chr1 345 600 20 chr1 430 619 21.78 chr1 870 910 112.3 chr1 914 920 12 chr1 930 999 13 My output would be peak1 20 22 23 33.5 90 peak2 20 21.78 112.3 12 13 Here the... (3 Replies)
Discussion started by: jacobs.smith
3 Replies

6. Shell Programming and Scripting

Print unique names in each row of a specific column using awk

Is it possible to remove redundant names in the 4th column? input cqWE 100 200 singapore;singapore AZO 300 400 brazil;america;germany;ireland;germany .... .... output cqWE 100 200 singapore AZO 300 400 brazil;america;germany;ireland (4 Replies)
Discussion started by: quincyjones
4 Replies

7. Shell Programming and Scripting

Subtracting each row from the first row in a single column file using awk

Hi Friends, I have a single column data like below. 1 2 3 4 5 I need the output like below. 0 1 2 3 4 where each row (including first row) subtracting from first row and the result should print below like the way shown in output file. Thanks Sid (11 Replies)
Discussion started by: ks_reddy
11 Replies

8. Shell Programming and Scripting

duplicate row based on single column

I am a newbie to shell scripting .. I have a .csv file. It has 1000 some rows and about 7 columns... but before I insert this data to a table I have to parse it and clean it ..basing on the value of the first column..which a string of phone number type... example below.. column 1 ... (2 Replies)
Discussion started by: mitr
2 Replies

9. Shell Programming and Scripting

print unique values of a column and sum up the corresponding values in next column

Hi All, I have a file which is having 3 columns as (string string integer) a b 1 x y 2 p k 5 y y 4 ..... ..... Question: I want get the unique value of column 2 in a sorted way(on column 2) and the sum of the 3rd column of the corresponding rows. e.g the above file should return the... (6 Replies)
Discussion started by: amigarus
6 Replies

10. Shell Programming and Scripting

Converting Column values to comma delimted single Row

I have a requirement in which i have to read a file which has multiple columns seperated by a pipe "|" from this i have to read each column values seperately and create a comma seperated row for the column and write to another file. eg: Input file: ColA ColB 1 2 2 x 3 y... (5 Replies)
Discussion started by: nvuradi
5 Replies
Login or Register to Ask a Question