Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

awk append to one line if first field is the same

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk append to one line if first field is the same
# 1  
Old 10-19-2009
awk append to one line if first field is the same
Hi all,

How would I append the second field each time to one line if the first field is the same for example I have this data:


Code:
10430,187976
10430,251588
10430,262904
10430,275008
10430,279892
10430,275008
10430,303740
10430,318136
10430,336988
10430,350324
10430,373648

And I want the output to be

Code:
10430,251588,262904,275008,

# 2  
Old 10-19-2009
Use gawk, nawk or /usr/xpg4/bin/awk on Solaris.
Are you sure you want the final comma?
Code:
awk -F, 'END { for (k in _) print k, _[k] }
{ _[$1] = $1 in _ ? _[$1] FS $2 : $2 }
' infile

Re-reading the post, I'm not sure I understand the requirement ...
# 3  
Old 10-19-2009
Hi radoulov, many thanks for your help, it looks like it is doing what I want.

To explain it, the first column is the process pid, and the 2nd column is the memory use, so I want to append the mem use to the pid so I can graph the data.

Only thing is now the first comma, delimiter seems to get remove when i run this, so i get out put like

Code:
10430 187976,251588,262904,275008,279892,292840,303740,318136,336988,350324,373648,395724,412160,422628,431968,438428,440008,442800,445464,448436,448948,449032,452276,457400

I would like to preserve the , after the pid 10430 so when i import it into excel it doesnt think its separate data
# 4  
Old 10-19-2009
Quote:
Originally Posted by radoulov
Use gawk, nawk or /usr/xpg4/bin/awk on Solaris.
Are you sure you want the final comma?
Code:
awk -F, 'END { for (k in _) print k, _[k] }
{ _[$1] = $1 in _ ? _[$1] FS $2 : $2 }
' infile

Re-reading the post, I'm not sure I understand the requirement ...
radoulov,

This line should have a comma as field separator:

Code:
END { for (k in _) print k FS _[k] }

Regards Smilie
# 5  
Old 10-19-2009
Quote:
Originally Posted by Franklin52
radoulov,

This line should have a comma as field separator:

Code:
END { for (k in _) print k FS _[k] }

Regards Smilie
Correct! Thank you Smilie
Actually, it could be even:

Code:
awk -F, 'END { for (k in _) print _[k] }
{ _[$1] = $1 in _ ? _[$1] FS $2 : $0 }
' infile

With Perl:

Code:
perl -F, -lane'
	push @{ $_{ $F[0] } }, $F[1];
	print map { join ",", $_, @{ $_{$_} } } keys %_
	  if eof
	' infile

Last edited by radoulov; 10-19-2009 at 08:01 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Printing string from last field of the nth line of file to start (or end) of each line (awk I think)

My file (the output of an experiment) starts off looking like this, _____________________________________________________________ Subjects incorporated to date: 001 Data file started on machine PKSHS260-05CP ********************************************************************** Subject 1,... (9 Replies)
Discussion started by: samonl
9 Replies

2. Shell Programming and Scripting

awk to remove line if field has symbols in it

Trying to use awk to remove a line only if $1 contains either ; or :. Thje awk below runs but no lines are removed. Thank you :). awk awk '$1 !~ /;/ || $1 !~ /:/ { print }' file file AARS2;TMEM151B 1 AASS 2 ABAT 3 ABCA1 3 ABCA10 1 ABCA12 2 ABCA13 1 ABCA13:AX746840 2 ABCA2 5 (5 Replies)
Discussion started by: cmccabe
5 Replies

3. Shell Programming and Scripting

Pass awk field to a command line executed within awk

Hi, I am trying to pass awk field to a command line executed within awk (need to convert a timestamp into formatted date). All my attempts failed this far. Here's an example. It works fine with timestamp hard-codded into the command echo "1381653229 something" |awk 'BEGIN{cmd="date -d... (4 Replies)
Discussion started by: tuxer
4 Replies

4. UNIX for Dummies Questions & Answers

Help with awk, where line length and field position are variable

I have several questions about using awk. I'm hoping someone could lend me a hand. (I'm also hoping that my questions make sense.) I have a file that contains pipe separated data. Each line has similar data but the number of fields and the field position on each line is variable. ... (3 Replies)
Discussion started by: Cheese64
3 Replies

5. UNIX for Dummies Questions & Answers

Values with common field in same line with awk

Hi all ! I almost did it but got a small problem. input: cars red cars blue cars green truck black Wanted: cars red-blue-green truck black Attempt: gawk 'BEGIN{FS="\t"}{a = a (a?"-":"")$2; $2=a; print $1 FS $2}' input But I also got the intermediate records... (2 Replies)
Discussion started by: beca123456
2 Replies

6. UNIX for Advanced & Expert Users

awk for a line that contains someting in a field

How would I do something like this when field 4 contains "John". I only want to print field 1 and 4 when when field 4 contains"John". awk -F" " '{print $1 $4} (3 Replies)
Discussion started by: cokedude
3 Replies

7. Shell Programming and Scripting

How to append a character to the last but one field on a specific line?

Hi Guys, I have a file like this: aaa b c d e f fsss g h i k l qqq r t h n I want: aaa b c d e f fsss g h i k l qqq r t h , n ggg p t e d u qqq i o s , k (2 Replies)
Discussion started by: npatwardhan
2 Replies

8. Shell Programming and Scripting

SED or AWK "append line to the previous line"

Hi, How can I remove the line beak in the following case if the line begin with the special char “;”? TEXT Text;text ;text Text;text;text I want to convert the text to: Text;text;text Text;text;text I have already tried to use... (31 Replies)
Discussion started by: research3
31 Replies

9. Shell Programming and Scripting

AWK line by line instead of field by field?

I've been using a lot of awk lately for csv files. But I've been using awk for csv files that contain 32 fields per line. For the first time, I've been given a csv file that contains one field per line (13 fields in each csv file). I need to check that a specific field, or line contains a... (2 Replies)
Discussion started by: yongho
2 Replies

10. Shell Programming and Scripting

Append a field to the end of each line of a file based on searching another file.

Hi All, I have two comma separated value(CSV) files, say FileA and FileB. The contents looks like that shown below. FileA EmpNo,Name,Age,Sex, 1000,ABC,23,M, 1001,DES,24,F, ... (2 Replies)
Discussion started by: ultimate
2 Replies
Login or Register to Ask a Question