Sub TOTAL Columns


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Sub TOTAL Columns
# 1  
Old 08-29-2014
Sub TOTAL Columns

Input

Code:
435,BL_lmapm03,rrr,RDF1+TDEV,0cef,45,mask1
435,BL_lmapm03,rrr,TDEV,080a,50,mask2
435,BL_lmapm02,fff,RDF1+TDEV,0ceg,45,mask4
435,BL_lmapm02,fff,TDEV,080b,60,mask6
435,BL_lmapm06,hhh,TDEV,080f,60,mask9


Output

Code:
435,BL_lmapm03,rrr,RDF1+TDEV,0cef,45,mask1
435,BL_lmapm03,rrr,TDEV,080a,50,mask2
435,BL_lmapm03,rrr,TOTAL,95

435,BL_lmapm02,fff,RDF1+TDEV,0ceg,45,mask4
435,BL_lmapm02,fff,TDEV,080b,60,mask6
435,BL_lmapm02,fff,TOTAL,105

435,BL_lmapm06,hhh,TDEV,080f,60,mask9
435,BL_lmapm06,hhh,TOTAL,60


Total $6 where $1 and $3 are same and add a blank line after TOTAL .
I tried something very basic ... but not quite the result
Code:
nawk -F, '!/^ *$/{a[$1OFS$3]+=$6} END{for(i in a){print i OFS a[i]}}' OFS=,  file

Code:
435,fff,105
435,rrr,95
435,hhh,60



Thanks !

Last edited by Scrutinizer; 08-29-2014 at 12:05 PM.. Reason: Additional code tags
# 2  
Old 08-29-2014
If the records are grouped, you could try:
Code:
awk '{i=$1 FS $2 FS $3} i!=p {if(p) print p,"TOTAL",t ORS; t=0} {p=i; t+=$6}1 END{print p,"TOTAL",t}' FS=, OFS=, file

This User Gave Thanks to Scrutinizer For This Post:
# 3  
Old 08-30-2014
Thx Scruntinizer , Getting this error when running ...
awk: line 1: syntax error at or near END
# 4  
Old 08-30-2014
Try changing 1 END in that script to {print} END.

And, since you seem to be running this on a Solaris/SunOS system, change awk to /usr/xpg4/bin/awk, /usr/xpg6/bin/awk, or nawk.
This User Gave Thanks to Don Cragun For This Post:
# 5  
Old 08-30-2014
Or try 1; END.
This User Gave Thanks to RudiC For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Evaluate 2 columns, add sum IF two columns satisfy the condition

HI All, I'm embedding SQL query in Script which gives following output: Assignee Group Total ABC Group1 17 PQR Group2 5 PQR Group3 6 XYZ Group1 10 XYZ Group3 5 I have saved the above output in a file. How do i sum up the contents of this output so as to get following output: ... (4 Replies)
Discussion started by: Khushbu
4 Replies

2. Shell Programming and Scripting

Compare 2 csv files by columns, then extract certain columns of matcing rows

Hi all, I'm pretty much a newbie to UNIX. I would appreciate any help with UNIX coding on comparing two large csv files (greater than 10 GB in size), and output a file with matching columns. I want to compare file1 and file2 by 'id' and 'chain' columns, then extract exact matching rows'... (5 Replies)
Discussion started by: bkane3
5 Replies

3. Shell Programming and Scripting

Deleting all the fields(columns) from a .csv file if all rows in that columns are blanks

Hi Friends, I have come across some files where some of the columns don not have data. Key, Data1,Data2,Data3,Data4,Data5 A,5,6,,10,, A,3,4,,3,, B,1,,4,5,, B,2,,3,4,, If we see the above data on Data5 column do not have any row got filled. So remove only that column(Here Data5) and... (4 Replies)
Discussion started by: ks_reddy
4 Replies

4. Shell Programming and Scripting

Combine columns from many files but keep them aligned in columns-shorter left column issue

Hello everyone, I searched the forum looking for answers to this but I could not pinpoint exactly what I need as I keep having trouble. I have many files each having two columns and hundreds of rows. first column is a string (can have many words) and the second column is a number.The files are... (5 Replies)
Discussion started by: isildur1234
5 Replies

5. Shell Programming and Scripting

Total of columns

Input file cll_0014_spp,84,uranus,disk33,45 cll_0014_spp,84,pluto,disk3,10 cll_0014_spp,450,pluto,disk4,1 cll_0014_spp,453,pluto,disk46,19 cll_0014_spp,84,neptune,disk34,60 cll_0014_spp,450,neptune,disk4,1 cll_0014_spp,68,neptune,disk54,59 cll_1234_spp,66,satrun,1000... (6 Replies)
Discussion started by: greycells
6 Replies

6. Shell Programming and Scripting

Help with sum total number of record and total number of record problem asking

Input file SFSQW 5192.56 HNRNPK 611.486 QEQW 1202.15 ASDR 568.627 QWET 6382.11 SFSQW 4386.3 HNRNPK 100 SFSQW 500 Desired output file SFSQW 10078.86 3 QWET 6382.11 1 QEQW 1202.15 1 HNRNPK 711.49 2 ASDR 568.63 1 The way I tried: (2 Replies)
Discussion started by: patrick87
2 Replies

7. Shell Programming and Scripting

Single command for add 2 columns and remove 2 columns in unix/performance tuning

Hi all, I have created a script which adding two columns and removing two columns for all files. Filename: Cust_information_1200_201010.txt Source Data: "1","Cust information","123","106001","street","1-203 high street" "1","Cust information","124","105001","street","1-203 high street" ... (0 Replies)
Discussion started by: onesuri
0 Replies

8. Shell Programming and Scripting

Calculate total space, total used space and total free space in filesystem names matching keyword

Good afternoon! Im new at scripting and Im trying to write a script to calculate total space, total used space and total free space in filesystem names matching a keyword (in this one we will use keyword virginia). Please dont be mean or harsh, like I said Im new and trying my best. Scripting... (4 Replies)
Discussion started by: bigben1220
4 Replies

9. UNIX for Dummies Questions & Answers

grep running total/ final total across multiple files

Ok, another fun hiccup in my UNIX learning curve. I am trying to count the number of occurrences of an IP address across multiple files named example.hits. I can extract the number of occurrences from the files individually but when you use grep -c with multiple files you get the output similar to... (5 Replies)
Discussion started by: MrAd
5 Replies
Login or Register to Ask a Question