Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Sum Column Value
Top Forums Shell Programming and Scripting Sum Column Value Post 302909619 by Chubler_XL on Thursday 17th of July 2014 11:59:01 PM
Old 07-18-2014
Nice solution Don, and It only took around 70 seconds to sum a 15 million record test file I built here.

Funny thing is my datafile didn't have any value with more that 2 digits of precision yet the awk.out still disagreed:

Code:
$ time ./don
370831916729.73
370831916729.73

real    0m46.250s
user    1m11.509s
sys     0m0.248s
$ cat awk.out 
3.70832e+11
370831916730.30

The data.txt wasn't anything special I made it like this:

Code:
for((i=0;i<15000000;i++)) {
    printf "1 2 3 %d%04d.%02d\n" $((RANDOM%5)) $((RANDOM%9999)) $((RANDOM % 99))
    [ $((i%1000)) -eq 0 ] && printf "\r%'d" $i >&2
} > data.txt

Last edited by Chubler_XL; 07-18-2014 at 01:09 AM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Column Sum

Hi Friends :D Please help me to modify a small script. I have a file with columns like: xxx 200 xxx 10 yyy 150 yyy 1500 zzz 05 www 120 and so on I have to add the column 2 for a particular column 1. I am trying the script given below, it works fine but takes a lot of time... (2 Replies)
Discussion started by: vanand420
2 Replies

2. UNIX for Dummies Questions & Answers

How do I sum one column based on another column?

Hi, I am new to this forum and new to awk. I have a file that contains 2 columns. Heres an example of what it looks like: 10 + 20 + 40 + 50 - 70 - So the file is tab-delimited. What I want to do is add 10 to column 1 whenever column 2 is + and substract 10 from column 1... (1 Reply)
Discussion started by: phil_heath
1 Replies

3. UNIX for Dummies Questions & Answers

How to sum rows in e.g. column 1 by a category in e.g. column 2

Hi, I've shown an example of what I would like to achieve below. In the example file, I would like to sum the values in column 2 for each distinct category in column 3 (presumably making an array?) and print the sum as well as the category name and length (note:length always corresponds with... (8 Replies)
Discussion started by: auburn
8 Replies

4. Shell Programming and Scripting

Sum Of Column Based On Column Condition

I have a following inputfile MT,AP,CDM,TTML,MUM,GS,SUCC,3 MT,AP,CDM,TTSL,AP,GS,FAIL,9 MT,AP,CDM,RCom,MAH,GS,SUCC,3 MT,AP,CDM,RTL,HP,GS,SUCC,1 MT,AP,CDM,Uni,UPE,GS,SUCC,2 MT,AP,CDM,Uni,MUM,GS,SUCC,2 TTSL,AP,GS,MT,MAH,CDM,SUCC,20 TTML,AP,GS,MT,MAH,CDM,FAIL,10... (2 Replies)
Discussion started by: siramitsharma
2 Replies

5. Shell Programming and Scripting

awk to sum a column based on duplicate strings in another column and show split totals

Hi, I have a similar input format- A_1 2 B_0 4 A_1 1 B_2 5 A_4 1 and looking to print in this output format with headers. can you suggest in awk?awk because i am doing some pattern matching from parent file to print column 1 of my input using awk already.Thanks! letter number_of_letters... (5 Replies)
Discussion started by: prashob123
5 Replies

6. Shell Programming and Scripting

Sum column values based in common identifier in 1st column.

Hi, I have a table to be imported for R as matrix or data.frame but I first need to edit it because I've got several lines with the same identifier (1st column), so I want to sum the each column (2nd -nth) of each identifier (1st column) The input is for example, after sorted: K00001 1 1 4 3... (8 Replies)
Discussion started by: sargotrons
8 Replies

7. UNIX for Dummies Questions & Answers

Match sum of values in each column with the corresponding column value present in trailer record

Hi All, I have a requirement where I need to find sum of values from column D through O present in a CSV file and check whether the sum of each Individual column matches with the value present for that corresponding column present in the trailer record. For example, let's assume for column D... (9 Replies)
Discussion started by: tpk
9 Replies

8. UNIX for Beginners Questions & Answers

Sum the values in the column using date column

I have a file which need to be summed up using date column. I/P: 2017/01/01 a 10 2017/01/01 b 20 2017/01/01 c 40 2017/01/01 a 60 2017/01/01 b 50 2017/01/01 c 40 2017/01/01 a 20 2017/01/01 b 30 2017/01/01 c 40 2017/02/01 a 10 2017/02/01 b 20 2017/02/01 c 30 2017/02/01 a 10... (6 Replies)
Discussion started by: Booo
6 Replies

9. Shell Programming and Scripting

awk to Sum columns when other column has duplicates and append one column value to another with Care

Hi Experts, Please bear with me, i need help I am learning AWk and stuck up in one issue. First point : I want to sum up column value for column 7, 9, 11,13 and column15 if rows in column 5 are duplicates.No action to be taken for rows where value in column 5 is unique. Second point : For... (1 Reply)
Discussion started by: as7951
1 Replies

10. Shell Programming and Scripting

Sum of a column as new column based on header in a script

Hello, I am trying to store sum of a column as a new column inside a file but have to find the column names dynamically I/p c1,c2,c3,c4,c5 10,20,30,40,50 20,30,40,50,60 If i want to find sum only column c1, c3 and output it as c6,c7 O/p c1,c2,c3,c4,c5,c6,c7 10,20,30,40,50,30,70... (6 Replies)
Discussion started by: mkathi
6 Replies

LEARN ABOUT REDHAT

sum

sum(n)									sum								    sum(n)

NAME

       sum - calculate a sum(1) compatible checksum

SYNOPSIS

       package require Tcl 8.2

       package require sum ?1.0?

       ::crc::sum ?-format format? message

       ::crc::sum ?-format format? -filename file

DESCRIPTION

       This  package  provides	a Tcl-only implementation of the sum(1) command which calculates a 16 bit checksum value from the input data.  The
       BSD sum algorithm is used by default but the SysV algorithm is also available.

COMMANDS

       ::crc::sum ?-format format? message

       ::crc::sum ?-format format? -filename file
	      The command takes string data or a file name and returns a checksum value calculated using the sum(1) algorithm. The result is  for-
	      matted using the format(n) specifier provided or as an unsigned integer (%u) by default.

OPTIONS

       -filename name
	      Return a checksum for the file contents instead of for parameter data.

       -format string
	      Return the checksum using an alternative format template.

EXAMPLES

       % crc::sum "Hello, World!"
       37287

       % crc::sum -format 0x%X "Hello, World!"
       0x91A7

       % crc::sum -file sum.tcl
       13392

SEE ALSO

       sum(1), cksum(n), crc32(n)

AUTHORS

       Pat Thoyts

KEYWORDS

       sum, cksum, checksum, crc, crc32, cyclic redundancy check, data integrity, security

crc									1.0								    sum(n)
All times are GMT -4. The time now is 03:52 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy