Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

sum numbers of multiple files

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting sum numbers of multiple files
# 1  
Old 08-03-2012
sum numbers of multiple files
Hi,

I want to count the number of occurrences of numbers from a file of 6,000,000 lines. Because its too large, I decided to split the counts up in multiple files. So I have files of the counts of 5,000 lines. Now I want to add up the counts of all those files.

The "counts file" looks like this:
Code:
--------- A=1, B=1 --------
1,1,0,0,0,1,1,1,0,0,1,1,0,0,0
2,3,5,0,0,1,2,4,5,6,7...........
--------- A=1, B=2 --------
1,1,0,0,0,1,1,1,0,0,1,1,0,0,0
2,3,5,0,0,1,2,4,5,6,7...........

So I have multiple of those "counts files" which I want to sum.

Does somebody have an idea?

Thanks!
Moderator's Comments:
Mod Comment
Please use code tags when posting data and code samples!
Last edited by vgersh99; 08-03-2012 at 01:05 PM.. Reason: code tags, please!
# 2  
Old 08-03-2012
Please provide a desired output based on a sample input (using code tags).
# 3  
Old 08-03-2012
Which numbers, exactly, are you measuring the occurences of? Does their position matter? What should be done with those header lines? What output would you get from the input you posted?
# 4  
Old 08-03-2012
Sorry I have a biology background, but need to program for a project now, so Im totally new with this..
But my input are multiple files like this:

file 1:
Code:
--------- A=1, B=1 -------- 1,1,0,0,0,1,1,1,0,0,1,1,0,0,0
--------- A=1, B=2 -------- 1,1,0,0,0,1,1,1,0,0,1,1,0,0,0

until A=4, B=4

file 2:
Code:
--------- A=1, B=1 -------- 1,1,0,0,0,1,1,1,0,0,1,1,0,0,0
--------- A=1, B=2 -------- 1,1,0,0,0,1,1,1,0,0,1,1,0,0,0

desired output:
file1 + file 2
Code:
--------- A=1, B=1 -------- 2,2,0,0,0,2,2,2,0,0,2,2,0,0,0
--------- A=1, B=2 -------- 2,2,0,0,0,2,2,2,0,0,2,2,0,0,0

Moderator's Comments:
Mod Comment Code tags for code, please.
Last edited by Corona688; 08-03-2012 at 01:50 PM..
# 5  
Old 08-03-2012
That looks completely different from the data you posted originally. Which is correct?
# 6  
Old 08-03-2012
for some reason the enter is missing in the last post.
Correct is:
Code:
------A=1,B=1--------
0,2,1,2,3,4 etc...

Moderator's Comments:
Mod Comment
Please use code tags when posting data and code samples!
Last edited by vgersh99; 08-03-2012 at 02:08 PM.. Reason: code tags, PLEASE!
# 7  
Old 08-03-2012
In your first post, it shows multiple lines below the headers. What happens to those? Are the lines summed individually or collectively?
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell script count lines and sum numbers from multiple files

I want to count the number of lines, I need this result be a number, and sum the last numeric column, I had done to make this one at time, but I need to make this for a crontab, so, it has to be an script, here is my lines: It counts the number of lines: egrep -i String file_name_201611* |... (5 Replies)
Discussion started by: Elly
5 Replies

2. Shell Programming and Scripting

Need to sum up a column value from multiple files into Credit and Debit categories using awk command

i have multiple files with Batch Header, Record detail & Batch trailer data in the files like : BH 20150225950050N8262 RD 20140918000000 99999999 unk Deferred Settlement -13950 BT01 -13950 *Above sample data donot have the spaces coorectly defined. I do have multiple batch trailer... (1 Reply)
Discussion started by: kcdg859
1 Replies

3. Shell Programming and Scripting

Sum of numbers in three or more files

I have files : cat file1 15 88 44 667 33 4cat file2 445 66 77 3 56 (12 Replies)
Discussion started by: Natalie
12 Replies

4. Shell Programming and Scripting

Sum of a column in multiple files

I am performing the following operation on a file that looks like this 1000 0 10 479.0 1115478.07497 0.0 0.0 0.0872665 1000 10 20 1500.0 3470012.29304 0.0 0.0 0.261799 1000 20 30 2442.0 5676346.87758 0.0 0.0 0.436332 1000 30 40 3378.0 7737905.30957 0.0 0.0 0.610865 1000 40 50 4131.0... (2 Replies)
Discussion started by: kayak
2 Replies

5. UNIX for Dummies Questions & Answers

need [HELP] sum array multiple files

Hi.. I'm very newbie here.. I wonder if somebody can help me.. I have multiple directories with same out file name for each directories.. ./dirA/out.dat ./dirB/out.dat ./dirC/out.dat ..and so on.. for ./dirA/out.dat here is the structure content : for ./dirB/out.dat the same... (4 Replies)
Discussion started by: agiantz
4 Replies

6. Shell Programming and Scripting

need [HELP] sum array multiple files

Hi.. I'm very newbie here.. I wonder if somebody can help me.. I have multiple directories with same out file name for each directories.. ./dirA/out.dat ./dirB/out.dat ./dirC/out.dat ..and so on.. for ./dirA/out.dat here is the structure content : for ./dirB/out.dat the same... (6 Replies)
Discussion started by: agiantz
6 Replies

7. Shell Programming and Scripting

Sum Numbers from different files

Hi All, I need to print the sum of numbers from different files. Input files: file1.out 10 20 30 file2.out 10 20 30 (5 Replies)
Discussion started by: saint2006
5 Replies

8. Shell Programming and Scripting

Read the data from multiple files and sum the value

Hi all, I have a requirement where i have to read multiple files using Shell Script in Korn Shell. each file will have the 3rd line as the amount field, i have to read this amount field and sum it for all the files. any idea on how to achieve this?? (i think i can achieve it using a loop,... (9 Replies)
Discussion started by: nvuradi
9 Replies

9. Shell Programming and Scripting

sum numbers in multiple files

I have 11 directories with around 200 files in each. In each directory the files are labeled out.0 through out.201 . Each file has around 118 numbers in a single column. I need to sum the files in each directory so each directory will have a resultant vector that is 118 numbers long. I then... (5 Replies)
Discussion started by: pattywac
5 Replies

10. Shell Programming and Scripting

how to find a sum of multiple numbers

I have a command which returns some numbers as follows: $ls -l ${dbname}.ix* | awk '{print $5 }' 929792 36864 57344 73728 53248 114688 How can I find the sum of those numbers by piping this output into 'awk' or some other editor/command? Thanks a lot -A (3 Replies)
Discussion started by: aoussenko
3 Replies
Login or Register to Ask a Question