Sponsored Content
Top Forums Shell Programming and Scripting Sum up values of columns in 4 files using shell script Post 302652243 by reach.sree@gmai on Wednesday 6th of June 2012 09:08:47 PM
Old 06-06-2012
Sum up values of columns in 4 files using shell script

I am new to shell script.I have records like below in 4 different files which have about 10000 records each, all records unique and sorted based on column 2.
Code:
1 2 3 4 5 6
---------------------------
SR|1010478|000044590|1|0|0|
SR|1014759|000105790|1|0|0|
SR|1016609|000108901|1|0|0|
SR|1017503|000111262|1|0|0|

I want to get column 2 of each file and sum up column 4 of each file and the whole process should not take more than 15-30 min. So my output should be a different file with records as below.
Code:
1 2 3 4 5 6
---------------------------
Total record count = 4
SR|1010478|000044590|4|0|0|
SR|1014759|000105790|4|0|0|
SR|1016609|000108901|3|0|0|
SR|1017503|000111262|2|0|0|

Can someone help me with this

Last edited by Franklin52; 06-07-2012 at 03:56 AM.. Reason: Please use code tags for data and code samples
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Shell script to calc sum of bytes used by files

I'm looking to create a Korn Shell script that, if given a directory as an arg, will calc bytes used by all files in the given directory and display that info. If no command line arg is given the program is to calc and display the bytes used by all the files in the pwd. Example output: ... (3 Replies)
Discussion started by: kecannon
3 Replies

2. Shell Programming and Scripting

sum the columns of files

I have several csv files like this: file1.csv 1 12 1 2 8 9 3 9 2 4 5 9 ... file2.csv 1 0 1 2 2 3 3 4 1 ... file3.csv 1 0 1 2 4 0 ... I want the result like this 1 12 3 2 14 12 3 13 3 (10 Replies)
Discussion started by: frewise
10 Replies

3. Shell Programming and Scripting

Shell script to sum every 3 values

I am looking for an easy way to calculate the sum of three values (*-12, *-01, *-02) which are contained after a comma (,). I have found an awk command that will sum every 3rd value, but I am not interested in the values before the comma (,). awk '{s+=$1}NR%3==0{print s;t+=s;s=0}'I am only... (8 Replies)
Discussion started by: ncwxpanther
8 Replies

4. Shell Programming and Scripting

Query the table and return values to shell script and search result values from another files.

Hi, I need a shell script, which would search the result values from another files. 1)execute " select column1 from table_name" query on the table. 2)Based on the result, need to be grep from .wft files. could please explain about this.Below is the way i am using. #!/bin/sh... (4 Replies)
Discussion started by: Rami Reddy
4 Replies

5. Shell Programming and Scripting

Sum specified values (columns) per row

Hello out there, file.txt: comp51820_c1_seq1 42 N 0:0:0:0:0:0 1:0:0:0:0:0 0:0:0:0:0:0 3:0:0:0:0:0 0:0:0:0:0:0 comp51820_c1_seq1 43 N 0:0:0:0:0:0 0:1:0:0:0:0 0:0:0:0:0:0 0:3:0:0:0:0 0:0:0:0:0:0 comp51820_c1_seq1 44 N 0:0:4:0:3:1 0:0:1:9:0:0 10:0:0:0:0:0 0:3:3:2:2:6 2:2:2:5:60:3... (16 Replies)
Discussion started by: pathunkathunk
16 Replies

6. Shell Programming and Scripting

Shell script count lines and sum numbers from multiple files

I want to count the number of lines, I need this result be a number, and sum the last numeric column, I had done to make this one at time, but I need to make this for a crontab, so, it has to be an script, here is my lines: It counts the number of lines: egrep -i String file_name_201611* |... (5 Replies)
Discussion started by: Elly
5 Replies

7. Shell Programming and Scripting

Help with shell script: selecting rows that have the same values in two columns

Hello, everyone I am beginner for shell programming. I want to print all lines that have the same values in first two columns data: a b 1 2 a a 3 4 b b 5 6 a b 4 6 what I expected is : a a 3 4 b b 5 6 but I searched for one hour in... (2 Replies)
Discussion started by: nengcheng
2 Replies

8. Shell Programming and Scripting

Do replace operation and awk to sum multiple columns if another column has duplicate values

Hi Experts, Please bear with me, i need help I am learning AWk and stuck up in one issue. First point : I want to sum up column value for column 7, 9, 11,13 and column15 if rows in column 5 are duplicates.No action to be taken for rows where value in column 5 is unique. Second point : For... (12 Replies)
Discussion started by: as7951
12 Replies

9. UNIX for Beginners Questions & Answers

Copy columns from one file into another and get sum of column values and row count

I have a file abc.csv, from which I need column 24(PurchaseOrder_TotalCost) to get the sum_of_amounts with date and row count into another file say output.csv abc.csv- UTF-8,,,,,,,,,,,,,,,,,,,,,,,,, ... (6 Replies)
Discussion started by: Tahir_M
6 Replies

10. UNIX for Advanced & Expert Users

Need Optimization shell/awk script to aggreagte (sum) for all the columns of Huge data file

Optimization shell/awk script to aggregate (sum) for all the columns of Huge data file File delimiter "|" Need to have Sum of all columns, with column number : aggregation (summation) for each column File not having the header Like below - Column 1 "Total Column 2 : "Total ... ...... (2 Replies)
Discussion started by: kartikirans
2 Replies
acctprc(8)						      System Manager's Manual							acctprc(8)

NAME
acctprc1, acctprc2, accton - Perform process-accounting procedures SYNOPSIS
acctprc1 [InFile] acctprc2 accton [OutFile] DESCRIPTION
The three acctprc commands, acctprc1, acctprc2, and accton, are used in the runacct shell procedure to produce process-accounting reports. acctprc1 [InFile] The acctprc1 command is used to read records from standard input that are in a format defined by the acct structure in the /usr/include/sys/acct.h header file. This process adds the login names that correspond to user IDs, and then writes corresponding ASCII records to standard output. For each process, the record format includes the following seven unheaded columns: The user ID column includes both traditional and assigned user identification numbers listed in the /etc/passwd file. The login name is the one used for the user ID in the /etc/passwd file. The number of seconds the process consumed when executed during prime-time hours. Prime-time and nonprime-time hours are defined in the /usr/sbin/acct/holidays file. The number of seconds the process consumed when executed during nonprime-time hours. Total number of characters transferred. Total number of blocks read and written. Mean memory size (in kilobyte units). When specified, InFile contains a list of login sessions in a format defined by the utmp structure in the /usr/include/utmp.h header file. The login session records are sorted according to user ID and login name. When InFile is not specified, acctprc1 gets login names from the password file /etc/passwd. The information in InFile is used to distinguish different login names that share the same user ID. acctprc2 The acctprc2 command reads, from standard input, the records written by acctprc1, summarizes them according to user ID and name, and writes sorted summaries to standard output as total accounting records in the tacct format (see the acctmerg command). accton [OutFile] When no parameters are specified with the accton command, account processing is turned off. When you specify an existing OutFile file, process accounting is turned on, and the kernel adds records to that file. You must specify an Outfile to start process accounting. Many shell script procedures expect the file name /var/adm/pacct, the standard process-accounting file. EXAMPLES
To add a user name to each process-accounting record in a binary file and then write these modified binary-file records to an ASCII file named out.file, enter the following line to an accounting shell script: /usr/sbin/acct/acctprc1 < /var/adm/pacct >out.file A user name is added to each record. The raw data in the pacct file is converted to ASCII and added to file out.file. To produce a total binary accounting record of the ASCII output file out.file produced in example 1, enter the following line to an accounting shell script: /usr/sbin/acct/acctprc2 < out.file > /var/adm/acct/nite/daytacct The resulting binary total accounting file, written in the acct format, contains records sorted by user ID. This sorted user ID file, is usually merged with other total accounting records when an acctmerg command is processed to produce a daily summary accounting record called /var/adm/acct/sum/daytacct. To turn on process accounting, enter: /usr/sbin/acct/accton /var/adm/pacct To turn off process accounting, enter: /usr/sbin/acct/accton FILES
Specifies the command path. Specifies the command path. Specifies the command path. RELATED INFORMATION
Commands: acct(8), acctcms(8), acctmerg(8), runacct(8) Functions: acct(2) delim off acctprc(8)
All times are GMT -4. The time now is 01:19 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy