Sponsored Content
Top Forums Shell Programming and Scripting awk and sum with original data Post 303025168 by ranjancom2000 on Thursday 25th of October 2018 12:52:40 PM
Old 10-25-2018
Quote:
Originally Posted by vgersh99
Code:
sort -k4,4 myFile | awk '$4!=p {if(p) print "Total= " tot;p=$4;tot=0} {print;tot+=$NF} END {print "Total= " tot}'

thanks working fine
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Read the data from multiple files and sum the value

Hi all, I have a requirement where i have to read multiple files using Shell Script in Korn Shell. each file will have the 3rd line as the amount field, i have to read this amount field and sum it for all the files. any idea on how to achieve this?? (i think i can achieve it using a loop,... (9 Replies)
Discussion started by: nvuradi
9 Replies

2. Shell Programming and Scripting

Identify matching data in a file and output to original line, in perl

Hi, I haven't done this for awhile, and further, I've never done it in perl so I appreciate any help you can give me. I have a file of lines, each with 5 data points that look like this: AB,N,ALLIANCEBERNSTEIN HLDNG L.P,AB,N ALD,N,ALLIED CAPITAL CORPORATION,ALD,N AFC,N,ALLIED CAPITAL... (4 Replies)
Discussion started by: Pcushing
4 Replies

3. UNIX for Advanced & Expert Users

A variable and sum of its value in a huge data.

Hi Experts, I got a question.. In the following output of `ps -elf | grep DataFlow` I get:- 242001 A mqsiadm 2076676 1691742 0 60 20 26ad4f400 130164 * May 09 - 3:02 DataFlowEngine EAIDVBR1_BROKER 5e453de8-2001-0000-0080-fd142b9ce8cb VIPS_INQ1 0 242001 A mqsiadm... (5 Replies)
Discussion started by: varungupta
5 Replies

4. UNIX for Dummies Questions & Answers

Sum of data in row format

Hi All, I have some numbers in two different files file1 4.21927E+00 4.68257E+00 5.56871E+00 3.59490E+01 7.65806E+01 1.39827E+02 and file2 5.61142E+00 6.21648E+00 7.40152E+00 4.41917E+01 8.31586E+01 1.42938E+02 I would like to get file3 which contains in each column the sum of the... (6 Replies)
Discussion started by: f_o_555
6 Replies

5. Shell Programming and Scripting

Help with calculate total sum of same data problem

Long list of input file: AGDRE1 0.1005449050 AGDRE1 2.1005443435 AGDRE1 1.2005449050 AGDRE1 5.1005487870 AASFV3 50.456304789 AASFV3 2.3659706549 AASFV3 6.3489807860 AASFV3 3.0089890148 RTRTRS 5.6546403546 . . Desired output file: AGDRE1 8.5021829410 AASFV3 62.180245240... (2 Replies)
Discussion started by: perl_beginner
2 Replies

6. Shell Programming and Scripting

AWK print and retain original format

I have a file with very specific column spacing formatting, I wish to do the following: awk '{print $1, $2, $3, $4, $5, $6, $19-$7, $20-$8, $21-$9, $10, $11, $12}' merge.pdb > vector.pdb but the format gets ruined. I have tried with print -f but to no avail.... (7 Replies)
Discussion started by: chrisjorg
7 Replies

7. Shell Programming and Scripting

Help with sum of data set

Input file 2 1159,310, 4 142,199,218,91, 3 91,273,349, Desired output result 2 1469 4 650 3 713 I have long list of input file as shown above. It has a "," delimited to separate between each record in column 2.... (1 Reply)
Discussion started by: perl_beginner
1 Replies

8. Shell Programming and Scripting

Help with sum range of data set together

Input File: 2000 3 1998 2 1997 2 1994 1 1991 1 1989 1 1987 2 1986 2 1985 1 1984 1 . . 10 277256 9 278274 8 282507 7 284837 6 287066 5 292967 (4 Replies)
Discussion started by: perl_beginner
4 Replies

9. UNIX for Advanced & Expert Users

Need Optimization shell/awk script to aggreagte (sum) for all the columns of Huge data file

Optimization shell/awk script to aggregate (sum) for all the columns of Huge data file File delimiter "|" Need to have Sum of all columns, with column number : aggregation (summation) for each column File not having the header Like below - Column 1 "Total Column 2 : "Total ... ...... (2 Replies)
Discussion started by: kartikirans
2 Replies
BTRECORD(8)															       BTRECORD(8)

NAME
btrecord - recreate IO loads recorded by blktrace SYNOPSIS
Usage: btrecord [ options ] <dev...> DESCRIPTION
The btrecord and btreplay tools provide the ability to record and replay IOs captured by the blktrace utility. Attempts are made to main- tain ordering, CPU mappings and time-separation of IOs. The blktrace utility provides the ability to collect detailed traces from the kernel for each IO processed by the block IO layer. The traces provide a complete timeline for each IO processed, including detailed information concerning when an IO was first received by the block IO layer -- indicating the device, CPU number, time stamp, IO direction, sector number and IO size (number of sectors). Using this information, one is able to replay the IO again on the same machine or another set up entirely. The basic operating work-flow to replay IOs would be something like: - Run blktrace to collect traces. Here you specify the device or devices that you wish to trace and later replay IOs upon. Note: the only traces you are interested in are QUEUE requests -- thus, to save system resources (including storage for traces), one could specify the -a queue command line option to blktrace. - While blktrace is running, you run the workload that you are interested in. - When the work load has completed, you stop the blktrace utility (thus saving all traces over the complete workload). - You extract the pertinent IO information from the traces saved by blktrace using the btrecord utility. This will parse each trace file created by blktrace, and crafty IO descriptions to be used in the next phase of the workload processing. - Once btrecord has successfully created a series of data files to be processed, you can run the btreplay utility which attempts to generate the same IOs seen during the sample workload phase. OPTIONS
-d <dir> --input-directory=<dir> Set input directory. This option requires a single parameter providing the directory name for where input files are to be found. The default directory is the current directory (.). -D <dir> --output-directory=<dir> Set output directory. This option requires a single parameter providing the directory name for where output files are to be found. The default directory is the current directory (.). -F --find-traces Find trace files automatically This option instructs btreplay to go find all the trace files in the directory specified (either via the -d option, or in the default directory (.). -h --help Show help and exit. -V --version Show version number and exit. -m <nanoseconds> --max-bunch-time=<nanoseconds> The -m option requires a single parameter which specifies an amount of time (in nanoseconds) to include in any one bunch of IOs that are to be processed. The smaller the value, the smaller the number of IOs processed at one time -- perhaps yielding in more realis- tic replay. However, after a certain point the amount of overhead per bunch may result in additional real replay time, thus yield- ing less accurate replay times. The default value is 10,000,000 nanoseconds (10 milliseconds). -M <num> --max-pkts=<num> Set maximum number of packets per bunch. The -M option requires a single parameter which specifies the maximum number of IOs to store in a single bunch. As with the -m option, smaller values may or may not yield more accurate replay times. The default value is 8, with a maximum value of up to 512 being supported. -o <basename> --output-base=<basename> Set base name for output files. Each output file has 3 fields: 1. Device identifier (taken directly from the device name of the blktrace output file). 2. btrecord base name -- by default ``replay''. 3. The CPU number (again, taken directly from the blktrace output file name). This option requires a single parameter that will override the default name (replay), and replace it with the specified value. -v --verbose Enable verbose output. This option will output some simple statistics at the end of a successful run. Example output is: sdab:0: 580661 pkts (tot), 126030 pkts (replay), 89809 bunches, 1.4 pkts/bunch sdab:1: 2559775 pkts (tot), 430172 pkts (replay), 293029 bunches, 1.5 pkts/bunch sdab:2: 653559 pkts (tot), 136522 pkts (replay), 102288 bunches, 1.3 pkts/bunch sdab:3: 474773 pkts (tot), 117849 pkts (replay), 69572 bunches, 1.7 pkts/bunch The meaning of the columns is: 1. The first field contains the device name and CPU identifier. Thus: sdab:0: means the device sdab and traces on CPU 0. 2. The second field contains the total number of packets processed for each device file. 3. The next field shows the number of packets eligible for replay. 4. The fourth field contains the total number of IO bunches. 5. The last field shows the average number of IOs per bunch recorded. AUTHORS
btrecord was written by Alan D. Brunelle. This man page was created from the btreplay documentation by Bas Zoetekouw. REPORTING BUGS
Report bugs to <linux-btrace@vger.kernel.org> COPYRIGHT
Copyright (C) 2007 Alan D. Brunelle, Alan D. Brunelle and Nathan Scott. This is free software. You may redistribute copies of it under the terms of the GNU General Public License <http://www.gnu.org/licenses/gpl.html>. There is NO WARRANTY, to the extent permitted by law. This manual page was created for Debian by Bas Zoetekouw. It was derived from the documentation provided by the authors and it may be used, distributed and modified under the terms of the GNU General Public License, version 2. On Debian systems, the text of the GNU General Public License can be found in /usr/share/common-licenses/GPL-2. SEE ALSO
The full documentation for btreplay can be found in /usr/share/doc/blktrace on Debian systems. blktrace (8), blkparse (1), btreplay (8) blktrace git-20071207142532 December 8, 2007 BTRECORD(8)
All times are GMT -4. The time now is 08:30 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy