02-06-2008
subtotal columns
Hello
I have a file that has two (or more) different types of records I want to total. How would I do this using awk?
The file may contain several dozen records. The records are sorted on the database column - what I want to do is get the amount of space that each table has in that database and, add that amount to a variable. When the database changes, I want to print out that subtotal, reset the variable to zero and process the rest of the file.
I've seen examples where awk will total the ENTIRE column but, I need to create subtotals for each database when it changes (2,3,4,maybe more). I'm thinking awk would be the most effective way to go with this; is there something else that I could use? Any help would be greatly appreciated.
Thanks
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi all,
I have created a script which adding two columns and removing two columns for all files.
Filename: Cust_information_1200_201010.txt
Source Data:
"1","Cust information","123","106001","street","1-203 high street"
"1","Cust information","124","105001","street","1-203 high street"
... (0 Replies)
Discussion started by: onesuri
0 Replies
2. UNIX for Dummies Questions & Answers
I have a file with 8 fields. I need the subtotals for fields 7 & 8 when field 5 changes.
cat wk1
01/02/2011/18AB/17/18/000000071/000000033
01/02/2011/18AB/17/18/000000164/000000021
01/02/2011/18AB/17/18/000000109/000000023
01/02/2011/28FB/04/04/000000000/000000000... (2 Replies)
Discussion started by: MS75001
2 Replies
3. UNIX for Advanced & Expert Users
Hi All,
i have a .Csv file in the below format
startTime, endTime, delta, gName, rName, rNumber, m2239max, m2239min, m2239avg, m100016509avg, m100019240max, metric3min, m100019240avg, propValues
11-Mar-2012 00:00:00, 11-Mar-2012 00:05:00, 300.0, vma3550a, a-1_CPU Index<1>, 200237463, 0.0,... (9 Replies)
Discussion started by: mahi_mayu069
9 Replies
4. Shell Programming and Scripting
Hello everyone,
I searched the forum looking for answers to this but I could not pinpoint exactly what I need as I keep having trouble.
I have many files each having two columns and hundreds of rows.
first column is a string (can have many words) and the second column is a number.The files are... (5 Replies)
Discussion started by: isildur1234
5 Replies
5. Shell Programming and Scripting
Hi Friends,
I have come across some files where some of the columns don not have data.
Key, Data1,Data2,Data3,Data4,Data5
A,5,6,,10,,
A,3,4,,3,,
B,1,,4,5,,
B,2,,3,4,,
If we see the above data on Data5 column do not have any row got filled. So remove only that column(Here Data5) and... (4 Replies)
Discussion started by: ks_reddy
4 Replies
6. Shell Programming and Scripting
Hi all, I know this sounds suspiciously like a homework course; but, it is not.
My goal is to take a file, and match my "ID" column to the "Date" column, if those conditions are true, add the total number of minutes worked and place it in this file, while not printing the original rows that I... (6 Replies)
Discussion started by: mtucker6784
6 Replies
7. Shell Programming and Scripting
Please help me on below req
Data in file
ARIZONA HCPAZ 47
ARIZONA HCPAZCONT 3056
ARIZONA AZA 20
CALIFORNIA HC06 878
CALIFORNIA LC04 51
CALIFORNIA LC06 4039
CALIFORNIA HCPCACONT 4960
THE CAMDEN GROUP CAM 83... (7 Replies)
Discussion started by: skchevva
7 Replies
8. Shell Programming and Scripting
Hi all, I'm pretty much a newbie to UNIX. I would appreciate any help with UNIX coding on comparing two large csv files (greater than 10 GB in size), and output a file with matching columns.
I want to compare file1 and file2 by 'id' and 'chain' columns, then extract exact matching rows'... (5 Replies)
Discussion started by: bkane3
5 Replies
9. Shell Programming and Scripting
HI All,
I'm embedding SQL query in Script which gives following output:
Assignee Group Total
ABC Group1 17
PQR Group2 5
PQR Group3 6
XYZ Group1 10
XYZ Group3 5
I have saved the above output in a file.
How do i sum up the contents of this output so as to get following output:
... (4 Replies)
Discussion started by: Khushbu
4 Replies
10. Shell Programming and Scripting
111AKKK|SHA|20|25
111|AKKK|SHA|15|35
112|ABC|FL|25|45
112|ABC|FL|15|15
115|AKKK|ASH|10|15
115|AKKK|ASH|20|20
112|ABC|FL|25|20
115|AKKK|ASH|30|35
111|AKKK|SHA|10|45
112|ABC|KL|15|15
112|ABC|KL|20|25
115|AKKK|ASH|30|35
please write a shell script
output should be below mentioned... (26 Replies)
Discussion started by: udhal
26 Replies
LEARN ABOUT CENTOS
tctmttest
TCTMTTEST(1) Tokyo Cabinet TCTMTTEST(1)
NAME
tctmttest - test cases of the table database API
DESCRIPTION
The command `tctmttest' is a utility for facility test under multi-thread situation. This command is used in the following format. `path'
specifies the path of a database file. `tnum' specifies the number of running threads. `rnum' specifies the number of iterations. `bnum'
specifies the number of buckets. `apow' specifies the power of the alignment. `fpow' specifies the power of the free block pool.
tctmttest write [-tl] [-td|-tb|-tt|-tx] [-rc num] [-lc num] [-nc num] [-xm num] [-df num] [-ip] [-is] [-in] [-it] [-if] [-ix]
[-nl|-nb] [-rnd] path tnum rnum [bnum [apow [fpow]]]
Store records with columns "str", "num", "type", and "flag".
tctmttest read [-rc num] [-lc num] [-nc num] [-xm num] [-df num] [-nl|-nb] [-rnd] path tnum
Retrieve all records of the database above.
tctmttest remove [-rc num] [-lc num] [-nc num] [-xm num] [-df num] [-nl|-nb] [-rnd] path tnum
Remove all records of the database above.
tctmttest wicked [-tl] [-td|-tb|-tt|-tx] [-nl|-nb] path tnum rnum
Perform updating operations selected at random.
tctmttest typical [-tl] [-td|-tb|-tt|-tx] [-rc num] [-lc num] [-nc num] [-xm num] [-df num] [-nl|-nb] [-rr num] path tnum rnum [bnum
[apow [fpow]]
Perform typical operations selected at random.
Options feature the following.
-tl : enable the option `TDBTLARGE'.
-td : enable the option `TDBTDEFLATE'.
-tb : enable the option `TDBTBZIP'.
-tt : enable the option `TDBTTCBS'.
-tx : enable the option `TDBTEXCODEC'.
-rc num : specify the number of cached records.
-lc num : specify the number of cached leaf pages.
-nc num : specify the number of cached non-leaf pages.
-xm num : specify the size of the extra mapped memory.
-df num : specify the unit step number of auto defragmentation.
-ip : create the number index for the primary key.
-is : create the string index for the column "str".
-in : create the number index for the column "num".
-it : create the string index for the column "type".
-if : create the token inverted index for the column "flag".
-ix : create the q-gram inverted index for the column "text".
-nl : enable the option `TDBNOLCK'.
-nb : enable the option `TDBLCKNB'.
-rnd : select keys at random.
-nc : omit the comparison test.
-rr num : specify the ratio of reading operation by percentage.
This command returns 0 on success, another on failure.
SEE ALSO
tcttest(1), tctmgr(1), tctdb(3), tokyocabinet(3)
Man Page 2012-08-18 TCTMTTEST(1)