Averaging all fields while counting repeated records


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Averaging all fields while counting repeated records
# 1  
Old 10-15-2009
Averaging all fields while counting repeated records

Hi every one;

I have a 31500-line text file upon which two following tasks are to be performed:

1: Rearranging the file
2: Taking the average of each column (considering number of zeros) and output the result into a new file

This is the code I've come up with:
Code:
awk '(NR%3150<3150) {print>""NR%175}' infile
while ( j<19 )
awk '{for (i=1;i<=NF;i++) {sum+=$i}} END{d=sort|uniq -c ; print sum/(18-$d)}' $j>>outfile
done

So the first line takes multiple lines in that each following lines output to a different files numbered 1 through 18:
(1,176, 351,526,...)> file1
(2, 177, 352, 527,...)>file2 and so on.
the second awk command takes the average of all fields and append it to the output file.
Here I am also trying to count the number of zeros which does not work.

Any help on this is highly appreciated.
Thanks
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

awk for matching fields between files with repeated records

Hello all, I am having trouble with what should be an easy task, but seem to be missing something fundamental. I have two files, with File 1 consisting of a single field of many thousands of records. I also have File 2 with two fields and many thousands of records. My goal is that when $1 of... (2 Replies)
Discussion started by: jvoot
2 Replies

2. UNIX for Beginners Questions & Answers

Matching fields between two files, repeated records

In two previous posts (here) and (here), I received help from forum members comparing multiple fields across two files and selectively printing portions of each as output based upon would-be matches using awk. I had been fairly comfortable populating awk arrays with fields and using awk's special... (3 Replies)
Discussion started by: jvoot
3 Replies

3. Homework & Coursework Questions

Accepting a phrase and counting the number of times that it is repeated in a specific website

1. The problem statement, all variables and given/known data: Develop a shell script that accepts a phrase and counts the number of times that it is repeated in a specific website. Note: Im not sure if it's the whole website, or just a specific page but im guessing its thewhole website. ... (2 Replies)
Discussion started by: Zakerii
2 Replies

4. Shell Programming and Scripting

Counting the records based on condition

Hi Unix team, I have a file with 30 columns with tab delimited. I need to count the records based on column 18 & 21 data. So I cut the data from the file using awk -F"\t" '{print $18,$21}' foo.txt Following is the output: USED SEDAN USED SUV NEW SUV USED Truck USED Truck USED... (6 Replies)
Discussion started by: karumudi7
6 Replies

5. Shell Programming and Scripting

Counting Fields with awk

ok, so a user can specify options as is shown below: ExA: cpu.pl!23!25!-allow or ExB: cpu.pl!23!25!-block!all options are delimited by the exclamation mark. now, in example A, there are 4 options provided by the user. in example B, there are 5 options provided by the user. ... (3 Replies)
Discussion started by: SkySmart
3 Replies

6. Emergency UNIX and Linux Support

[Solved] Extract records based on a repeated column value

Hi guys, I need help in making a command to find some data. I have multiple files in which multiple records are present.. Each record is separated with a carriage return and in each record there are multiple fields with each field separated by "|" what i want is that I want to extract... (1 Reply)
Discussion started by: m_usmanayub
1 Replies

7. Shell Programming and Scripting

Help in counting the no of repeated words with count in a file

Hi Pls help in solving my doubt.Iam having file like below file1.txt priya jenny jenny priya raj radhika priya bharti bharti Output required: I need a output like count of repeated words with name for ex: priya 3 jenny 2 (4 Replies)
Discussion started by: bha148
4 Replies

8. Shell Programming and Scripting

Help me in counting records from file

Hi, Please help me in counting the below records(1st field) from samplefile: Expected output: Count Descr ------------------------------------------- 7 Mean manager 14 ... (7 Replies)
Discussion started by: prashant43
7 Replies

9. Shell Programming and Scripting

Counting records with AWK

I've been working with an awk script and I'm wondeing id it's possible to count records in a file which DO NOT contain, in this instance fields 12 and 13. With the one script I am wanting to display the count for the records WITH fields 12 and 13 and a seperate count of records WITHOUT fields... (2 Replies)
Discussion started by: Glyn_Mo
2 Replies

10. Shell Programming and Scripting

Count No of Records in File without counting Header and Trailer Records

I have a flat file and need to count no of records in the file less the header and the trailer record. I would appreciate any and all asistance Thanks Hadi Lalani (2 Replies)
Discussion started by: guiguy
2 Replies
Login or Register to Ask a Question
acctcms(8)						      System Manager's Manual							acctcms(8)

NAME
acctcms - Produces command usage summaries from accounting records SYNOPSIS
acctcms [-acjnspot] file ... FLAGS
Displays output in ASCII summary format rather than the default binary format. The acctcms command sorts its output in descending order according to total K-core minutes. The unit K-core minutes is the amount of storage used (in kilobytes) multiplied by the amount of time the buffer was in use. The hog factor is the total CPU time divided by the total real time. The ASCII summary output format has the fol- lowing headings: The COMMAND NAME column specifies the name of the command. Because only object modules are reported by the accounting system, the sh command entry specifies the entry for all shell processes, regardless of their actual names. The NUMBER CMDS column speci- fies the total number of command invocations during the accounting period. The TOTAL KCOREMIN column combines the amount of memory used and the length of time used. Memory is specified in kilobyte blocks, and time is specified in minutes. The TOTAL CPU-MIN column specifies the total CPU time needed to process the command the number of times specified in the NUMBER CMDS column. The TOTAL REAL-MIN column speci- fies the total number of real-time minutes needed to process the command the number of times specified in the NUMBER CMDS column. The MEAN SIZE-K column specifies the average amount of memory in kilobytes used to process the command the number of times specified in the NUMBER CMDS column. The MEAN CPU-MIN column specifies the average amount of CPU time that the command used each time it was processed. The mean CPU minutes are obtained by dividing the total CPU minutes by the total number of commands. The HOG FACTOR column specifies the CPU time needed to process the command the number of times specified in the NUMBER CMDS column with respect to the time required to process all com- mands. This value shows the ratio of system availability to system utilization. The CHARS TRANSFD column specifies the total number of characters that were read or written when the command was processed the number of times specified in the NUMBER CMDS column. The BLOCKS READ column specifies the number of file system blocks (1 block is equivalent to 1 kilobyte) that were read when the command was processed the number of times specified in the NUMBER CMDS column. The number of blocks read may not correspond with the number of characters trans- ferred. Sorts in descending order according to total CPU time rather than total K-core minutes. Combines all commands called only once in the column specified by "***other" in the COMMAND NAME column. Sorts in descending order according to the number of times each command was called. Displays a command summary of nonprime-time commands. Displays a command summary of prime-time commands. Assumes that any file specified after this flag is in binary format. Processes all records as total accounting records. The default binary format splits each heading into prime-time and nonprime-time parts. DESCRIPTION
The acctcms command outputs data in a format called TOTAL COMMAND SUMMARY. This command reads each file specified, combines and sorts all records for identically named processes, and writes them in a binary format to the output device. Files are usually organized in the acct file format. When you specify the -o and -p flags together, the acctcms command produces a summary report that combines commands processed during both prime and nonprime time. All the output summaries specify total usage, except for the number of times run, CPU minutes, and real minutes, which are split into prime-time and nonprime-time minutes. EXAMPLES
To collect command accounting records from one or more source files into a command summary file called today and to maintain a running total summary of commands in a file called cmtotal, add the following lines to an accounting shell script: acctcms [source File(s) ....] > today cp total prev_tot acctcms -s today prev_tot > cmtotal acctcms -a -s cmtotal First, the acctcms command is used to redirect command records in File(s) that you specify to a file called today. Next, the old total com- mand summary file is renamed prev_tot. Then, the command summary records that are collected in the today and the prev_tot files are redi- rected to a new command summary file called cmtotal. These are all binary files. The last acctcms command outputs to the default output device the contents of the cmtotal file in the ASCII default command summary format previously described, so that the report may be dis- played. FILES
Specifies the command path. This is where prime time is set. Accounting header files that define formats for writing accounting files. RELATED INFORMATION
Commands: acct(8), runacct(8) Functions: acct(2) delim off acctcms(8)