Shell script count lines and sum numbers from multiple files Post: 302985985

Sponsored Content

Top Forums Shell Programming and Scripting Shell script count lines and sum numbers from multiple files Post 302985985 by Elly on Thursday 17th of November 2016 04:11:04 PM

11-17-2016

Registered User

Hi RudiC, I am sorry my mistake, I was not clear up, so, look:

I have a directoy with files .CSV with names like this : ESTCOL_GPRS_201611*, these files are a lot, in the * are hour, Minute and seconds. The contents of these files are strings like these:

Code:

COMGPRS,CGHW12,COMGPRS_CGHW12_610617.dat,processed_cdr_20161117061743_01680861.cdr,20161117060116,20161117,225,42832

I wanna to count the unique occurrences for the column 2 and sum all of them and the values sum of column 8 to have an output like this:
Files Records
2,433 , 119,930,636

I have been trying something like this, but yet I have not achieved it

Code:

#!/bin/awk -f
BEGIN {
        FS=",";
}
{
        if (($1 == "COMGPRS") && ($2 == "ALK_01P")) {
                if (substr($5,1,8) == "20161115") {
                    sum+=$8;
                }
        }
}
END {
                print "Registros," $2 "," $sum;
}

I have not looked even count the number of files (Lineas unique)

Elly

View Public Profile for Elly

Find all posts by Elly

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

trying to count lines in multiple files

Hi there, I need help. I want to run the command: less filename | wc -l But on multiple files in a directory So to get those files I would run ls -ltr | grep filename_2000123 or of course ls -ltr *filename_2000123* But I am having a problem running a loop to get a count of each...

2. Shell Programming and Scripting

how to find a sum of multiple numbers

I have a command which returns some numbers as follows: $ls -l ${dbname}.ix* | awk '{print $5 }' 929792 36864 57344 73728 53248 114688 How can I find the sum of those numbers by piping this output into 'awk' or some other editor/command? Thanks a lot -A

3. Shell Programming and Scripting

sum numbers in multiple files

I have 11 directories with around 200 files in each. In each directory the files are labeled out.0 through out.201 . Each file has around 118 numbers in a single column. I need to sum the files in each directory so each directory will have a resultant vector that is 118 numbers long. I then...

4. Shell Programming and Scripting

Shell script to find the sum of first n Fibonacci numbers

pls give me the solution for this i need it for my exam pls pls pls Shell script to find the sum of first n Fibonacci numbers

5. Homework & Coursework Questions

Help with shell script to find sum of first n numbers of Fibonacci series

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: Shell script to find sum of first n numbers of Fibonacci series 2. Relevant commands, code, scripts,...

6. Shell Programming and Scripting

Sum Numbers from different files

Hi All, I need to print the sum of numbers from different files. Input files: file1.out 10 20 30 file2.out 10 20 30

7. Shell Programming and Scripting

sum numbers of multiple files

Hi, I want to count the number of occurrences of numbers from a file of 6,000,000 lines. Because its too large, I decided to split the counts up in multiple files. So I have files of the counts of 5,000 lines. Now I want to add up the counts of all those files. The "counts file" looks like...

8. Shell Programming and Scripting

Count lines from multiple files (3)

Hey everyone, I've to count lines from string of files names then to show sum output of lines. for example: read x = F1 F2 F3 F1 = 12 lines F2 = 14 lines F3 = 10 lines = 36 what I did is: read x echo $x >|temp for x in $(cat temp) do wc -l < $x

9. Shell Programming and Scripting

Sum of numbers in three or more files

I have files : cat file1 15 88 44 667 33 4cat file2 445 66 77 3 56

10. Shell Programming and Scripting

Script Shell: Count The sum of numbers in a file

Hi all; Here is my file: V1.3=4 V1.4=5 V1.1=3 V1.2=6 V1.3=6 Please, can you help me to write a script shell that counts the sum of values in my file (4+5+3+6+6) ? Thank you so much for help. Kind regards.

LEARN ABOUT HPUX

sum

sum(1)							      General Commands Manual							    sum(1)

NAME

       sum - print checksum and block or byte count of file(s)

SYNOPSIS

       [file ...]

   Remarks
       is obsolescent and should not be used in new applications that are intended to be portable between systems.  Use instead (see cksum(1)).

DESCRIPTION

       calculates  and	prints to standard output a checksum for each named file, and also prints the size of the file in 512 byte blocks, rounded
       up.

       The default algorithm is a 16-bit sum of the bytes in which overflow is ignored.   Alternate  algorithms  can  be  selected  with  the  and
       options.

       Standard input is used if no file names are given.

       is typically used to verify data integrity when copying files between systems.

   Options
       recognizes the following options:

	      Use an alternate algorithm in which the 16-bit sum is right rotated
			with each byte in computing the checksum.

	      Use the 32-bit cyclical redundancy check (CRC) algorithm used by

RETURN VALUE

       returns the following values upon completion:

	      All files were processed successfully.

	      One or more files could not be read or some other error occurred.

       If an inaccessible file is encountered, continues processing any remaining files, but the final exit status is affected.

DIAGNOSTICS

       Read error conditions are indistinguishable from end of file on most devices; check the block or byte count.

WARNINGS

       This  command  is  likely  to  be withdrawn from X/Open standards.  Applications using this command might not be portable to other vendors'
       platforms. The usage of cksum(1) is recommended.

SEE ALSO

       cksum(1), wc(1).

STANDARDS CONFORMANCE

																	    sum(1)