Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Dealing with Empty files, AWK and Loops
Top Forums UNIX for Dummies Questions & Answers Dealing with Empty files, AWK and Loops Post 302651989 by Corona688 on Wednesday 6th of June 2012 11:52:14 AM
Old 06-06-2012
Code:
$ cat meanvar.awk

BEGIN { OFS="," }

F != FILENAME {
        if(n>0)
        {
                mean=s/n;
                for(i in x)
                {
                        ss += (x[i]-mean)^2;
                        delete x[i];
                }
                var=(ss/n);

                print F, mean, var;
        }

        ss=0;   s=0;    n=0;    F=FILENAME
}

{
        x[++n]=$0;
        s+=$0;
        next
}


END {
        if(n>0)
        {
                mean=s/n;
                for(i in x)
                {
                        ss += (x[i]-mean)^2;
                        delete x[i];
                }
                var=(ss/n);

                print F, mean, var;
        }
}

$ tail -n 100 file*
==> file1 <==
1
2
3
4
5
6
7
8
9
10

==> file2 <==
1
1
1
2
3
3
3
4

==> file3 <==

==> file4 <==
5
5
5
5
5
5
5
5
5
5

$ awk -f meanvar.awk file*

file1,5.5,8.25
file2,2.25,1.1875
file4,5,0

$

These 2 Users Gave Thanks to Corona688 For This Post:
A-V vbe
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

While loops and awk

I am trying to make a script that will replace backslashes in a file, but only if the occurance is a pathname. In the file, there are a lot of regular expressions as well, so I'm trying to preserve the integrity of those regular expressions, but convert Windows relative paths. I'm using bash and... (1 Reply)
Discussion started by: Loriel
1 Replies

2. Shell Programming and Scripting

perl: When dealing with files that do not exist

I have a process run weekly where I must convert data formats for about thirty files. I read a text file that provides all of the filenames and switch settings. My perl code is: for ($j = 1; $j <= $k; $j++) { open(FIN2,$fin2) || die "open: $!"; do other stuff } Every once in... (2 Replies)
Discussion started by: joeyg
2 Replies

3. Shell Programming and Scripting

Dealing with log files

Hi , My requirement is that i need to search for a number of strings in a log file and print them with line numbers.The search should be date wise. The sample log file is : Jan 17 02:45:34 srim6165 MQSIv500: (UKBRKR1P_B.LZ_ BENCHMARKS)BIP2648E: Message backed out to a queue; node... (6 Replies)
Discussion started by: charudpss
6 Replies

4. Shell Programming and Scripting

Dealing with files with spaces in the name

Hello, I'm a computer science major and I'm having problems dealing with file names with spaces in them. Particularly I'm saving a file name in a variable and then using the variable in a compare function i.e. a='te xt.txt' b='file2.txt' cmp $a $b If anyone could help me with this particular... (10 Replies)
Discussion started by: jakethegreycat
10 Replies

5. Shell Programming and Scripting

Iterating over subdirectories and dealing with files within them

Hello, I am working on a coding project for a class and to test the program I have created, I have come up with 100 different test cases. The program takes four text files as input, so each of the test cases is contained in a folder with four files. I have a folder called 'tests', within which... (1 Reply)
Discussion started by: dpryor
1 Replies

6. UNIX Desktop Questions & Answers

awk using 2 input files instead of while loops

Hi Friends, I have two files as input with data that looks like this: file1.txt 1 2 3 4 file2.txt a,aa b,bb c,cc d,dd e,ee f,ff instead of me doing 2 while loops to get the combinations while read line_file1 (2 Replies)
Discussion started by: kokoro
2 Replies

7. UNIX for Dummies Questions & Answers

Dealing with Double Loops, Arrays and GREP

Can someone please help me to learn how to deal with loops, arrays and grep? I have two arrays (lets say I and j) each in a separate file And have file with lines of data I need to extract, such as Ruby Smith: some text here Ruby Smith: some other text here Ruby Brown: some text here Ruby... (10 Replies)
Discussion started by: A-V
10 Replies

8. Shell Programming and Scripting

Dealing with multiple files

Korn Shell I have hundreds of small files like below created every day. A midnight cron job moves them to the location /u04/temp/logs But sometimes I have to manually move these files based a certain dates or time. I have two basic requirements 1.Using mv command I want to move all .dat... (2 Replies)
Discussion started by: kraljic
2 Replies

9. Shell Programming and Scripting

Awk: Dealing with whitespace in associative array indicies

Is there a reliable way to deal with whitespace in array indicies? I am trying to annotate fails in a database using a table of known fails. In a begin block I have code like this: # Read in Known Fail List getline < "'"$failListFile"'"; getline < "'"$failListFile"'"; getline <... (6 Replies)
Discussion started by: Michael Stora
6 Replies

10. Shell Programming and Scripting

Check file from multiple files is empty using awk

I am passing multiple files in awk & since one of the file is empty(say file3) so the same gets skipped & logic goes for toss. Need suggestion/help in checking and putting additional checks for the same awk -F, 'FNR==1 {++filecounter} filecounter==1 {KRL=$2;next} filecounter==2... (8 Replies)
Discussion started by: siramitsharma
8 Replies

LEARN ABOUT REDHAT

rmf

RMF(1)                                                               [nmh-1.5]                                                              RMF(1)

NAME

       rmf - remove an nmh folder

SYNOPSIS

       rmf [+folder] [-interactive | -nointeractive] [-version] [-help]

DESCRIPTION

       Rmf removes all of the messages (files) within the specified (or default) folder, and then removes the folder (directory) itself.

       If  there  are  any  files  within the folder which are not a part of nmh, they will not be removed, and an error will be produced.  If the
       folder is given explicitly or the -nointeractive option is given, then the folder will be removed  without  confirmation.   Otherwise,  the
       user  will be asked for confirmation.  If rmf can't find the current folder, for some reason, the folder to be removed defaults to `+inbox'
       (unless overridden by user's profile entry "Inbox") with confirmation.

       If the folder being removed is a subfolder, the parent folder will become the new current folder, and rmf will produce  a  message  telling
       the user this has happened.  This provides an easy mechanism for selecting a set of messages, operating on the list, then removing the list
       and returning to the current folder from which the list was extracted.

       If rmf s used on a read-only folder, it will delete all the (private) sequences (i.e., "atr-seq-folder" entries) for this folder from  your
       context without affecting the folder itself.

       Rmf irreversibly deletes messages that don't have other links, so use it with caution.

FILES

       $HOME/.mh_profile          The user profile

PROFILE COMPONENTS

       Path:                To determine the user's nmh directory
       Current-Folder:      To find the default current folder
       Inbox:               To find the default inbox

SEE ALSO

       rmm(1)

DEFAULTS

       `+folder' defaults to the current folder, usually with confirmation
       `-interactive' if +folder' not given, `-nointeractive' otherwise

CONTEXT

       Rmf  will  set the current folder to the parent folder if a subfolder is removed; or if the current folder is removed, it will make "inbox"
       current.  Otherwise, it doesn't change the current folder or message.

BUGS

       Although intuitively one would suspect that rmf works recursively, it does not.  Hence if you have a sub-folder within a folder,  in  order
       to rmf the parent, you must first rmf each of the children.

MH.6.8                                                             11 June 2012                                                             RMF(1)
All times are GMT -4. The time now is 12:38 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy