Sponsored Content
Top Forums Shell Programming and Scripting Comparison of fields then increment a counter reading line by line in a file Post 302859337 by selvankj on Wednesday 2nd of October 2013 10:39:31 PM
Old 10-02-2013
hey Jimm

thanks for looking at the post and repsponding

i think i confused you with cond 1 and cond2 , the thing is i have 2-3 conditions and in all instances i will have to get the count of how many times it has occurred, but i tried it prints only one value var1 and not var2 or var3

Code:
awk -F '|' '  $3 =="Y" && $4=="0" && $6=="N" {var1++; next}
                 $3 =="Y" && $6=="N"  {var2++}
                 {next}
                 END{print "condition 1", var1, " condition2", var2}' inputfil


Last edited by Don Cragun; 10-03-2013 at 12:21 AM.. Reason: Remove extraneous PHP tags
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Reading a file line by line and processing for each line

Hi, I am a beginner in shell scripting. I have written the following script, which is supposed to process the while loop for each line in the sid_home.txt file. But I'm getting the 'end of file' unexpected for the last line. The file sid_home.txt gets generated as expected, but the script... (6 Replies)
Discussion started by: sagarparadkar
6 Replies

2. Shell Programming and Scripting

KSH: Reading a file line by line into multiple arrays

Hi - I have a file that contains data in this format:- #comment value1 value2 value3 #comment value4 value5 value6 value7 #comment value8 value9 I need to read value1, value2 and value3 into one array, value4 value5 value6 and value7 into another array and value8 and value9 into a 3rd... (2 Replies)
Discussion started by: sniper57
2 Replies

3. Shell Programming and Scripting

reading a file inside awk and processing line by line

Hi Sorry to multipost. I am opening the new thread because the earlier threads head was misleading to my current doubt. and i am stuck. list=`cat /u/Test/programs`; psg "ServTest" | awk -v listawk=$list '{ cmd_name=($5 ~ /^/)? $9:$8 for(pgmname in listawk) ... (6 Replies)
Discussion started by: Anteus
6 Replies

4. Shell Programming and Scripting

[Solved] Problem in reading a file line by line till it reaches a white line

So, I want to read line-by-line a text file with unknown number of files.... So: a=1 b=1 while ; do b=`sed -n '$ap' test` a=`expr $a + 1` $here do something with b etc done the problem is that sed does not seem to recognise the $a, even when trying sed -n ' $a p' So, I cannot read... (3 Replies)
Discussion started by: hakermania
3 Replies

5. UNIX for Dummies Questions & Answers

Parsing file, reading each line to variable, evaluating date/time stamp of each line

So, the beginning of my script will cat & grep a file with the output directed to a new file. The data I have in this file needs to be parsed, read and evaluated. Basically, I need to identify the latest date/time stamp and then calculate whether or not it is within 15 minutes of the current... (1 Reply)
Discussion started by: hynesward
1 Replies

6. Shell Programming and Scripting

How to start reading from the nth line till the last line of a file.

Hi, For my reuirement, I have to read a file from the 2nd line till the last line<EOF>. Say, I have a file as test.txt, which as a header record in the first line followed by records in rest of the lines. for i in `cat test.txt` { echo $i } While doing the above loop, I have read... (5 Replies)
Discussion started by: machomaddy
5 Replies

7. Shell Programming and Scripting

Reading text file, comparing a value in a line, and placing only part of the line in a variable?

I need some help. I would like to read in a text file. Take a variable such as ROW-D-01, compare it to what's in one line in the text file such as PROD/VM/ROW-D-01 and only input PROD/VM into a variable without the /ROW-D-01. Is this possible? any help is appreciated. (2 Replies)
Discussion started by: xChristopher
2 Replies

8. Shell Programming and Scripting

Reading line by line from live log file using while loop and considering only those lines start from

Hi, I want to read a live log file line by line and considering those line which start from time stamp; Below code I am using, which read line but throws an exception when comparing line that does not contain error code tail -F /logs/COMMON-ERROR.log | while read myline; do... (2 Replies)
Discussion started by: ketanraut
2 Replies

9. UNIX for Beginners Questions & Answers

Reading a file line by line and print required lines based on pattern

Hi All, i want to write a shell script read below file line by line and want to exclude the lines which contains empty value for MOUNTPOINT field. i am using centos 7 Operating system. want to read below file. # cat /tmp/d5 NAME="/dev/sda" TYPE="disk" SIZE="60G" OWNER="root"... (4 Replies)
Discussion started by: balu1234
4 Replies
Test::LectroTest::Property(3pm) 			User Contributed Perl Documentation			   Test::LectroTest::Property(3pm)

NAME
Test::LectroTest::Property - Properties that make testable claims about your software SYNOPSIS
use MyModule; # provides my_function_to_test use Test::LectroTest::Generator qw( :common ); use Test::LectroTest::Property qw( Test ); use Test::LectroTest::TestRunner; my $prop_non_neg = Property { ##[ x <- Int, y <- Int ]## $tcon->label("negative") if $x < 0; $tcon->label("odd") if $x % 2; $tcon->retry if $y == 0; # 0 can't be used in test my_function_to_test( $x, $y ) >= 0; }, name => "my_function_to_test output is non-negative"; my $runner = Test::LectroTest::TestRunner->new(); $runner->run_suite( $prop_non_neg, # ... more properties here ... ); DESCRIPTION
STOP! If you're just looking for an easy way to write and run unit tests, see Test::LectroTest first. Once you're comfortable with what is presented there and ready to delve into the full offerings of properties, this is the document for you. This module allows you to define Properties that can be checked automatically by Test::LectroTest. A Property is a specification of your software's required behavior over a given set of conditions. The set of conditions is given by a generator-binding specification. The required behavior is defined implicitly by a block of code that tests your software for a given set of generated conditions; if your software matches the expected behavor, the block of code returns true; otherwise, false. This documentation serves as reference documentation for LectroTest Properties. If you don't understand the basics of Properties yet, see "OVERVIEW" in Test::LectroTest::Tutorial before continuing. Two ways to create Properties There are two ways to create a property: 1. Use the "Property" function to promote a block of code that contains both a generator-binding specification and a behavior test into a Test::LectroTest::Property object. This is the preferred method. Example: my $prop1 = Property { ##[ x <- Int ]## thing_to_test($x) >= 0; }, name => "thing_to_test is non-negative"; 2. Use the "new" method of Test::LectroTest::Property and provide it with the necessary ingredients via named parameters: my $prop2 = Test::LectroTest::Property->new( inputs => [ x => Int ], test => sub { my ($tcon,$x) = @_; thing_to_test($x) >= 0 }, name => "thing_to_test is non-negative" ); Both are equivalent, but the first is concise, easier to read, and lets LectroTest do some of the heavy lifting for you. The second is probably better, however, if you are constructing property specifications programmatically. Generator-binding specification The generator-binding specification declares that certain variables are to be bound to certain kinds of random-value generators during the tests of your software's behavior. The number and kind of generators define the "condition space" that is examined during property checks. If you use the "Property" function to create your properties, your generator-binding specification must come first in your code block, and you must use the following syntax: ##[ var1 <- gen1, var2 <- gen2, ... ]## Comments are not allowed within the specification, but you may break it across multiple lines: ##[ var1 <- gen1, var2 <- gen2, ... ]## or ##[ var1 <- gen1, var2 <- gen2, ... ]## Further, for better integration with syntax-highlighting IDEs, the terminating "]##" delimiter may be preceded by a hash symbol "#" and optional whitespace to make it appear like a comment: ##[ var1 <- gen1, var2 <- gen2, ... # ]## On the other hand, if you use "Test::LectroTest::Property->new()" to create your objects, the generator-binding specification takes the form of an array reference containing variable-generator pairs that is passed to "new()" via the parameter named "inputs": inputs => [ var1 => gen1, var2 => gen2, ... ] Normal Perl syntax applies here. Specifying multiple sets of generator bindings Sometimes you may want to repeat a property check with multiple sets of generator bindings. This can happen, for instance, when your condition space is vast and you want to ensure that a particular portion of it receives focused coverage while still sampling the overall space. For times like this, you can list multiple sets of bindings within the "##[" and "]##" delimiters, like so: ##[ var1 <- gen1A, ... ], [ var1 <- gen1B, ... ], ... more sets of bindings ... [ var1 <- gen1N, ... ]## Note that only the first and last set need the special delimiters. The equivalent when using "new()" is as follows: inputs => [ [ var1 => gen1A, ... ], [ var1 => gen1B, ... ], ... [ var1 => gen1N, ... ] ] Regardless of how you declare the sets of bindings, each set must provide bindings for the exact same set of variables. (The generators, of course, can be different.) For example, this kind of thing is illegal: ##[ x <- Int ], [ y <- Int ]## The above is illegal because both sets of bindings must use x or both must use y; they can't each use a different variable. ##[ x <- Int ], [ x <- Int, y <- Float ]## The above is illegal because the second set has an extra variable that isn't present in the first. Both sets must use exactly the same variables. None of the variables may be extra, none may be missing, and all must be named identically across the sets of bindings. Behavior test The behavior test is a subroutine that accepts a test-controller object and a given set of input conditions, tests your software's observed behavior against the required behavior with respect to the input conditions, and returns true or false to indicate acceptance or rejection. If you are using the "Property" function to create your property objects, lexically bound variables are created and loaded with values automatically, per your input-generator specification, so you can just go ahead and use the variables immediately: my $prop = Property { ##[ i <- Int, delta <- Float(range=>[0,1]) ]## my $lo_val = my_thing_to_test($i); my $hi_val = my_thing_to_test($i + $delta); $lo_val == $hi_val; }, name => "my_thing_to_test ignores fractions" ; On the other hand, if you are using "Test::LectroTest::Property->new()", you must declare and initialize these variables manually from Perl's @_ variable in lexicographically increasing order after receiving $tcon, the test controller object. (This inconvenience, by the way, is why the former method is preferred.) The hard way: my $prop = Test::LectroTest::Property->new( inputs => [ i => Int, delta => Float(range=>[0,1]) ], test => sub { my ($tcon, $delta, $i) = @_; my $lo_val = my_thing_to_test($i); my $hi_val = my_thing_to_test($i + $delta); $lo_val == $hi_val }, name => "my_thing_to_test ignores fractions" ) ; Control logic, retries, and labeling Inside the behavior test, you have access to a special variable $tcon that allows you to interact with the test controller. Through $tcon you can do the following: o retry the current trial with different inputs (if you don't like the inputs you were given at first) o add labels to the current trial for reporting purposes o attach notes and variable dumps to the current trial for diagnostic purposes, should the trial fail (For the full details of what you can do with $tcon see the "testcontroller" section of Test::LectroTest::TestRunner.) For example, let's say that we have written a function "my_sqrt" that returns the square root of its input. In order to check whether our implementation fulfills the mathematical definition of square root, we might specify the following property: my $epsilon = 0.000_001; Property { ##[ x <- Float ]## return $tcon->retry if $x < 0; $tcon->label("less than one") if $x < 1; my $sx = my_sqrt( $x ); abs($sx * $sx - $x) < $epsilon; }, name => "my_sqrt satisfies defn of square root"; Because we don't want to deal with imaginary numbers, our square-root function is defined only over non-negative numbers. To make sure we don't accidentally check our property "at" a negative number, we use the following line to re-start the trial with a different input should the input we are given at first be negative: return $tcon->retry if $x < 0; An interesting fact is that for all values x between zero and one, the square root of x is larger than x itself. Perhaps our implementation treats such values as a special case. In order to be confident that we are checking this case, we added the following line: $tcon->label("less than one") if $x < 1; In the property-check output, we can see what percentage of the trials checked this case: 1..1 ok 1 - 'my_sqrt satisfies defn of square root' (1000 attempts) # 1% less than one Trivial cases Random-input generators may create some inputs that are trivial and don't provide much testing value. To make it easy to label such cases, you can use the following from within your behavior tests: $tcon->trivial if ... ; The above is exactly equivalent to the following: $tcon->label("trivial") if ... ; SEE ALSO
Test::LectroTest::Generator describes the many generators and generator combinators that you can use to define the test or condition spaces that you want LectroTest to search for bugs. Test::LectroTest::TestRunner describes the objects that check your properties and tells you how to turn their control knobs. You'll want to look here if you're interested in customizing the testing procedure. HERE BE SOURCE FILTERS
The special syntax used to specify generator bindings relies upon a source filter (see Filter::Util::Call). If you don't want to use the syntax, you can disable the filter like so: use Test::LectroTest::Property qw( NO_FILTER ); LECTROTEST HOME
The LectroTest home is http://community.moertel.com/LectroTest. There you will find more documentation, presentations, mailing-list archives, a wiki, and other helpful LectroTest-related resources. It's also the best place to ask questions. AUTHOR
Tom Moertel (tom@moertel.com) INSPIRATION
The LectroTest project was inspired by Haskell's QuickCheck module by Koen Claessen and John Hughes: http://www.cs.chalmers.se/~rjmh/QuickCheck/. COPYRIGHT and LICENSE Copyright (c) 2004-05 by Thomas G Moertel. All rights reserved. This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself. perl v5.12.3 2007-08-30 Test::LectroTest::Property(3pm)
All times are GMT -4. The time now is 08:32 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy