07-30-2009
How to count unique strings
How do I count the total number of unique strings from a file using Perl? Any help is appreciated..
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I need to grep for a pattern in a file. Files are huge and have several repeated occurances of the strings which match pattern. I just need the strings which contain the pattern in the output.
For eg.
The contents of my file are as follows. The pattern I want to match by is ABCD
... (5 Replies)
Discussion started by: tektips
5 Replies
2. Shell Programming and Scripting
I have a sorted file like:
Apple 3
Apple 5
Apple 8
Banana 2
Banana 3
Grape 31
Orange 7
Orange 13
I'd like to search $1 and if $1 is not the same as $1 in the previous row print that row and print the number of times $1 was found.
so the output would look like:
Apple 8 3
Banana... (2 Replies)
Discussion started by: dcfargo
2 Replies
3. Shell Programming and Scripting
Hello Guys
I have a flat file with '|~|' delimited
When I use to record count using below command
awk -FS"+" ' {print $colno}' filename | wc -l
the count is fine
But when I am trying to find the unique number of record the o/p is always 1
awk -FS"+" ' {print $colno}'... (11 Replies)
Discussion started by: Pratik4891
11 Replies
4. Shell Programming and Scripting
Hi,
Im looking for a script which will calculate the unique strings column 2 & 3 values in a log as mentioned in example
eg:-
bag 12 12
bag 18 15
bags 15 13
bags 15 14
blazer 24 24
blazer 33 32
boots 19 15
Result should be:-
bag 30 27
bags 30 27... (9 Replies)
Discussion started by: Paulwintech
9 Replies
5. Shell Programming and Scripting
how to display the unique strings in two files using shell script or commands.
I tried diff and cmp but it shows the entire line, i need only the mismatched strings.
File1:
sat,sun,mon,tue
rose,lilly,lotus
white,red,blue,green,pink
File2:
sat,sun,mon,tue
rose,sunflower,lotus... (4 Replies)
Discussion started by: Arun_Linux
4 Replies
6. Shell Programming and Scripting
Im looking for an awk script that will take the unique values in column 5, then print and count the unique values in column 6.
CA001011500 11111 11111 -9999 201301 AAA
CA001012040 11111 11111 -9999 201301 AAA
CA001012573 11111 11111 -9999 201301 BBB
CA001012710 11111 11111 -9999 201301... (4 Replies)
Discussion started by: ncwxpanther
4 Replies
7. Shell Programming and Scripting
When I use the below awk to count the unique lines in $4 for the input it seems to work. The answer is 3 because $4 is only unique 3 times in all the entries. However, when I use the same on actual data I get 56,536 and I know the answer should be 56,548. My question is there a better way to... (8 Replies)
Discussion started by: cmccabe
8 Replies
8. Shell Programming and Scripting
Hello Team,
I need your help on the following:
My input file a.txt is as below:
3330690|373846|108471
3330690|373846|108471
0640829|459725|100001
0640829|459725|100001
3330690|373847|108471
Here row 1 and row 2 of column 1 are identical but corresponding column 2 value are... (4 Replies)
Discussion started by: angshuman
4 Replies
9. UNIX for Beginners Questions & Answers
Dear all,
I would like to know how to list and count unique words in thousands number of text files.
Please help me out
thanks in advance (9 Replies)
Discussion started by: imranrasheedamu
9 Replies
10. UNIX for Beginners Questions & Answers
Hello,
I am trying to count unique rows in my file based on 4 columns (2-5) and to output its frequency in a sixth column. My file is tab delimited
My input file looks like this:
Colum1 Colum2 Colum3 Colum4 Coulmn5
1.1 100 100 a b
1.1 100 100 a c
1.2 200 205 a d
1.3 300 301 a y
1.3 300... (6 Replies)
Discussion started by: nans
6 Replies
LEARN ABOUT DEBIAN
perl::critic::statistics
Perl::Critic::Statistics(3pm) User Contributed Perl Documentation Perl::Critic::Statistics(3pm)
NAME
Perl::Critic::Statistics - Compile stats on Perl::Critic violations.
DESCRIPTION
This class accumulates statistics on Perl::Critic violations across one or more files. NOTE: This class is experimental and subject to
change.
INTERFACE SUPPORT
This is considered to be a non-public class. Its interface is subject to change without notice.
METHODS
"new()"
Create a new instance of Perl::Critic::Statistics. No arguments are supported at this time.
" accumulate( $doc, @violations ) "
Accumulates statistics about the $doc and the @violations that were found.
"modules()"
The number of chunks of code (usually files) that have been analyzed.
"subs()"
The total number of subroutines analyzed by this Critic.
"statements()"
The total number of statements analyzed by this Critic.
"lines()"
The total number of lines of code analyzed by this Critic.
"lines_of_blank()"
The total number of blank lines analyzed by this Critic. This includes only blank lines in code, not POD or data.
"lines_of_comment()"
The total number of comment lines analyzed by this Critic. This includes only lines whose first non-whitespace character is "#".
"lines_of_data()"
The total number of lines of data section analyzed by this Critic, not counting the "__END__" or "__DATA__" line. POD in a data section
is counted as POD, not data.
"lines_of_perl()"
The total number of lines of Perl code analyzed by this Critic. Perl appearing in the data section is not counted.
"lines_of_pod()"
The total number of lines of POD analyzed by this Critic. Pod occurring in a data section is counted as POD, not as data.
"violations_by_severity()"
The number of violations of each severity found by this Critic as a reference to a hash keyed by severity.
"violations_by_policy()"
The number of violations of each policy found by this Critic as a reference to a hash keyed by full policy name.
"total_violations()"
The the total number of violations found by this Critic.
"statements_other_than_subs()"
The total number of statements minus the number of subroutines. Useful because a subroutine is considered a statement by PPI.
"average_sub_mccabe()"
The average McCabe score of all scanned subroutines.
"violations_per_file()"
The total violations divided by the number of modules.
"violations_per_statement()"
The total violations divided by the number statements minus subroutines.
"violations_per_line_of_code()"
The total violations divided by the lines of code.
AUTHOR
Elliot Shank "<perl@galumph.com>"
COPYRIGHT
Copyright (c) 2007-2011 Elliot Shank.
This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself. The full text of this license
can be found in the LICENSE file included with this module.
perl v5.14.2 2012-06-07 Perl::Critic::Statistics(3pm)