07-30-2009
yes, I got an error message "Useless use of hash element in void context ....filename...
Thanx.
---------- Post updated at 02:40 PM ---------- Previous update was at 02:20 PM ----------
I've made changes to the code to handle utf8 as :--
use encoding 'utf8';
my %unique;
# my $unique;
my $line;
open my $FH, "<:encoding(utf8)", "$ARGV[0]" or die "Can't open file $ARGV[0]: $!";
while(<$FH>) {
chomp;
$unique{$_}++;
}
close $FH;
foreach my $line (keys %unique) {
print "$line = $unique{$line}\n";
}
However, I am getting the message....
2 files to edit.
I don't know this.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I need to grep for a pattern in a file. Files are huge and have several repeated occurances of the strings which match pattern. I just need the strings which contain the pattern in the output.
For eg.
The contents of my file are as follows. The pattern I want to match by is ABCD
... (5 Replies)
Discussion started by: tektips
5 Replies
2. Shell Programming and Scripting
I have a sorted file like:
Apple 3
Apple 5
Apple 8
Banana 2
Banana 3
Grape 31
Orange 7
Orange 13
I'd like to search $1 and if $1 is not the same as $1 in the previous row print that row and print the number of times $1 was found.
so the output would look like:
Apple 8 3
Banana... (2 Replies)
Discussion started by: dcfargo
2 Replies
3. Shell Programming and Scripting
Hello Guys
I have a flat file with '|~|' delimited
When I use to record count using below command
awk -FS"+" ' {print $colno}' filename | wc -l
the count is fine
But when I am trying to find the unique number of record the o/p is always 1
awk -FS"+" ' {print $colno}'... (11 Replies)
Discussion started by: Pratik4891
11 Replies
4. Shell Programming and Scripting
Hi,
Im looking for a script which will calculate the unique strings column 2 & 3 values in a log as mentioned in example
eg:-
bag 12 12
bag 18 15
bags 15 13
bags 15 14
blazer 24 24
blazer 33 32
boots 19 15
Result should be:-
bag 30 27
bags 30 27... (9 Replies)
Discussion started by: Paulwintech
9 Replies
5. Shell Programming and Scripting
how to display the unique strings in two files using shell script or commands.
I tried diff and cmp but it shows the entire line, i need only the mismatched strings.
File1:
sat,sun,mon,tue
rose,lilly,lotus
white,red,blue,green,pink
File2:
sat,sun,mon,tue
rose,sunflower,lotus... (4 Replies)
Discussion started by: Arun_Linux
4 Replies
6. Shell Programming and Scripting
Im looking for an awk script that will take the unique values in column 5, then print and count the unique values in column 6.
CA001011500 11111 11111 -9999 201301 AAA
CA001012040 11111 11111 -9999 201301 AAA
CA001012573 11111 11111 -9999 201301 BBB
CA001012710 11111 11111 -9999 201301... (4 Replies)
Discussion started by: ncwxpanther
4 Replies
7. Shell Programming and Scripting
When I use the below awk to count the unique lines in $4 for the input it seems to work. The answer is 3 because $4 is only unique 3 times in all the entries. However, when I use the same on actual data I get 56,536 and I know the answer should be 56,548. My question is there a better way to... (8 Replies)
Discussion started by: cmccabe
8 Replies
8. Shell Programming and Scripting
Hello Team,
I need your help on the following:
My input file a.txt is as below:
3330690|373846|108471
3330690|373846|108471
0640829|459725|100001
0640829|459725|100001
3330690|373847|108471
Here row 1 and row 2 of column 1 are identical but corresponding column 2 value are... (4 Replies)
Discussion started by: angshuman
4 Replies
9. UNIX for Beginners Questions & Answers
Dear all,
I would like to know how to list and count unique words in thousands number of text files.
Please help me out
thanks in advance (9 Replies)
Discussion started by: imranrasheedamu
9 Replies
10. UNIX for Beginners Questions & Answers
Hello,
I am trying to count unique rows in my file based on 4 columns (2-5) and to output its frequency in a sixth column. My file is tab delimited
My input file looks like this:
Colum1 Colum2 Colum3 Colum4 Coulmn5
1.1 100 100 a b
1.1 100 100 a c
1.2 200 205 a d
1.3 300 301 a y
1.3 300... (6 Replies)
Discussion started by: nans
6 Replies
LEARN ABOUT DEBIAN
file::slurp::unicode
File::Slurp::Unicode(3pm) User Contributed Perl Documentation File::Slurp::Unicode(3pm)
NAME
File::Slurp::Unicode - Reading/Writing of Complete Files with Character Encoding Support
SYNOPSIS
use File::Slurp::Unicode;
my $text = read_file('filename', encoding => 'utf8');
my @lines = read_file('filename'); # utf8 is assumed if no encoding.
write_file('filename', { encoding => 'utf16' }, @lines);
# same as File::Slurp::write_file (ie. no encoding):
write_file('filename', { encoding => 'binary' }, @lines);
use File::Slurp::Unicode qw(slurp);
my $text = slurp('filename', encoding => 'latin1');
DESCRIPTION
This module wraps File::Slurp and adds character encoding support through the "encoding" parameter. It exports the same functions which
take all the same parameters as File::Slurp. Please see the File::Slurp documentation for basic usage; only the differences are described
from here on out.
read_file
Pass in an argument called "encoding" to change the file encoding. If no argument is passed in, UTF-8 encoding is assumed.
The special encoding 'binary' is interpreted to mean that there should be no decoding done to the data after reading it. This is pretty
much the same as calling "File::Slurp::read_file()" directly. This option is here only to make code which needs to read both binary and
text files look uniform.
write_file
Pass in an argument called "encoding" to change the file encoding. If no argument is passed in and no wide characters are present in the
output data, then no conversion will be done. If there are wide characters in the output data then UTF-8 encoding is assumed.
The special encoding 'binary' is interpreted to mean that there should be no encoding done to the data before writing. If you pass a wide
string (a string with Perl's internal 'utf8 bit' set) to "write_file" and set the encoding to 'binary' it will die with an appropriate
message. This is pretty much the same as calling "File::Slurp::write_file()" directly. This option is here only to make code which needs
write both binary and text files look uniform.
SEE ALSO
File::Slurp
BUGS
None known. Contact author or file a bug report on CPAN if you find any.
COPYRIGHT
This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
Copyright (C) 2010 David Caldwell
AUTHOR
David Caldwell <david@porkrind.org>
<http://porkrind.org/>
PROJECT HOME
<http://github.com/caldwell/File-Slurp-Unicode>
perl v5.10.1 2010-10-28 File::Slurp::Unicode(3pm)