Sponsored Content
Top Forums Shell Programming and Scripting List unique values and count instances in .csv file Post 302609697 by Skrynesaver on Tuesday 20th of March 2012 10:00:14 AM
Old 03-20-2012
I'd be tempted to use a Perl hash keyed on the values and sorted by value. eg.
Code:
perl -e 'while(<>){@record=split/,/,$_;$count{$record[1]}++;}for $key (reverse sort {$count{$a}<=>$count{$b}} keys %count){print "$key => $count{$key}\n"}'    tmp.dat

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

return a list of unique values of a column from csv format file

Hi all, I have a huge csv file with the following format of data, Num SNPs, 549997 Total SNPs,555352 Num Samples, 157 SNP, SampleID, Allele1, Allele2 A001,AB1,A,A A002,AB1,A,A A003,AB1,A,A ... ... ... I would like to write out a list of unique SNP (column 1). Could you... (3 Replies)
Discussion started by: phoeberunner
3 Replies

2. Shell Programming and Scripting

How to count Unique Values from a file.

Hi I have the following info in a file - <Cell id="25D"/> <Cell id="26A"/> <Cell id="26B"/> <Cell id="26C"/> <Cell id="27A"/> <Cell id="27B"/> <Cell id="27C"/> <Cell id="28A"/> I would like to know how would you go about counting all... (4 Replies)
Discussion started by: Prega
4 Replies

3. Shell Programming and Scripting

Shell script to count unique rows in a CSV

HI All, I have a CSV file of 30 columns separated by ,. I want to get a count of all unique rows written to a flat file. The CSV file is around 5000 rows The first column is a time stamp and I need to exclude while counting unique Thanks, Ravi (4 Replies)
Discussion started by: Nani369
4 Replies

4. Shell Programming and Scripting

Find and count unique date values in a file based on position

Hello, I need some sort of way to extract every date contained in a file, and count how many of those dates there are. Here are the specifics: The date format I'm looking for is mm/dd/yyyy I only need to look after line 45 in the file (that's where the data begins) The columns of... (2 Replies)
Discussion started by: ronan1219
2 Replies

5. Shell Programming and Scripting

Looping through entire directory and count unique values

Hello, I`m a complete newbie to coding, please help with this problem. I have multiple files in a directory, I have to loop through the contents of each file and extract number of unique isoforms in that file. Each file is tab delimited and only the line with the first parent (column 3)... (1 Reply)
Discussion started by: ritakadm
1 Replies

6. Shell Programming and Scripting

Count frequency of unique values in specific column

Hi, I have tab-deliminated data similar to the following: dot is-big 2 dot is-round 3 dot is-gray 4 cat is-big 3 hot in-summer 5 I want to count the frequency of each individual "unique" value in the 1st column. Thus, the desired output would be as follows: dot 3 cat 1 hot 1 is... (5 Replies)
Discussion started by: owwow14
5 Replies

7. Linux

To get all the columns in a CSV file based on unique values of particular column

cat sample.csv ID,Name,no 1,AAA,1 2,BBB,1 3,AAA,1 4,BBB,1 cut -d',' -f2 sample.csv | sort | uniq this gives only the 2nd column values Name AAA BBB How to I get all the columns of CSV along with this? (1 Reply)
Discussion started by: sanvel
1 Replies

8. Shell Programming and Scripting

Count Unique values from multiple lists of files

Looking for a little help here. I have 1000's of text files within a multiple folders. YYYY/ /MM /1000's Files Eg. 2014/01/1000 files 2014/02/1237 files 2014/03/1400 files There are folders for each year and each month, and within each monthly folder there are... (4 Replies)
Discussion started by: whegra
4 Replies

9. Shell Programming and Scripting

Print count of unique values

Hello experts, I am converting a number into its binary output as : read n echo "obase=2;$n" | bc I wish to count the maximum continuous occurrences of the digit 1. Example : 1. The binary equivalent of 5 = 101. Hence the output must be 1. 2. The binary... (3 Replies)
Discussion started by: H squared
3 Replies

10. Shell Programming and Scripting

Count number of unique values in each column of array

What is an efficient way of counting the number of unique values in a 400 column by 1000 row array and outputting the counts per column, assuming the unique values in the array are: A, B, C, D In other words the output should look like: Value COL1 COL2 COL3 A 50 51 52... (16 Replies)
Discussion started by: Geneanalyst
16 Replies
Moose::Meta::Attribute::Native::Trait::Hash(3)		User Contributed Perl Documentation	    Moose::Meta::Attribute::Native::Trait::Hash(3)

NAME
Moose::Meta::Attribute::Native::Trait::Hash - Helper trait for HashRef attributes VERSION
version 2.0604 SYNOPSIS
package Stuff; use Moose; has 'options' => ( traits => ['Hash'], is => 'ro', isa => 'HashRef[Str]', default => sub { {} }, handles => { set_option => 'set', get_option => 'get', has_no_options => 'is_empty', num_options => 'count', delete_option => 'delete', option_pairs => 'kv', }, ); DESCRIPTION
This trait provides native delegation methods for hash references. PROVIDED METHODS
get($key, $key2, $key3...) Returns values from the hash. In list context it returns a list of values in the hash for the given keys. In scalar context it returns the value for the last key specified. This method requires at least one argument. set($key => $value, $key2 => $value2...) Sets the elements in the hash to the given values. It returns the new values set for each key, in the same order as the keys passed to the method. This method requires at least two arguments, and expects an even number of arguments. delete($key, $key2, $key3...) Removes the elements with the given keys. In list context it returns a list of values in the hash for the deleted keys. In scalar context it returns the value for the last key specified. keys Returns the list of keys in the hash. This method does not accept any arguments. exists($key) Returns true if the given key is present in the hash. This method requires a single argument. defined($key) Returns true if the value of a given key is defined. This method requires a single argument. values Returns the list of values in the hash. This method does not accept any arguments. kv Returns the key/value pairs in the hash as an array of array references. for my $pair ( $object->option_pairs ) { print "$pair->[0] = $pair->[1] "; } This method does not accept any arguments. elements Returns the key/value pairs in the hash as a flattened list.. This method does not accept any arguments. clear Resets the hash to an empty value, like "%hash = ()". This method does not accept any arguments. count Returns the number of elements in the hash. Also useful for not empty: "has_options => 'count'". This method does not accept any arguments. is_empty If the hash is populated, returns false. Otherwise, returns true. This method does not accept any arguments. accessor($key) accessor($key, $value) If passed one argument, returns the value of the specified key. If passed two arguments, sets the value of the specified key. When called as a setter, this method returns the value that was set. shallow_clone This method returns a shallow clone of the hash reference. The return value is a reference to a new hash with the same keys and values. It is shallow because any values that were references in the original will be the same references in the clone. Note that "each" is deliberately omitted, due to its stateful interaction with the hash iterator. "keys" or "kv" are much safer. METHODS
meta BUGS
See "BUGS" in Moose for details on reporting bugs. AUTHOR
Moose is maintained by the Moose Cabal, along with the help of many contributors. See "CABAL" in Moose and "CONTRIBUTORS" in Moose for details. COPYRIGHT AND LICENSE
This software is copyright (c) 2012 by Infinity Interactive, Inc.. This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself. perl v5.16.2 2012-09-19 Moose::Meta::Attribute::Native::Trait::Hash(3)
All times are GMT -4. The time now is 10:23 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy