Sponsored Content
Top Forums Shell Programming and Scripting List unique values and count instances in .csv file Post 302609697 by Skrynesaver on Tuesday 20th of March 2012 10:00:14 AM
Old 03-20-2012
I'd be tempted to use a Perl hash keyed on the values and sorted by value. eg.
Code:
perl -e 'while(<>){@record=split/,/,$_;$count{$record[1]}++;}for $key (reverse sort {$count{$a}<=>$count{$b}} keys %count){print "$key => $count{$key}\n"}'    tmp.dat

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

return a list of unique values of a column from csv format file

Hi all, I have a huge csv file with the following format of data, Num SNPs, 549997 Total SNPs,555352 Num Samples, 157 SNP, SampleID, Allele1, Allele2 A001,AB1,A,A A002,AB1,A,A A003,AB1,A,A ... ... ... I would like to write out a list of unique SNP (column 1). Could you... (3 Replies)
Discussion started by: phoeberunner
3 Replies

2. Shell Programming and Scripting

How to count Unique Values from a file.

Hi I have the following info in a file - <Cell id="25D"/> <Cell id="26A"/> <Cell id="26B"/> <Cell id="26C"/> <Cell id="27A"/> <Cell id="27B"/> <Cell id="27C"/> <Cell id="28A"/> I would like to know how would you go about counting all... (4 Replies)
Discussion started by: Prega
4 Replies

3. Shell Programming and Scripting

Shell script to count unique rows in a CSV

HI All, I have a CSV file of 30 columns separated by ,. I want to get a count of all unique rows written to a flat file. The CSV file is around 5000 rows The first column is a time stamp and I need to exclude while counting unique Thanks, Ravi (4 Replies)
Discussion started by: Nani369
4 Replies

4. Shell Programming and Scripting

Find and count unique date values in a file based on position

Hello, I need some sort of way to extract every date contained in a file, and count how many of those dates there are. Here are the specifics: The date format I'm looking for is mm/dd/yyyy I only need to look after line 45 in the file (that's where the data begins) The columns of... (2 Replies)
Discussion started by: ronan1219
2 Replies

5. Shell Programming and Scripting

Looping through entire directory and count unique values

Hello, I`m a complete newbie to coding, please help with this problem. I have multiple files in a directory, I have to loop through the contents of each file and extract number of unique isoforms in that file. Each file is tab delimited and only the line with the first parent (column 3)... (1 Reply)
Discussion started by: ritakadm
1 Replies

6. Shell Programming and Scripting

Count frequency of unique values in specific column

Hi, I have tab-deliminated data similar to the following: dot is-big 2 dot is-round 3 dot is-gray 4 cat is-big 3 hot in-summer 5 I want to count the frequency of each individual "unique" value in the 1st column. Thus, the desired output would be as follows: dot 3 cat 1 hot 1 is... (5 Replies)
Discussion started by: owwow14
5 Replies

7. Linux

To get all the columns in a CSV file based on unique values of particular column

cat sample.csv ID,Name,no 1,AAA,1 2,BBB,1 3,AAA,1 4,BBB,1 cut -d',' -f2 sample.csv | sort | uniq this gives only the 2nd column values Name AAA BBB How to I get all the columns of CSV along with this? (1 Reply)
Discussion started by: sanvel
1 Replies

8. Shell Programming and Scripting

Count Unique values from multiple lists of files

Looking for a little help here. I have 1000's of text files within a multiple folders. YYYY/ /MM /1000's Files Eg. 2014/01/1000 files 2014/02/1237 files 2014/03/1400 files There are folders for each year and each month, and within each monthly folder there are... (4 Replies)
Discussion started by: whegra
4 Replies

9. Shell Programming and Scripting

Print count of unique values

Hello experts, I am converting a number into its binary output as : read n echo "obase=2;$n" | bc I wish to count the maximum continuous occurrences of the digit 1. Example : 1. The binary equivalent of 5 = 101. Hence the output must be 1. 2. The binary... (3 Replies)
Discussion started by: H squared
3 Replies

10. Shell Programming and Scripting

Count number of unique values in each column of array

What is an efficient way of counting the number of unique values in a 400 column by 1000 row array and outputting the counts per column, assuming the unique values in the array are: A, B, C, D In other words the output should look like: Value COL1 COL2 COL3 A 50 51 52... (16 Replies)
Discussion started by: Geneanalyst
16 Replies
Chart::Clicker::Data::Series(3pm)			User Contributed Perl Documentation			 Chart::Clicker::Data::Series(3pm)

NAME
Chart::Clicker::Data::Series - A series of key, value pairs representing chart data VERSION
version 2.83 SYNOPSIS
use Chart::Clicker::Data::Series; my @keys = (1, 2, 3, 4, 5, 6, 7, 8, 9, 10); my @values = (42, 25, 86, 23, 2, 19, 103, 12, 54, 9); my $series = Chart::Clicker::Data::Series->new({ keys => @keys, value => @values }); # Alternately, if you prefer my $series2 = Chart::Clicker::Data::Series->new({ 1 => 42, 2 => 25, 3 => 85, 4 => 23, 5 => 2, 6 => 19, 7 => 102, 8 => 12, 9 => 54, 10 => 9 }); DESCRIPTION
Chart::Clicker::Data::Series represents a series of values to be charted. Despite the name (keys and values) it is expected that all keys and values will be numeric. Values is pretty obvious, but it is important that keys also be numeric, as otherwise we'd have no idea how to order the data. If you want to use text labels for your domain's see Chart::Clicker::Axis's tick_labels method. ATTRIBUTES
keys Set/Get the keys for this series. add_to_keys Adds a key to this series. name Set/Get the name for this Series range Returns the range for this series. values Set/Get the values for this series. METHODS
key_count Get the count of keys in this series. add_to_values Add a value to this series. value_count Get the count of values in this series. add_pair ($key, $value) Convenience method to add a single key and a single value to the series. get_value_for_key ($key) Returns the value associated with the specified key. This is necessary because not all series will have values for every key. AUTHOR
Cory G Watson <gphat@cpan.org> COPYRIGHT AND LICENSE
This software is copyright (c) 2012 by Cold Hard Code, LLC. This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself. perl v5.14.2 2012-06-22 Chart::Clicker::Data::Series(3pm)
All times are GMT -4. The time now is 12:02 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy