Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Awk: count unique element of array
Top Forums UNIX for Beginners Questions & Answers Awk: count unique element of array Post 302989962 by RudiC on Friday 20th of January 2017 05:29:15 AM
Old 01-20-2017
@Scrutinizer: VEEERY interesting approach! Brilliant! At least the first one. The second will count wrongly if more than duplicates occur - C[F[i]] will deduct 1 for the first duplicate, 2 for the third occurrence, etc. Might not be what was required?
This User Gave Thanks to RudiC For This Post:
Scrutinizer
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

acessing awk array element while getline < "file"

I am attempting to write a awk script that reads in a file after awk array elements are assigned and using those elements while reading in the new file. Does this make sense? /pattern/ {tst=$3} (( getline < "file" ) > 0 ) { x=x " "tst } When I print tst in the END statement it... (9 Replies)
Discussion started by: timj123
9 Replies

2. Shell Programming and Scripting

awk count how many unique IPs have received that error

Hi all, I want to write a awk script that counts unique IPs that have received one special error. For example 25-04-2012;192.168.70.31;1254545454545417;500.0;SUCCESS 25-04-2012;192.168.70.32;355666650914;315126423993;;General_ERROR_23 30-04-2012;192.168.70.33;e;null;null;Failure... (2 Replies)
Discussion started by: arrals_vl
2 Replies

3. Shell Programming and Scripting

awk pattern match and count unique in column

Hi all I have a need of searching some pattern in file by month and then count unique records D11 G11 R11 -------> Pattern available in file S11 Jan$1 to $5 column contains some records in which I want to find unique for this purpose I have written script like below awk '/Jan/ ||... (4 Replies)
Discussion started by: nex_asp
4 Replies

4. Shell Programming and Scripting

awk Search Array Element Return Index

Can you search AWK array elements and return each index value for that element. For example an array named car would have index make and element engine. I want to return all makes with engine size 1.6. Array woulld look like this: BMW 1.6 BMW 2.0 BMW 2.5 AUDI 1.8 AUDI 1.6 ... (11 Replies)
Discussion started by: u20sr
11 Replies

5. Shell Programming and Scripting

awk to count using each unique value

Im looking for an awk script that will take the unique values in column 5, then print and count the unique values in column 6. CA001011500 11111 11111 -9999 201301 AAA CA001012040 11111 11111 -9999 201301 AAA CA001012573 11111 11111 -9999 201301 BBB CA001012710 11111 11111 -9999 201301... (4 Replies)
Discussion started by: ncwxpanther
4 Replies

6. UNIX for Advanced & Expert Users

Array Element

This question is for someone that's more familiar with Array Element. I need to know if the maximum array element that can be assigned is 1024 and if its so, Is there a workaround solution when the counter exceeded 1024? param_array="$param_nam" counter=$counter+1 #to avoid space... (3 Replies)
Discussion started by: cumeh1624
3 Replies

7. Shell Programming and Scripting

awk unique count of partial match with semi-colon

Trying to get the unique count of the below input, but if the text in beginning of $5 is a partial match to another line in the file then it is not unique. awk awk '!seen++ {n++} END {print n}' input 7 input chr1 159174749 159174770 chr1:159174749-159174770 ACKR1 chr1 ... (2 Replies)
Discussion started by: cmccabe
2 Replies

8. Shell Programming and Scripting

Awk: check element in array and it's value

Hello, I want to see if element exists in array, if so then, check it's corresponding value. Column 4 is position and column 1 is the chromosome for it. There are duplicates for one position on one chromosome. I want to check if same position exists on different chromosome: Data... (8 Replies)
Discussion started by: genome
8 Replies

9. Shell Programming and Scripting

Count number of unique values in each column of array

What is an efficient way of counting the number of unique values in a 400 column by 1000 row array and outputting the counts per column, assuming the unique values in the array are: A, B, C, D In other words the output should look like: Value COL1 COL2 COL3 A 50 51 52... (16 Replies)
Discussion started by: Geneanalyst
16 Replies

10. UNIX for Beginners Questions & Answers

Awk: count unique elements in a field and sum their occurence across the entire file

Hi, Sure it's an easy one, but it drives me insane. input ("|" separated): 1|A,B,C,A 2|A,D,D 3|A,B,B I would like to count the occurence of each capital letters in $2 across the entire file, knowing that duplicates in each record count as 1. I am trying to get this output... (5 Replies)
Discussion started by: beca123456
5 Replies

LEARN ABOUT CENTOS

hardlink

hardlink(1)						      General Commands Manual						       hardlink(1)

NAME

       hardlink - Consolidate duplicate files via hardlinks

SYNOPSIS

       hardlink [-c] [-n] [-v] [-vv] [-h] directory1 [ directory2 ... ]

DESCRIPTION

       This manual page documents hardlink, a program which consolidates duplicate files in one or more directories using hardlinks.

       hardlink  traverses  one or more directories searching for duplicate files.  When it finds duplicate files, it uses one of them as the mas-
       ter.  It then removes all other duplicates and places a hardlink for each one pointing to the master file.  This allows for conservation of
       disk space where multiple directories on a single filesystem contain many duplicate files.

       Since hard links can only span a single filesystem, hardlink is only useful when all directories specified are on the same filesystem.

OPTIONS

       -c	 Compare  only	the  contents of the files being considered for consolidation.	Disregards permission, ownership and other differ-
		 ences.

       -f	 Force hardlinking across file systems.

       -n	 Do not perform the consolidation; only print what would be changed.

       -v	 Print summary after hardlinking.

       -vv	 Print every hardlinked file and bytes saved. Also print summary after hardlinking.

       -h	 Show help.

AUTHOR

       hardlink was written by Jakub Jelinek <jakub@redhat.com>.

       Man page written by Brian Long.

       Man page updated by Jindrich Novy <jnovy@redhat.com>

BUGS

       hardlink assumes that its target directory trees do not change from under it.  If a directory tree does change, this may result in hardlink
       accessing  files  and/or directories outside of the intended directory tree.  Thus, you must avoid running hardlink on potentially changing
       directory trees, and especially on directory trees under control of another user.

																       hardlink(1)
All times are GMT -4. The time now is 10:39 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy