Sponsored Content
Top Forums Shell Programming and Scripting awk to count using each unique value Post 302900365 by ncwxpanther on Tuesday 6th of May 2014 10:36:25 AM
Old 05-06-2014
awk to count using each unique value

Im looking for an awk script that will take the unique values in column 5, then print and count the unique values in column 6.

Code:
CA001011500  11111 11111 -9999 201301 AAA
CA001012040  11111 11111 -9999 201301 AAA
CA001012573  11111 11111 -9999 201301 BBB
CA001012710  11111 11111 -9999 201301 BBB
CA001015105  11111 11111 -9999 201301 BBB
CA001015638  11111 11111 -9999 201301 CCC
CA001011500  11111 11111  -9999 201302 AAA
CA001012040  11111 11111  -9999 201302 BBB
CA001012573  11111 11111 -9999 201302 BBB
CA001012710  11111  11111 -9999 201302 CCC
CA001015105  11111 11111  -9999 201302 CCC
CA001015638  11111 11111  -9999 201302 CCC

Output will need to be:

Code:
201301 AAA 2
201301 BBB 3
201301 CCC 1
201302 AAA 1
201302 BBB 2
201302 CCC 3

I know this will print the unique values of column 5, but how do i tie in the count of unique values in column 6?
Code:
 awk '{ a[$5]++ } END { for (b in a) { print b } }'

Thanks in advance!
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to count unique strings

How do I count the total number of unique strings from a file using Perl? Any help is appreciated.. (6 Replies)
Discussion started by: my_Perl
6 Replies

2. Shell Programming and Scripting

awk count how many unique IPs have received that error

Hi all, I want to write a awk script that counts unique IPs that have received one special error. For example 25-04-2012;192.168.70.31;1254545454545417;500.0;SUCCESS 25-04-2012;192.168.70.32;355666650914;315126423993;;General_ERROR_23 30-04-2012;192.168.70.33;e;null;null;Failure... (2 Replies)
Discussion started by: arrals_vl
2 Replies

3. Shell Programming and Scripting

awk pattern match and count unique in column

Hi all I have a need of searching some pattern in file by month and then count unique records D11 G11 R11 -------> Pattern available in file S11 Jan$1 to $5 column contains some records in which I want to find unique for this purpose I have written script like below awk '/Jan/ ||... (4 Replies)
Discussion started by: nex_asp
4 Replies

4. UNIX for Dummies Questions & Answers

Search and count a unique string

Hi Guys, I have a file as follows. Here is my story: For each field, the string in the 5th column needs to be searched in other fields of the same column and counted if the 1st column of the field is different from that of the primary field. BTW, the unique strings of 1st column need to be... (6 Replies)
Discussion started by: a_bahreini
6 Replies

5. Shell Programming and Scripting

awk unique count of partial match with semi-colon

Trying to get the unique count of the below input, but if the text in beginning of $5 is a partial match to another line in the file then it is not unique. awk awk '!seen++ {n++} END {print n}' input 7 input chr1 159174749 159174770 chr1:159174749-159174770 ACKR1 chr1 ... (2 Replies)
Discussion started by: cmccabe
2 Replies

6. Shell Programming and Scripting

Count occurrence of column one unique value having unique second column value

Hello Team, I need your help on the following: My input file a.txt is as below: 3330690|373846|108471 3330690|373846|108471 0640829|459725|100001 0640829|459725|100001 3330690|373847|108471 Here row 1 and row 2 of column 1 are identical but corresponding column 2 value are... (4 Replies)
Discussion started by: angshuman
4 Replies

7. UNIX for Beginners Questions & Answers

Awk: count unique element of array

Hi, tab-separated input: blabla_1 A,B,C,C blabla_2 A,E,G blabla_3 R,Q,A,B,C,R,Q output: blabla_1 3 blabla_2 3 blabla_3 5 After splitting $2 in an array, I am trying to store the number of unique elements in a variable, but have some difficulties resetting the variable to 0 before... (6 Replies)
Discussion started by: beca123456
6 Replies

8. UNIX for Beginners Questions & Answers

Count unique words

Dear all, I would like to know how to list and count unique words in thousands number of text files. Please help me out thanks in advance (9 Replies)
Discussion started by: imranrasheedamu
9 Replies

9. UNIX for Beginners Questions & Answers

Count unique column

Hello, I am trying to count unique rows in my file based on 4 columns (2-5) and to output its frequency in a sixth column. My file is tab delimited My input file looks like this: Colum1 Colum2 Colum3 Colum4 Coulmn5 1.1 100 100 a b 1.1 100 100 a c 1.2 200 205 a d 1.3 300 301 a y 1.3 300... (6 Replies)
Discussion started by: nans
6 Replies

10. UNIX for Beginners Questions & Answers

Awk: count unique elements in a field and sum their occurence across the entire file

Hi, Sure it's an easy one, but it drives me insane. input ("|" separated): 1|A,B,C,A 2|A,D,D 3|A,B,B I would like to count the occurence of each capital letters in $2 across the entire file, knowing that duplicates in each record count as 1. I am trying to get this output... (5 Replies)
Discussion started by: beca123456
5 Replies
LDAPSEARCHPREFS.CONF(5) 					File Formats Manual					   LDAPSEARCHPREFS.CONF(5)

NAME
ldapsearchprefs.conf - configuration file for LDAP search preference routines SYNOPSIS
/etc/openldap/ldapsearchprefs.conf DESCRIPTION
The file /etc/openldap/ldapsearchprefs.conf contains information used by the LDAP search preference routines (see ldap-searchpref(3)). Blank lines and lines that have a first character of `#' are treated as comments and ignored. Non-comment lines contain one or more tokens. Tokens are separated by white space, and double quotes `"' can be used to include white space inside a token. Search preferences are typically used by LDAP-based client programs to specify what a user may search for, which attributes are searched, and which options are available to the user. The first non-commment line specifies the version of the template information and must contain the token Version followed by an integer version number. E.g., Version 1 The current version is 1, so the above example is always the correct opening line. The remainder of the file consists of one or more search preference configurations. The first line of a search preference is a human-read- able name for the type of object being searched for, e.g. "People" or "Organizations". This name is stored in the so_objtypeprompt member of the ldap_searchobj structure. E.g., "People" specifies a label for a search preference designed to find X.500 entries for People. The next line specifies a list of options for this search object. The only option currently allowed is "internal" which means that this search object should not be presented directly to a user. Options are placed in the so_options member of the ldap_searchobj structure and can be tested using the LDAP_IS_SEARCHOBJ_OPTION_SET() macro. Use "" if no special options are desired. The next line specifes a label to use for "Fewer Choices" (for lack of a better term) searches. "Fewer Choices" searches are those where the user's input is fed to the ldap_filter routines to determine an appropriate filter to use. This contrasts with explicitly-constructed LDAP filters, or "More Choices" searches, where the user can explicitly construct an LDAP filter. The "Fewer" and "More Choices" terms derive from the maX.500, waX.500 and xax500 directory user agents, which offer two configurations of their "Find Entry" dialogs - one where the user types a search string, and the client code attempts to find reasonable filter(s) to use in searching ("Fewer Choices"), and one where the user can select from several pop-up menus which allow complete specification of the search to be performed ("More Choices"). For example: "Search For:" can be used by LDAP client programs to label the field into which the user can type a "Fewer Choices" search. This information is stored in the so_prompt member of the ldap_searchobj structure. The next line specifies an LDAP filter prefix to append to all "More Choices" searched. This is typically used to limit the types of entries returned to those containing a specific object class. For example: "(&(objectClass=person)" would cause only entries containing the object class "person" to be returned by a search. Note that parentheses may be unbalanced here, since this is a filter prefix, not an entire filter. This information is stored in the so_filterprefix member of the ldap_searchobj struc- ture. The next line is an LDAP filter tag (see ldap-filter(3)) which specifies the set of LDAP filters to be applied for "Fewer Choices" search- ing. The line "xax500-People" would tell the client program to use the set of LDAP filters from the ldap filter configuration file tagged "xax500-People". This informa- tion is stored in the so_filtertag member of the ldap_searchobj structure. The next line specifies an LDAP attribute to retrieve to help the user choose when several entries match the search terms specified. For example: "title" specifies that if more than one entry matches the search criteria, the client program should retrieve the "title" attribute that and present that to the user to allow them to select the appropriate entry. The next line specifies a label for the above attribute, e.g. "Title:" The above information is stored in the so_defaultselectattr and so_defaultselecttext members of the ldap_searchobj structure. Note that these are defaults, and are intended to be overridden by the sa_selectattr and sa_selecttext fields of the ldap_searchattr data structure (see below). The next line specifies the scope of the LDAP search to be performed. Acceptable values are subtree, onelevel, and base. See ldap(3) for more information. The next section is a list of "More Choices" search options, terminated by a line containing only the string "END". Example: "Common Name" cn 11111 "" "" "Surname" sn 11111 "" "" "Business Phone" "telephoneNumber" 11101 "" "" END Each line represents one method of searching. In this example, there are three ways of searching - by Common Name, by Surname, and by Business Phone number. The first field is the text which should be displayed to user. The second field is the attribute which will be searched. The third field is a bitmap which specifies which of the match types (discussed below) are permitted for this search type. A "1" value in a given bit position indicates that a particular match type is valid, and a "0" indicates that is it not valid. The fourth and fifth fields are, respectively, the select attribute name (corresponding to the sa_selectattr field of the ldap_searchattr data struc- ture) and on-screen name for the select attribute (corresponding to the sa_selecttext field). These values are intended to override the so_defaultselectattr and so_defaultselecttext values, described above. If blank, the client software should use the default values above. The next section is a list of search match options, terminated by a a line containing only the string "END". Example: "exactly matches" "(%a=%v))" "approximately matches" "(%a~=%v))" "starts with" "(%a=%v*))" "ends with" "(%a=*%v))" "contains" "(%a=*%v*))" END In this example, there are five ways of refining the search. For each method, there is an LDAP filter suffix which is appended to the ldap filter thus far constructed. The routine ldap_build_filter() may be used to construct the whole filter. It substitutes the appropriate attribute for "%a" in the filter, and a value (generally, something the user types) for "%v". EXAMPLE
The following example illustrates one possible configuration of search preferences for "people". # Version number Version 1 # Name for this search object People # Label to place before text box user types in "Search For:" # Filter prefix to append to all "More Choices" searches "(&(objectClass=person)" # Tag to use for "Fewer Choices" searches - from ldapfilter.conf file "xax500-People" # If a search results in > 1 match, retrieve this attribute to help # user disambiguate the entries... multilineDescription # ...and label it with this string: "Description" # Search scope to use when searching subtree # Follows a list of "More Choices" search options. Format is: # Label, attribute, select-bitmap, extra attr display name, extra attr ldap name # If last two are null, "Fewer Choices" name/attributes used "Common Name" cn 11111 "" "" "Surname" sn 11111 "" "" "Business Phone" "telephoneNumber" 11101 "" "" "E-Mail Address" "mail" 11111 "" "" "Uniqname" "uid" 11111 "" "" END # Match types "exactly matches" "(%a=%v))" "approximately matches" "(%a~=%v))" "starts with" "(%a=%v*))" "ends with" "(%a=*%v))" "contains" "(%a=*%v*))" END In this example, the user may search for People. For "fewer choices" searching, the tag for the ldap filter config file is "xax500-Peo- ple". FILES
/etc/openldap/ldapsearchprefs.conf SEE ALSO
ldap(3). ldap-searchprefs(3) ACKNOWLEDGEMENTS
OpenLDAP is developed and maintained by The OpenLDAP Project (http://www.openldap.org/). OpenLDAP is derived from University of Michigan LDAP 3.3 Release. OpenLDAP 2.0.27-Release 20 August 2000 LDAPSEARCHPREFS.CONF(5)
All times are GMT -4. The time now is 11:16 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy