Sponsored Content
Full Discussion: Unique count from flat file
Top Forums Shell Programming and Scripting Unique count from flat file Post 302586075 by Klashxx on Friday 30th of December 2011 05:15:10 AM
Old 12-30-2011
a pure awk:
Code:
awk -F"[|~|]+" 'a[$4]==""{a[$4]=1;b++}END{print b}' test.dat

Or:
Code:
awk -F\~ '!a[$4]{a[$4]=1;b++}END{print b}'  test.dat

This User Gave Thanks to Klashxx For This Post:
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help with pipe count in a flat file!!!

Hi Friends, I have a flat file and it has 43 columns which means 42 pipes but some records have less number of pipes.Can anyone tell me a command to count the number of pipes in a record and redirect the count to some new file because the flat file has not less than 40,000 records. Thanks... (14 Replies)
Discussion started by: kumarsaravana_s
14 Replies

2. Shell Programming and Scripting

count alphabets in a flat file and print

I have a text file with a huge dataset, and each row in that dataset has some data(65479 rows). In that file I need to find the number of times a-z & A-Z Appears. How Can I Initialise Array into an Array to parse the count also I need to parse a,A into a single array preferably. example of... (3 Replies)
Discussion started by: vmsenthil
3 Replies

3. Shell Programming and Scripting

How to count Unique Values from a file.

Hi I have the following info in a file - <Cell id="25D"/> <Cell id="26A"/> <Cell id="26B"/> <Cell id="26C"/> <Cell id="27A"/> <Cell id="27B"/> <Cell id="27C"/> <Cell id="28A"/> I would like to know how would you go about counting all... (4 Replies)
Discussion started by: Prega
4 Replies

4. UNIX for Advanced & Expert Users

Count number of unique patterns from a log file

Hello Everyone I need your help in fixing this issue., I have a log file which has data of users logging in to an application. I want to search for a particular pattern in the log ISSessionValidated=N If this key word is found , the above 8 lines will contain the name of the user who's... (12 Replies)
Discussion started by: xtechkid
12 Replies

5. Shell Programming and Scripting

List unique values and count instances in .csv file

I need to take the second column of a .csv file and count the number of instances of each unique value in that same second column. I'd like the output to be value,count sorted by most instances. Thanks for any guidance! Data example: 317476,317756,0 816063,318861,0 313123,319091,0... (4 Replies)
Discussion started by: batcho
4 Replies

6. Shell Programming and Scripting

Find and count unique date values in a file based on position

Hello, I need some sort of way to extract every date contained in a file, and count how many of those dates there are. Here are the specifics: The date format I'm looking for is mm/dd/yyyy I only need to look after line 45 in the file (that's where the data begins) The columns of... (2 Replies)
Discussion started by: ronan1219
2 Replies

7. Shell Programming and Scripting

Count occurrence of column one unique value having unique second column value

Hello Team, I need your help on the following: My input file a.txt is as below: 3330690|373846|108471 3330690|373846|108471 0640829|459725|100001 0640829|459725|100001 3330690|373847|108471 Here row 1 and row 2 of column 1 are identical but corresponding column 2 value are... (4 Replies)
Discussion started by: angshuman
4 Replies

8. UNIX for Beginners Questions & Answers

Count unique words

Dear all, I would like to know how to list and count unique words in thousands number of text files. Please help me out thanks in advance (9 Replies)
Discussion started by: imranrasheedamu
9 Replies

9. UNIX for Beginners Questions & Answers

Count unique column

Hello, I am trying to count unique rows in my file based on 4 columns (2-5) and to output its frequency in a sixth column. My file is tab delimited My input file looks like this: Colum1 Colum2 Colum3 Colum4 Coulmn5 1.1 100 100 a b 1.1 100 100 a c 1.2 200 205 a d 1.3 300 301 a y 1.3 300... (6 Replies)
Discussion started by: nans
6 Replies

10. UNIX for Beginners Questions & Answers

Awk: count unique elements in a field and sum their occurence across the entire file

Hi, Sure it's an easy one, but it drives me insane. input ("|" separated): 1|A,B,C,A 2|A,D,D 3|A,B,B I would like to count the occurence of each capital letters in $2 across the entire file, knowing that duplicates in each record count as 1. I am trying to get this output... (5 Replies)
Discussion started by: beca123456
5 Replies
XML2(1) 						      General Commands Manual							   XML2(1)

NAME
xml2 - convert xml documents in a flat format 2xml - convert flat format into xml html2 - convert html documents in a flat format 2html - convert flat format into html csv2 - convert csv files in a flat format 2csv - convert flat format into csv SYNOPSIS
<xml2|2xml|html2|2html|csv2|2csv> > outfile < infile DESCRIPTION
There are six tools. Except csv2 and and 2csv they don't take any command-line arguments. They are all simple filters which can be used to read files from standard input in one format and output it to standard output in another format. The flat format used by the tools is specific to these tools. It is a syntax for representing structured markup in a way that makes it easy to process with line-oriented tools. The same format is used for HTML and XML; in fact, you can think of html2 as converting HTML to XHTML and running xml2 on the result; likewise 2html and 2xml. (Of course, this isn't how the implementation works.) SEE ALSO
This program does normally not include any documentation in form of manpages. However it has a real excellent documentation online with a lot of example. In fact this manpage was based on this documentation. Please find it on: http://dan.egnor.name/xml2/ref Examples can be found here: http://dan.egnor.name/xml2/examples AUTHOR
xml2 was written by Dan Egnor. This manpage was written by Patrick Schoenfeld <schoenfeld@in-medias-res.com> for the Debian project, but may be used by others under the same terms as xml2 is distributed. BUGS
Bugs can be reported through the Debian Bug tracking system. 7h february 2008 XML2(1)
All times are GMT -4. The time now is 10:29 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy