Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Finding the number of unique words in a file
Top Forums Shell Programming and Scripting Finding the number of unique words in a file Post 302449994 by zaxxon on Wednesday 1st of September 2010 06:35:29 AM
Old 09-01-2010
Quote:
Code:
sort -u your_file | wc -l

this command gives all word's in the file.but not unique word
The switch -u does not necessarily have the same meaning with all versions of sort on different OSes. GNU sort -u is filtering uniques, yes.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

how to find capital letter names in a file without finding words at start of sentence

Hi, I want to be able to list all the names in a file which begin with a capital letter, but I don't want it to list words that begin a new sentence. Is there any way round this? Thanks for your help. (1 Reply)
Discussion started by: kev269
1 Replies

2. Shell Programming and Scripting

how to read all the unique words in a text file

How can i read all the unique words in a file, i used - cat comment_file.txt | /usr/xpg6/bin/tr -sc 'A-Za-z' '/012' and cat comment_file.txt | /usr/xpg6/bin/tr -sdc 'A-Za-z' '/012' but they didnt worked..... (5 Replies)
Discussion started by: aditya.ece1985
5 Replies

3. Shell Programming and Scripting

Need help with finding unique string in log file

Shell script help Here is 3 sample lines from a log file <date> INFO <java.com.blah> abcd:ID= user login <date> DEBUG <java.com.blah> <nlah bla> abcd:ID=123 user login <date> INFO <java.com.blah> abcd:ID=3243 user login I want to find unique "ID" from this log... (3 Replies)
Discussion started by: gubbu
3 Replies

4. Shell Programming and Scripting

Split file by number of words

Dear all I am trying to divide a file using the number of words as a condition. Alternatively, I would at least like to be able to retrieve the first x words of a given file. Any tips? Thanks in advance. (7 Replies)
Discussion started by: aavv
7 Replies

5. UNIX for Advanced & Expert Users

Count number of unique patterns from a log file

Hello Everyone I need your help in fixing this issue., I have a log file which has data of users logging in to an application. I want to search for a particular pattern in the log ISSessionValidated=N If this key word is found , the above 8 lines will contain the name of the user who's... (12 Replies)
Discussion started by: xtechkid
12 Replies

6. Shell Programming and Scripting

Finding consecutive same words in a file

Hi All, I tried this but I am having trouble formulating this: I have a file that looks like this (this is a sample file words can be different): network router frame network router computer card host computer card One can see that in this file "network" and "router" occur... (3 Replies)
Discussion started by: shoaibjameel123
3 Replies

7. Shell Programming and Scripting

Finding my lost file by searching for words in it

Got a question for you guys...I am searching through a public directory (that has tons of files) trying to find a file that I was working on a longggggg time ago. I can't remember what it is called, but I do remember the content. It should contains words like this: Joe Pulvo botnet zeus... (5 Replies)
Discussion started by: statichazard
5 Replies

8. Shell Programming and Scripting

problem to count number of words from file

hi every one i have written this simple shell for counting number of word that user need to find from file but i have get several error when run it. can someone tell me the problem ? echo "Enter the file name" read file echo "enter word" read word for i in \`cat $file` do if then... (1 Reply)
Discussion started by: nimafire
1 Replies

9. Shell Programming and Scripting

How count the number of two words associated with the two words occurring in the file?

Hi , I need to count the number of errors associated with the two words occurring in the file. It's about counting the occurrences of the word "error" for where is the word "index.js". As such the command should look like. Please kindly help. I was trying: grep "error" log.txt | wc -l (1 Reply)
Discussion started by: jmarx
1 Replies

10. Shell Programming and Scripting

Replace all string matches in file with unique random number

Hello Take this file... Test01 Ref test Version 01 Test02 Ref test Version 02 Test66 Ref test Version 66 Test99 Ref test Version 99 I want to substitute every occurrence of Test{2} with a unique random number, so for example, if I was using sed, substitution would be something... (1 Reply)
Discussion started by: funkman
1 Replies

LEARN ABOUT DEBIAN

gaelic

GAELIC(5)						     Linux Programmers Manual							 GAELIC(5)

NAME

       gaelic - a list of Scots Gaelic words

DESCRIPTION

       /usr/share/dict/gaelic is an ASCII file which contains an alphabetic list of words, one per line.

FILES

       /etc/dictionaries-common/words  is  a  symbolic	link  to  a  /usr/share/dict/<language> file.  /usr/share/dict/words is a symbolic link to
       /etc/dictionaries-common/words, and is the name by which other software	should	refer  to  the	system	word  list.   See  select-default-
       wordlist(8) for more information.

       The directory /usr/share/dict can contain word lists for many languages, with name of the language in English, e.g., /usr/share/dict/french
       and /usr/share/dict/danish contain respectively lists of French and Danish words if they exist.	Such lists should be coded using  the  ISO
       8859-1 character set encoding.

SEE ALSO

       ispell(1), select-default-wordlist(8), and the Filesystem Hierarchy Standard.

HISTORY

       The words lists are not specific, and may be generated from any number of sources.

       The  system word list used to be /usr/dict/words.  For compatibility, software should check that location if /usr/share/dict/words does not
       exist.

AUTHOR

       Alastair McKinstry <mckinstry@computer.org>

Linux								   20 July 2002 							 GAELIC(5)
All times are GMT -4. The time now is 06:33 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy