how to read all the unique words in a text file

aditya.ece1985 · #1 (**permalink**) 11-30-2007

How can i read all the unique words in a file, i used -

cat comment_file.txt | /usr/xpg6/bin/tr -sc 'A-Za-z' '/012'
and
cat comment_file.txt | /usr/xpg6/bin/tr -sdc 'A-Za-z' '/012'
but they didnt worked.....

encrypted · #2 (**permalink**) 11-30-2007

Does uniq somefile help?

aditya.ece1985 · #3 (**permalink**) 11-30-2007

yes u will be using uniq only but the first part is not working i used -
cat comment_file.txt | /usr/xpg6/bin/tr -sdc 'A-Za-z' '/012' | sort | uniq -c

encrypted · #4 (**permalink**) 11-30-2007

This one from the archives may help. Although it shows non-unique non-unique words you would need to tweak it.

aditya.ece1985 · #5 (**permalink**) 11-30-2007

thankx anyways

aditya.ece1985 · #6 (**permalink**) 11-30-2007

this is the solution ---

cat comment_file.txt | tr " " "\n" | sort | uniq -c | wc -l

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
Copying Text between two unique text patterns	spindoctor	UNIX for Dummies Questions & Answers	3	01-16-2009 03:42 AM
How can i read a non text file in unix - ELF-64 executable object file - IA64	alexcol	UNIX for Advanced & Expert Users	8	11-07-2008 08:56 AM
script to Read Error,jbase,voilation,segmentation words from a file	Mujtaba khan	Shell Programming and Scripting	3	03-30-2008 01:19 PM
Read words from file and create new file using K-shell.	bsrajirs	Shell Programming and Scripting	4	06-01-2007 12:15 PM
read specific text from a log file	ragha81	Shell Programming and Scripting	4	10-17-2006 01:17 PM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread:


	Powered by