Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Counting occurrences of all words in multiple files
Top Forums Shell Programming and Scripting Counting occurrences of all words in multiple files Post 302584460 by methyl on Friday 23rd of December 2011 09:50:24 AM
Old 12-23-2011
Similar idea:
Convert the file contents to lower case. Change any space or tab to a newline. Remove any blank lines. Sort each word to alphabetic order. Count unique occurances. Sort by descending order of count.

Code:
cat *.txt|tr '[A-Z]' '[a-z]' | tr ' \t' '\n\n'|sed -e "/^$/d"| \
          sort|uniq -c|sort -nr

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

pattern search for multiple log files and counting

I have 10 appservers and each appserver has 4 jvms . Each of these logs is archived and stored on a nfs directory . For example the files are /logs/200907/ap1-jvm1.server.log.20090715.gz /logs/200907/ap2-jvm2.server.log.20090714.gz /logs/200908/ap1-jvm1.server.log.20090812.gz I want to... (3 Replies)
Discussion started by: gubbu
3 Replies

2. Shell Programming and Scripting

Counting words

Hi Is there a way to count the no. of words in all files in directory. All are text files.I use wc -w but somehow i am not getting the rite answer. Is there an alternative. Thanks in advance (9 Replies)
Discussion started by: kinny
9 Replies

3. Shell Programming and Scripting

Counting lines in multiple files

Hi, I have couple of .txt files (say 50 files) in a folder. For each file: I need to get the number of lines in each file and then that count -1 (I wanted to exclude the header. Then sum the counts of all files and output the total sum. Is there an efficient way to do this using shell... (7 Replies)
Discussion started by: Lucky Ali
7 Replies

4. Shell Programming and Scripting

multiple files: counting

In a directory, I have 5000 multiple files that contains around 4000 rows with 10 columns in each file containing a unique string 'AT' located at 4th column. OM 3328 O BT 268 5.800 7.500 4.700 0.000 1.400 OM 3329 O BT 723 8.500 8.900... (7 Replies)
Discussion started by: asanjuan
7 Replies

5. Shell Programming and Scripting

counting number of pattern occurrences

Hi All, Is it possible to count number of occurrences of a pattern in a single record using awk?? for example: a line like this: abrsjdfhafa I want to count the number of a character occurrences. but still use the default RS, I don't want to set RS to single character. (1 Reply)
Discussion started by: ghoda2_10
1 Replies

6. Shell Programming and Scripting

Counting number of files that contain words stored in another file

Hi All, I have written a script on this but it does not do the requisite job. My requirement is this: 1. I have two kinds of files each with different extensions. One set of files are *.dat (6000 unique DAT files all in one directory) and another set *.dic files (6000 unique DIC files in... (1 Reply)
Discussion started by: shoaibjameel123
1 Replies

7. Shell Programming and Scripting

Counting non-specific occurrences within a file.

I'm pretty new to scripting and didn't see an example of this issue yet. I am trying to count and print the total number of times each value is found within a file. Here is a short example of my starting file. value 3 value 3 value 3 value 3 value 4 value 6 value 6 value 6 value 6... (3 Replies)
Discussion started by: funkynmr
3 Replies

8. UNIX for Dummies Questions & Answers

BASH - Counting word occurrences in a Web Page

Hi all, I have to do a script bash (for university) that counts all word occurrences in a specific web page. anyone can help me?. Thanks :) (1 Reply)
Discussion started by: piacentero
1 Replies

9. UNIX for Dummies Questions & Answers

Awk: Counting occurrences between two files

Hi, I have two text files (1.txt and 2.txt). 2.txt contains two columns which are extracted from 1.txt using a simple if(condition) print. I want to: - count how many times the values contained in 2.txt appear in 1.txt -if they appear just one time, I have to delete the entire row in... (5 Replies)
Discussion started by: Pintug
5 Replies

10. Shell Programming and Scripting

sed parser behaving strange on replacing multiple words in multiple files

I have 4000 files like $cat clus_grp_seq10_g.phy 18 1002 anig_OJJ65951_1 ATGGTTTCGCAGCGTGATAGAGAATTGTTTAGGGATGATATTCGCTCGCGAGGAACGAAGCTCAATGCTGCCGAGCGCGAGAGTCTGCTAAGGCCATATCTGCCAGATCCGTCTGACCTTCCACGCAGGCCACTTCAGCGGCGCAAGAAGGTTCCTCG aver_OOF92921_1 ... (1 Reply)
Discussion started by: sammy777888
1 Replies

LEARN ABOUT DEBIAN

apertium-multiple-translations

apertium-multiple-translations(1)										 apertium-multiple-translations(1)

NAME

       apertium-multiple-translations - This application is part of ( apertium )

       This tool is part of the apertium open-source machine translation toolbox: http://www.apertium.org.

SYNOPSIS

       apertium-multiple-translations preproc biltrans [input [output]]

DESCRIPTION

       apertium-multiple-translations is the program that outputs multiple translations of certain words in a text according to the different pos-
       sible translations of the words in the bilingual dictionary (in a dictionary that supports it).	The place  to  put  this  program  in  the
       modes.xml file is just after apertium-pretransfer.

FILES

       These are the four files that can be used with this command: preproc Result of preprocess trules file

       biltrans Bilingual letter transducer file

       infile Input file (stdin by default).

       outfile Output file (stdout by default).

SEE ALSO

       apertium-transfer(1), apertium-translator(1), apertium (1).

BUGS

       Lots of...lurking in the dark and waiting for you!

AUTHOR

       Copyright  (c) 2005--2008 Universitat d'Alacant / Universidad de Alicante.  This is free software.  You may redistribute copies of it under
       the terms of the GNU General Public License <http://www.gnu.org/licenses/gpl.html>.

								    2006-03-08					 apertium-multiple-translations(1)
All times are GMT -4. The time now is 02:07 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy