Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Determining Word Frequency of Specific Terms
Top Forums Shell Programming and Scripting Determining Word Frequency of Specific Terms Post 302295041 by radoulov on Friday 6th of March 2009 11:25:32 AM
Old 03-06-2009
Let me clarify,
the last version of the code implements the following logic:

1. For every input file:

1.1. If the third field matches the following regular expression:

Code:
^(PTR|MX|NS|CNAME|A)$

Which means that the third field exactly matches one of the following strings:

Code:
PTR or MX or NS or CNAME or A

1.2. AND we've not yet reached the SPECIALS section:

Code:
!s

1.3. We count each occurrence of the value of the third field (building the associative array z).

Code:
{ z[$3]++ }

2. When we reach the SPECIALS section (s) AND the second field matches exactly the string IN we count every record:

Code:
s && $2 == "IN" { sc++ }

2.1. The following code marks the beginning of the SPECIALS section, it gets reset at the beginning of every file:

Code:
/SPECIALS/ { s = 1 }

Is the above logic clear and correct?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Word frequency with additional information

Hello everyone, I am using a chunk of code to display the frequency of a file name in a list of directories. The code looks like this: find . -name "*.log" | cut -d/ -f4 | cut -d. -f1 | awk '{print $1}' | sort | uniq -c | sort -nr The file paths would look something like this:... (1 Reply)
Discussion started by: ToeLint
1 Replies

2. Shell Programming and Scripting

word frequency counter - awk solution?

Dear all, i need your help on this. There is a text file, i need to count word frequency for each word with frequency >40 in each line of file and output it into another file with columns like this: word1,word2,word3, ...wordn 0,0,1 1,2,0 3,2,0 etc -- each raw represents... (13 Replies)
Discussion started by: irrevocabile
13 Replies

3. Shell Programming and Scripting

Word Frequency Sort

hello, Here is a program for creating a word-frequency # wf.gk --- program to generate word frequencies from a file { # remove punctuation: This will remove all punctuations from the file gsub(/_]/, "", $0) #Start frequency analysis for (i = 1; i <= NF; i++) freq++ } END #Print output... (11 Replies)
Discussion started by: gimley
11 Replies

4. UNIX for Dummies Questions & Answers

How to print line starts with specific word and contains specific word using sed?

Hi, I have gone through may posts and dint find exact solution for my requirement. I have file which consists below data and same file have lot of other data. <MAPPING DESCRIPTION ='' ISVALID ='YES' NAME='m_TASK_UPDATE' OBJECTVERSION ='1'> <MAPPING DESCRIPTION ='' ISVALID ='NO'... (11 Replies)
Discussion started by: tmalik79
11 Replies

5. Shell Programming and Scripting

Help with calculating frequency of specific word in a string

Input file: #read_1 AWEAWQQRZZZQWQQWZ #read_2 ZZAQWRQTWQQQWADSADZZZ #read_3 POGZZZZZZADWRR . . Desired output file: #read_1 3 #read_1 1 #read_2 2 #read_2 3 #read_3 6 . . (3 Replies)
Discussion started by: perl_beginner
3 Replies

6. Shell Programming and Scripting

Fetch entries in front of specific word till next word

Hi all I have following file which I have to edit for research purpose file:///tmp/moz-screenshot.png body, div, table, thead, tbody, tfoot, tr, th, td, p { font-family: &quot;Liberation Sans&quot;; font-size: x-small; } Drug: KRP-104 QD Drug: Placebo Drug: Metformin|Drug:... (15 Replies)
Discussion started by: Priyanka Chopra
15 Replies

7. Shell Programming and Scripting

Convert a list of word/terms into their Regexp representation

Ok this might sound pretty weird but here is the request. Running on a linux system in bash or Perl (i really don't know perl but the end user has a few pearl script already) Start File looks something like this (4000 entries) TEST PLAN T//TF T-TF TEST (T) Hacker ... I am thinking about... (3 Replies)
Discussion started by: oly_r
3 Replies

8. Shell Programming and Scripting

Shell scripting: frequency of specific word in a string and statistics

Hello friends, I need a BIG help from UNIX collective intelligence: I have a CSV file like this: VALUE,TIMESTAMP,TEXT 1,Sun May 05 16:13:05 +0000 2013,"RT @gracecheree: Praying God sends me a really great man one day. Gotta trust in his timing. 0,Sun May 05 16:13:05 +0000 2013,@sendi__... (19 Replies)
Discussion started by: kraterions
19 Replies

9. Shell Programming and Scripting

Count frequency of unique values in specific column

Hi, I have tab-deliminated data similar to the following: dot is-big 2 dot is-round 3 dot is-gray 4 cat is-big 3 hot in-summer 5 I want to count the frequency of each individual "unique" value in the 1st column. Thus, the desired output would be as follows: dot 3 cat 1 hot 1 is... (5 Replies)
Discussion started by: owwow14
5 Replies

10. Shell Programming and Scripting

Search for a specific word and print only the word from the input file

Hi, I have a sample file as shown below, I am looking for sed or any command which prints the complete word only from the input file. Ex: $ cat "sample.log" I am searching for a word which is present in this file We can do a pattern search using grep but I need to cut only the word which... (1 Reply)
Discussion started by: mohan_kumarcs
1 Replies

LEARN ABOUT OSX

trace

TRACE(1)						    BSD General Commands Manual 						  TRACE(1)

NAME

     trace -- configure and record kernel trace events

SYNOPSIS

     trace -h

     trace -i [-b numbufs]

     trace -g

     trace -d [-a pid | -x pid]

     trace -r

     trace -n

     trace -e [-c class [-p class] [-s subclass]] [-a pid | -x pid] [-k code | -k code | -k code | -k code]

     trace -E [-c class [-p class] [-s subclass]] [-a pid | -x pid] [-k code | -k code | -k code | -k code] executable_path
	   [optional args to executable]

     trace -t [-R rawfile] [-o OutputFilename] [-N] [ExtraCodeFilename1 ExtraCodeFilename2 ...]

DESCRIPTION

     The trace command allows developers to initialize and configure the kernel trace subsystem. Trace events can be recorded to an in-memory buf-
     fer, or logged directly to a file. Raw data files can later be decoded to a plaintext format.

SEE ALSO

     fs_usage(1), sc_usage(1), latency(1), top(1)

Mac OS X							 October 28, 2010							  Mac OS X
All times are GMT -4. The time now is 06:57 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy