Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Shell scripting: frequency of specific word in a string and statistics
Top Forums Shell Programming and Scripting Shell scripting: frequency of specific word in a string and statistics Post 302805931 by kraterions on Saturday 11th of May 2013 05:57:52 PM
Old 05-11-2013
Hi Skrynesaver,

many many thanks for your BIG HELP.

Impressive job, really!

I launched your script and here his output:

Code:
WORD,TOTFrequency,(1)Frequency,(0)Frequency,(-1)Frequency,1%Frequency,0%Frequency,-1%Frequency
that,20,11,1,80.43%,0.02%,0.17%
great,1,1,0,00.02%,0.00%,0.00%
really,9,5,2,20.19%,0.04%,0.04%
day,1,1,0,00.02%,0.00%,0.00%

So, I'd like to ask you about 4 points:

1) As you can see the FIELD "(-1)Frequency" is not present
2) Words column is not sort in decreasing order
3) Is possible to set an option to search words "like grep -i" case insensitive in order to match as follows:

Code:
my @wanted=qw(day) result= today days monday etc.......

4) Is possible to search "like grep -i" case insensitive and list in decreasing order the 50 most frequent words, where words >=3 characters?


Again, many many thanks for your attention and for your BIG HELP.

Hope to hear from you soon!!!!

Have a good time.
Last edited by kraterions; 05-12-2013 at 02:55 AM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Determining Word Frequency of Specific Terms

Hello, I require a perl script that will read a .txt file that contains words like 224.199.207.IN-ADDR.ARPA. IN NS NS1.internet.com. 4.200.162.207.in-addr.arpa. IN PTR beeriftw.internet.com. arroyoeinternet.com. IN A 200.199.227.49 I want to focus on words: IN... (23 Replies)
Discussion started by: richsark
23 Replies

2. Shell Programming and Scripting

Finding a word at specific location in a string

Hi All , I have different strings (SQL queries infact) of different lengths such as: 1. "SELECT XYZ FROM ABC WHERE ABC.DEF='123' " 2. "DELETE FROM ABC WHERE ABC.DEF='567'" 3. "SELECT * FROM ABC" I need to find out the word coming after the... (1 Reply)
Discussion started by: swapnil.nawale
1 Replies

3. Shell Programming and Scripting

search a word and print specific string using awk

Hi, I have list of directory paths in a variable and i want to delete those dirs and if dir does not exist then search that string and get the correct path from xml file after that delete the correct directory. i tried to use grep and it prints the entire line from the search.once i get the entire... (7 Replies)
Discussion started by: dragon.1431
7 Replies

4. Shell Programming and Scripting

awk or sed command to print specific string between word and blank space

My source is on each line 98.194.245.255 - - "GET /disp0201.php?poc=4060&roc=1&ps=R&ooc=13&mjv=6&mov=5&rel=5&bod=155&oxi=2&omj=5&ozn=1&dav=20&cd=&daz=&drc=&mo=&sid=&lang=EN&loc=JPN HTTP/1.1" 302 - "-" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.0.3705; .NET CLR... (5 Replies)
Discussion started by: elamurugu
5 Replies

5. Shell Programming and Scripting

search-word-print-specific-string

Hi, Our input xml looks like: <doc> <str name="account_id">1111</str> <str name="prd_id">DHEP155EK</str> </doc> - <doc> <str name="account_id">6666</str> <str name="prd_id">394531662</str> </doc> - <doc> <str name="account_id">6666</str> <str... (1 Reply)
Discussion started by: Jassz
1 Replies

6. Shell Programming and Scripting

Parse a String for a Specific Word

Hello, I'm almost there with scripting, and I've looked at a few examples that could help me out here. But I'm still at a lost where to start. I'm looking to parse each line in the log file below and save the output like below. Log File AABBCGCAT022|242|3 AABBCGCAT023|243|4... (6 Replies)
Discussion started by: ravzter
6 Replies

7. Shell Programming and Scripting

break the string and print it in a new line after a specific word

Hi Gurus I am new to this forum.. I am using HP Unix OS. I have one single string in input file as shown below Abc123 | cde | fgh | ghik| lmno | Abc456 |one |two |three | four | Abc789 | five | Six | seven | eight | Abc098 | ........ I want to achive the result in a output file as shown... (3 Replies)
Discussion started by: kannansr621
3 Replies

8. UNIX for Dummies Questions & Answers

How to print line starts with specific word and contains specific word using sed?

Hi, I have gone through may posts and dint find exact solution for my requirement. I have file which consists below data and same file have lot of other data. <MAPPING DESCRIPTION ='' ISVALID ='YES' NAME='m_TASK_UPDATE' OBJECTVERSION ='1'> <MAPPING DESCRIPTION ='' ISVALID ='NO'... (11 Replies)
Discussion started by: tmalik79
11 Replies

9. Shell Programming and Scripting

Help with calculating frequency of specific word in a string

Input file: #read_1 AWEAWQQRZZZQWQQWZ #read_2 ZZAQWRQTWQQQWADSADZZZ #read_3 POGZZZZZZADWRR . . Desired output file: #read_1 3 #read_1 1 #read_2 2 #read_2 3 #read_3 6 . . (3 Replies)
Discussion started by: perl_beginner
3 Replies

10. UNIX for Beginners Questions & Answers

Get string before specific word in UNIX

Hi All, I'm writing unix shell script and I have these files. I need to get name before _DETL.tmp. ABC_AAA_DETL.tmp ABC_BBB_DETL.tmp ABC_CCC_DETL.tmp PQR_DETL.tmp DEF_DETL.tmp JKL_DETL.tmp YUI_DETL.tmp TG_NM_DDD_DETL.tmp TG_NM_EEE_DETL.tmp GHJ_DETL.tmp RTY_DETL.tmp output will... (3 Replies)
Discussion started by: ace_friends22
3 Replies

LEARN ABOUT FREEBSD

est

EST(4)							   BSD Kernel Interfaces Manual 						    EST(4)

NAME

     est -- Enhanced Speedstep Technology

SYNOPSIS

     To compile this capability into your kernel place the following line in your kernel configuration file:

	   device cpufreq

DESCRIPTION

     The est interface provides support for the Intel Enhanced Speedstep Technology.

     Note that est capabilities are automatically loaded by the cpufreq(4) driver.

LOADER TUNABLES

     The est interface is intended to allow cpufreq(4) to access and implement Intel Enhanced SpeedStep Technology via acpi(4) and the acpi_perf
     interface accessors.  If the default settings are not optimal, the following sysctls can be used to modify or monitor est behavior.

     hw.est.msr_info
	     Attempt to infer information from direct probing of the msr.  Should only be used in diagnostic cases.  (default 0)

     hw.est.strict
	     Validate frequency requested is accepted by the cpu when set.  It appears that this will only work on single core cpus.  (default 0)

SYSCTL VARIABLES

     The following sysctl(8) values are available

     dev.est.%d.desc
	     Description of support, almost always Enhanced SpeedStep Frequency Control.

     dev.est.0.%desc: Enhanced SpeedStep Frequency Control

     dev.est.%d.driver
	     Driver in use, always est.

     dev.est.0.%driver: est

     dev.est.%d.parent

     dev.est.0.%parent: cpu0
	     The cpu that is exposing these frequencies.  For example cpu0.

     dev.est.%d.freq_settings.
	     The valid frequencies that are allowed by this CPU and their step values.

     dev.est.0.freq_settings: 2201/45000 2200/45000 2000/39581 1900/37387
	     1800/34806 1700/32703 1600/30227 1500/28212 1400/25828 1300/23900 1200/21613 1100/19775 1000/17582 900/15437 800/13723

DIAGNOSTICS

     est%d: <Enhanced SpeedStep Frequency Control> on cpu%d

     Indicates normal startup of this interface.

     est: CPU supports Enhanced Speedstep, but is not recognized.
     est: cpu_vendor GenuineIntel, msr 471c471c0600471c
     device_attach: est%d attach returned 6

     Indicates all attempts to attach to this interface have failed.  This usually indicates an improper BIOS setting restricting O/S control of
     the CPU speeds.  Consult your BIOS documentation for more details.

COMPATIBILITY

     est is only found on supported Intel CPUs.

SEE ALSO

     cpufreq(4)

     Intel 64 and IA-32 Architectures Software Developer Manuals, http://www.intel.com/content/www/us/en/processors/architectures-software-
     developer-manuals.html.

AUTHORS

     This manual page was written by Sean Bruno <sbruno@FreeBSD.org>.

BSD
								 October 18, 2012							       BSD
All times are GMT -4. The time now is 09:24 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy