Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Text analysis
Top Forums UNIX for Dummies Questions & Answers Text analysis Post 302511142 by ctsgnb on Wednesday 6th of April 2011 05:23:57 AM
Old 04-06-2011
Code:
strings walle.txt | head -5521 | tail +91 | sed "s/[][^\"'(\`),=\.;?!:#%+-]/ /g;s/  */ /g" | tr ' [:upper:]' '\n[:lower:]' | grep -v '^[0-9]*$' | sort | uniq -c >wordcount.txt

---------- Post updated at 11:23 AM ---------- Previous update was at 09:23 AM ----------

Check the file at the different step and see if it can fit your needs

Code:
strings walle.txt | head -5521 | tail +91 >f1
sed "s/[][^\"'(\`),=\.;?!:#%+-]/ /g;s/  */ /g" f1 >f2
tr ' [:upper:]' '\n[:lower:]' <f2 >f3
grep -v '^[0-9]' f3 | sort >f4
uniq -c f4 >f5
sort -k 1n f5 >f6

Code:
strings walle.txt | head -5521 | tail +91 >f1
sed "s/[][^\"'(\`),=\.;?!:#%+-]/ /g;s/  */ /g" f1 >f2
tr ' [:upper:]' '\n[:lower:]' <f2 >f1
grep -v '^[0-9]' f1 | sort >f2
uniq -c f2 >f1
sort -k 1n f1 >f2

Last edited by ctsgnb; 04-06-2011 at 06:31 AM..
 

8 More Discussions You Might Find Interesting

1. Solaris

Catalina Analysis

How can I make analysis for catalina.out (2 Replies)
Discussion started by: Burhan
2 Replies

2. Shell Programming and Scripting

AWK script: decrypt text uses frequency analysis

Ez all! I have a question how to decrypt text uses letter frequency analysis. I have code which count the letters, but what i need to do after that. Can anybody help me to write a code. VERY NEEDED! My code now: #!/usr/bin/awk -f BEGIN { FS="" } { for (i=1; i <= NF; i++) { if ($i... (4 Replies)
Discussion started by: SerJel
4 Replies

3. Programming

Regarding stack analysis

I would like to know how I could do the following : void func(){ int a = 100; b=0; int c = a/b; } void sig_handler (int sig,siginfo_t *info,void *context){ //signal handling function //here I want to access the variables of func() } int main(){ struct sigaction *act =... (7 Replies)
Discussion started by: vpraveen84
7 Replies

4. Shell Programming and Scripting

text file analysis

Hello, I have a text file containin 4 lines which are repeated along the file, ie the file looks like this: 16:20:12.060769 blablabla 40 16:20:12.093199 blablabla 640 16:20:12.209003 blablabla 640 16:20:12.273179 blablabla 216 16:20:27.217444 blablabla 40 16:20:27.235410 blablabla 640... (2 Replies)
Discussion started by: Celine19
2 Replies

5. Shell Programming and Scripting

Metacharacters analysis

:confused:Hi , Can someone please advise what is the meaning of metacharacters in below code? a_PROCESS=${0##*/} a_DPFX=${a_PROCESS%.*} a_LPFX="a_DPFX : $$ : " a_UPFX="Usage: $a_PROCESS" Regards, gehlnar (3 Replies)
Discussion started by: gehlnar
3 Replies

6. Shell Programming and Scripting

Analysis of a script

what does this line in a script mean?? I have tried to give it at the command prompt and here is what it returns ksh: /db2home/db2dap1/sqllib/db2profile: not found. . /db2home/db2dap1/sqllib/db2profile i have tried the same thing for my home directory too and the result is the same .... (5 Replies)
Discussion started by: ramky79
5 Replies

7. UNIX for Dummies Questions & Answers

Help with text analysis - UNIX

Hey Guys I recently posted yesterday about trying to count the amount of separate words that exists in a text file e.g. walle.txt. i want the output to give to give me a list of words with a number next indicating how many times its came up in the file e.g: cat 20 the 11 if 40 I'm... (0 Replies)
Discussion started by: John0101
0 Replies

8. Infrastructure Monitoring

Nmon Analysis

Dear All, I am an performance tester. Now i am working in project where we are using linux 2.6.32. Now I got an oppurtunity to learn the monitoring the server. As part of this task i need to do analysis of the Nmon report. I was completely blank in this. So please suggest me how to start... (0 Replies)
Discussion started by: iamsengu
0 Replies

LEARN ABOUT DEBIAN

text::lorem

Text::Lorem(3pm)					User Contributed Perl Documentation					  Text::Lorem(3pm)

NAME

       Text::Lorem - Generate random Latin looking text

SYNOPSIS

	   use Text::Lorem;

	   my $text = Text::Lorem->new();

	   # Generate a string of text with 5 words
	   $words = $text->words(5);

	   # Generate a string of text with 2 sentences
	   $sentences = $text->sentences(2);

	   # Generate 3 paragraphs
	   $paragraphs = $text->paragraphs(3);

DESCRIPTION

       Often when developing a website or other application it's important to have placeholders for content.  This module generates prescribed
       amounts of fake Latin text.

CONSTRUCTOR

       "new()"
	   The default constructor, "new()" takes no arguments and returns a Text::Lorem object.

METHODS

       "words( INTEGER )"
	   Returns INTEGER fake Latin words.

       "sentences( INTEGER )"
	   Returns INTEGER sentences in fake Latin.

       "paragraphs( INTEGER )"
	   Returns INTEGER paragraphs of fake Latin text.

THANKS

       Thanks to the guys who pushed me off the cliff called comfort and into the scary world of Perl: James Duncan, Leon Brocard.

AUTHOR

       Adeola Awoyemi (adeola@fotango.com)

SEE ALSO

	 L<WWW::Lipsum> and L<http://lipsum.com/>

COPYRIGHT

       Copyright 2003 Fotango Ltd. All rights reserved. <http://opensource.fotango.com/> This software is released under the same license as Perl
       itself.

perl v5.10.1							    2011-01-05							  Text::Lorem(3pm)
All times are GMT -4. The time now is 04:42 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy