Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: AWK script to detect webpages from file
Top Forums Shell Programming and Scripting AWK script to detect webpages from file Post 302406260 by ROFL on Monday 22nd of March 2010 12:12:12 PM
Old 03-22-2010
AWK script to detect webpages from file
Hi guys I'm very new to unix and I have to create an awk script that detects webpage addresses from a file/webpage and outputs how many times each webpage was detected.e.g. if my file was:

(Note: The symbol " was added to stop them being created into links)

"www.google.com"
"www.facebook.com"
"www.google.com"

the output should be:

"www.google.com" x2
"www.facebook.com" x1

However I cannot get this to work at the moment, can somebody please tell me what is wrong with my code:

Code:
BEGIN {print "Running script on the file",ARGV[1]} 

/www*/{for(i=1;i<=NF;i++)
    {if($i ~ /^www/)
        link[NR] = $i
        occurs[NR] = 1
    }

}
{for(i = 1; i < NR; i++) 
    {if(link[NR] == link[i])
        occurs[i]++
        link[NR] = "repeat"    
    }
}
{print link[NR],"occurs",occurs[NR],"times"}
END {print "Ending"}

Thank you!
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Unix script to detect new file entry in directory

Hi All, I want to detect each new file coming / getting created in unix directory. When every new file came to directory, i have to get its details like its size , date and time stamp and store it into another file. Could any one please tell me , how i can achieve that? Thanks. (13 Replies)
Discussion started by: james_1984
13 Replies

2. UNIX for Dummies Questions & Answers

how to detect my script is already running

I have a script which must not be run more than once at any given time. THis script will be scheduled to run every 20 mins as a cron job. In my script can i have logic to say if this script is already running from the previous cron, then exit. How do i go about doing that. If you describe the... (11 Replies)
Discussion started by: rmulchandani
11 Replies

3. Shell Programming and Scripting

AWK script to detect webpages from file

Hi guys I'm very new to unix and I have to create an awk script that detects webpage addresses from a file/webpage and outputs how many times each webpage was detected.e.g. if my file was: www.google.com www.facebook.com www.google.com the output should be: www.google.com x2... (2 Replies)
Discussion started by: ROFL
2 Replies

4. Shell Programming and Scripting

script to detect a file from inserted usb and puts into a Variable

There is a same named log file that I have on my 2 different android phones. When I plug it into my computer, it appears in the media folder, For example the first android phone: /media/F6BA-0AF5/folder/A.log I want to put that into a variable to be manipulated.... (3 Replies)
Discussion started by: tobenguyen
3 Replies

5. Shell Programming and Scripting

Script to detect dynamic ip change and update to config file

Hi All, I am newbie here and request your assistance. I have a service running on public ip, but since I have a dynamic IP it keeps on changing and every time I need to manually get the new ip and add to the config file and restart the service. This has become bit time consuming. Hence, I... (4 Replies)
Discussion started by: Shaan_Shaan
4 Replies

6. Shell Programming and Scripting

How to detect empty field in awk ?

Hi ! programmers I have a need of detecting empty field in file my file looks like this 40.900|-71.600|1.6|20|1|1961|21.00|3.700||1|US|28035|10029370|31 40.900|-71.600|5.7|20|1|1961|21.00|3.700||1|US|28035|10029370|31 40.900|-71.600|7.8|20|1|1961|21.00|3.700||1|US|28035|10029370|31... (7 Replies)
Discussion started by: Dona Clara
7 Replies

7. Shell Programming and Scripting

Help with detect with regex and move script

Hi all, I am needing some help with a script that will search for a video file by known extensions and then do a pattern search (I'm guessing via regex) and then based on a match of one type of another move the file to an assigned directory. I would like to do this with either a shell script... (7 Replies)
Discussion started by: Simplify
7 Replies

8. Shell Programming and Scripting

How to detect awk and nawk?

I have 10 scripts which use awk/nawk extensively. I have to always change awk to nawk and nawk to awk when i deploy all my scripts to different types of servers as some support nawk while other support awk. Can you propose a solution that without having to tweak my 10 scripts at several... (8 Replies)
Discussion started by: mohtashims
8 Replies

9. Shell Programming and Scripting

awk script to detect specific string in a log file and count it

Hello, can someone guide me on this? I don't know what is the best approach, (awk script, shell script) I am using RedHat Linux version 6.5. There is a third party application deployed on that server. This app by default generates 5 log files and each file is 20MB. These log rollover... (5 Replies)
Discussion started by: ktisbest
5 Replies

10. Shell Programming and Scripting

How to detect url in use in a script?

Hello, I have a small script and it runs from web application in below format: pipe:///path_to_myscript.sh url1 url2 url3 myscript.sh: #!/bin/bash count=0 while do count=$((count+1)) exec 3>&1 ((ffmpeg -i $1 ...... -f mpegts pipe:1 2>/dev/null 1>&3 ) 2>&1 | \ while read LINE; do echo... (9 Replies)
Discussion started by: baris35
9 Replies

LEARN ABOUT DEBIAN

hobbitweb

HOBBITWEB(5)							File Formats Manual						      HOBBITWEB(5)

NAME

       Xymon web page headers, footers and forms.

DESCRIPTION

       The  Xymon  webpages  are  somewhat  customizable, by modifying the header- and footer-templates found in the ~xymon/server/web/ directory.
       There are usually two or more files for a webpage: A template_header file which is the header for this webpage, and a template_footer  file
       which is the footer.  Webpages where entry forms are used have a template_form file which is the data-entry form.

       With  the  exception of the bulletin files, the header files are inserted into the HTML code at the very beginning and the footer files are
       inserted at the bottom.

       The following templates are available:

       bulletin
	      A bulletin_header and bulletin_footer is not shipped with Xymon, but if they exist then the content of these files will be  inserted
	      in  all  HTML  documents generated by Xymon. The "bulletin_header" contents will appear after the normal header for the webpage, and
	      the "bulletin_footer" will appear just before the normal footer for the webpage. These files can be used to post important  informa-
	      tion about the Xymon system, e.g. to notify users of current operational or monitoring problems.

       acknowledge
	      Header, footer and form template for the Xymon acknowledge alert webpage generated by bb-ack.cgi(1)

       bb     Header and footer for the Xymon Main view webpages, generated by bbgen(1)

       bb2    Header and footer for the Xymon All non-green view webpage, generated by bbgen(1)

       bbnk   Header  and  footer  for the now deprecated BBNK webpage, generated by bbgen.  You should use the newer hobbit-nkview.cgi(1) utility
	      instead, which uses the hobbitnk templates.

       bbrep  Header and footer for the Xymon Main view availability report webpages, generated by bbgen(1) when running  in  availability  report
	      mode.

       bbsnap Header and footer for the Xymon Main view snapshot webpages, generated by bbgen(1) when running in snapshot report mode.

       bbsnap2
	      Header and footer for the Xymon All non-green view snapshot webpage, generated by bbgen(1) when running in snapshot report mode.

       columndoc
	      Header  and footer for the Xymon Column documentation webpages, generated by the bb-csvinfo.cgi(1) utility in the default Xymon con-
	      figuration.

       confreport
	      Header and footer for the Xymon Configuration report webpage, generated by the hobbit-confreport.cgi(1) utility. Note that there are
	      also  "confreport_front"	and  "confreport_back"	templates,  these  are inserted into the generated report before the hostlist, and
	      before the column documentation, respectively.

       event  Header, footer and form for the Xymon Eventlog report, generated by hobbit-eventlog.cgi(1)

       findhost
	      Header, footer and form for the Xymon Find host webpage, generated by bb-findhost.cgi(1)

       graphs Header and footer for the Xymon Graph details webpages, generated by hobbitgraph.cgi(1)

       hist   Header and footer for the Xymon History webpage, generated by bb-hist.cgi(1)

       histlog
	      Header and footer for the Xymon Historical status-log webpage, generated by hobbitsvc.cgi(1) utility when used to show a	historical
	      (non-current) status log.

       hobbitnk
	      Header and footer for the Xymon Critical Systems view webpage, generated by hobbit-nkview.cgi(1)

       hostsvc
	      Header and footer for the Xymon Status-log webpage, generated by hobbitsvc.cgi(1) utility when used to show a current status log.

       info   Header  and footer for the Xymon Info column webpage, generated by hobbitsvc.cgi(1) utility when used to show the host configuration
	      page.

       maintact
	      Header and footer for the Xymon  webpage, generated by hobbit-enadis.cgi(1) utility when using the Enable/Disable "preview" mode.

       maint  Header, footer and form for the Xymon Enable/disable webpage, generated by hobbit-enadis.cgi(1)

       nkack  Form show on the status-log webpage when viewed from the "Critical Systems" overview. This form is used to  acknowledge  a  critical
	      status by the operators monitoring the Critical Systems view.

       nkedit Header, footer and form for the Critical Systems Editor, the hobbit-nkedit.cgi(1) utility.

       replog Header  and footer for the Xymon Report status-log webpage, generated by hobbitsvc.cgi(1) utility when used to show a status log for
	      an availability report.

       report Header, footer and forms for selecting a pre-generated Availability Report.  Handled by the bb-datepage.cgi(1) utility.

       snapshot
	      Header and footer for the Xymon Snapshot report selection webpage, generated by bb-snapshot.cgi(1)

SEE ALSO

       bbgen(1), hobbitsvc.cgi(1), xymon(7)

Xymon							    Version 4.2.3:  4 Feb 2009						      HOBBITWEB(5)
All times are GMT -4. The time now is 11:32 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy