Sponsored Content
Full Discussion: check web content - Ksh
Operating Systems AIX check web content - Ksh Post 302451586 by bakunin on Tuesday 7th of September 2010 09:46:41 AM
Old 09-07-2010
Quote:
Originally Posted by funksen
I would use wget
... or cURL or Lynx ... or probably some dozen other (and to me unknown) similar tools. Choose your poison....

I hope this helps.

bakunin
 

4 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Web content download

There is a web API https://pi.ercot.com/contentproxy/publicList?folder_id=10001937 As soon as this is fired on the browser a page comes in which many files are listed for downloads I want to download all the files ....is it possible to write a shell script which can download the files (1 Reply)
Discussion started by: viv1
1 Replies

2. Shell Programming and Scripting

How to check whether the web page is up without dowloading any content

Hi I am writing a script to check wheather the web page is up and running. I dont want to download the web page.. I I used wget --spider command. but i am not getting anything. can some one tell me the command to the web page.. if the page is up and running I should send a mail to my... (19 Replies)
Discussion started by: ahamed
19 Replies

3. Shell Programming and Scripting

Getting web page content and deliver via mail

Guys could you please help. I want to have shell scripts that get the website html content and same time mail html page to DL. Can any1 help here? (2 Replies)
Discussion started by: AnkitC
2 Replies

4. Shell Programming and Scripting

Trying to submit web form content to a shell script

Hi I was hoping some one could help me with a problem I have. I am trying to collect some information from a web form and save it to a text file. I found an example on this site that is sort of what I am trying to accomplish, the shell script bellow should echo the input back to the browser... (0 Replies)
Discussion started by: Paul Walker
0 Replies
DANSGUARDIAN(8) 						   dansguardian 						   DANSGUARDIAN(8)

NAME
DansGuardian2 - web content filter SYNOPSIS
dansguardian [ -c config-file ] [ -v ] [ -h ] [ -N ] [ -q ] [ -Q ] [ -s ] [ -r ] [ -g ] SUMMARY
DansGuardian is a web content filtering proxy(1) for Linux, NetBSD, FreeBSD, OpenBSD, and Solaris that uses Squid(2) to do all the fetch- ing. It filters using multiple methods. These methods include URL and domain filtering, content phrase filtering, PICS filtering, MIME type fil- tering, file extension filtering, POST limiting and content (AV) scanning. The content phrase filtering will check for pages that contain profanities and phrases often associated with pornography and other undesir- able content. The POST filtering allows you to block or limit web uploads. The URL and domain filtering is able to handle huge lists and is significantly faster than squidGuard. Content scanning enables downloaded content to be passed through ClamD, KAVD, any local program with machine-parseable console output, and any other AV scanner available as an ICAP server. The filtering has configurable domain, user and source IP exception lists. SSL tunneling is supported; however, due to the encrypted nature of HTTPS requests, filtering is only supported on destination domain. The configurable logging produces a log in an easy to read format which has the option to only log the text-based pages, thus significantly reducing redundant information such as every image on a page. DansGuardian is under continuous development and so it is best to visit the web site for the latest information. (1) Technically DansGuardian is more of a filtering pass-through than a true proxy - but don't let that worry you! (2) DansGuardian should work with any proxy, not just Squid. For example, it is known to work with Oops. DOCUMENTATION
For all further information including copyright, support, FAQ, docs, mailing list - please go to: http://dansguardian.org/ Mirror: http://dansguardian.intmain.com/ Available documentation can be found at http://www.dansguardian.org/?page=documentation The DansGuardian FAQ is at http://www.dansguardian.org/?page=faq Some useful HOWTOs that cover specific implimentations of DansGuardian and caching/filtering in general can be found at http://www.dansguardian.org/?page=howto Information about Debian specific changes and configuration can be found in /usr/share/doc/dansguardian/changelog.Debian.gz . OPTIONS
-c config-file Use the given config-file. -v gives the version number and build options. -h Output a short summary of available command line options. -N Do not go into the background. -q causes DansGuardian to kill any running copy. -Q kill any running copy AND start a new one with current options. -s shows the parent process PID and exits. -r closes all connections and reloads config files by issuing a HUP, but this does not reset the maxchildren option (amongst others). -g gently restarts by not closing all current connections; only reloads filter group config files. (Issues a USR1) COPYRIGHT
DansGuardian is copyright Daniel Barron 2001. daniel@jadeb.com Daniel Barron Oct 2008 DANSGUARDIAN(8)
All times are GMT -4. The time now is 01:03 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy