reading web page source in unix


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers reading web page source in unix
# 1  
Old 03-26-2008
reading web page source in unix

is there a command that allows you to take a url and grab the source code from the page and output it to stdout?

i want to know because i want to grab a page and pass it thru another program to analyze the page.

any help would be appreciated
thanks
# 2  
Old 03-26-2008
wget, curl, GET, lynx, ...
# 3  
Old 03-26-2008
thanks alot
# 4  
Old 03-26-2008
Hi.

Threads here are composed with a collection of links that may contain similar material. Look all the way down at the bottom of this page ... cheers, drl
 
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Dump web page source as rendered by browser

Hi guys| I need to retrieve a specific .m3u8 link from a web page, which makes use of iframes and JavaScript I tried to get the full source with "wget", "lynx", "w3m" and "phantomjs", but they can't dump all the source, with the part containing the link that i need, which seems to be inside... (0 Replies)
Discussion started by: Marmz
0 Replies

2. Shell Programming and Scripting

Reading input from web into UNIX file

Hi, Could someone let me know how to read input from a web page into a unix file. I am writing my script in bash shell in Solaris version. Thanks in advance, ayarlaga. (7 Replies)
Discussion started by: ayarlaga
7 Replies

3. AIX

How to Use a UNIX Shell Script to Create an HTML Web Page?

dear friends , in my work i have to monitor some system performance in hourly basis by runing some commands , for example (lpstat) to know that all the queue is ready how can i create webpage and connect it with the server (AIX operating system) and make this page refreshed every 10 second and... (12 Replies)
Discussion started by: rami abusweilei
12 Replies

4. Shell Programming and Scripting

Performing extractions on web source page

I have downloaded a web source page to a file. I then egrep a single word to extract a line containing it to another file. I then cat the second file and remove everything before a word and after a second word to capture the phrase desired. This did not work. I used vi to validate that the 2... (1 Reply)
Discussion started by: slak0
1 Replies

5. Shell Programming and Scripting

web page source cleanup

is it possible to pass webpages to remove all tag style information, but leave the tag... say I have <h1 style='font-size: xxx; color: xxxxxx'>headline 1</h1> i want to get <h1>headline 1</h1> BTW, i got an oneliner here to remove all tags: sed -n '/^$/!{s/<*>//g;p; Thanks a... (4 Replies)
Discussion started by: dtdt
4 Replies

6. HP-UX

Help running a unix script from a web page

First, let me state that I am completely out of my realm with this. I have a server running HPUX. I'm not even sure if this can be considered a UNIX question and for that let me apologize in advance. I need to create a web page where a client can input 2 variables (i.e. date and phone number).... (0 Replies)
Discussion started by: grinds
0 Replies

7. UNIX for Dummies Questions & Answers

Help required Unix and Web page Integration.

HI guys , I want to create a simple website which can communicate with unix server. For example i want to run some command on a unix server through a website. What will be the best approach to do the same. Kindly help . (2 Replies)
Discussion started by: pinga123
2 Replies

8. UNIX and Linux Applications

Html web page to Unix Connectivity

Hi All, I need a basic overview of connecting a HTML web page to Unix I will give a brief of my exact requirement. There will be a front end HTML page - a web page which will have certain buttons. Each button will have certain functionality. For eg: There is a button for Disk Usage. When the... (1 Reply)
Discussion started by: abhilashnair
1 Replies

9. UNIX for Dummies Questions & Answers

Which comand to show the source code on a web page?

Hi folks! I am using MacOsX that runs freeBSD. Could you tell me what comand to type on the Unix Terminal to display on the terminal the source code of a certain web page? I think something like #<comand> http://www.apple.com will display on the terminal's window the html source code... (11 Replies)
Discussion started by: fundidor
11 Replies
Login or Register to Ask a Question