fetching a web page in C - High Level Programming

rayne · #1 08-08-2007

Hello,

I'm a total newbie to HTTP commands, so I'm not sure how to do this. What I'd like is to write a C program to fetch the contents of a html page of a given address.

Could someone help with this?

Thanks in advance!

matrixmadhan · #2 08-08-2007

what I could immediately think of is

use ( wget url ) in a system with contents redirected to a file.

But this is the not right approach.

Else

frame a http request and post it to the port 80 of the needed url

porter · #3 08-08-2007

You basically do

Code:

fd=socket(AF_INET,SOCK_STREAM,0);
connect(fd,remoteWebserver....)
send(fd,"GET / HTTP/1.0\r\n\r\n",18);
shutdown(fd,SD_SEND);
while ((i=recv(fd,buf,sizeof(buf),0))>0)
{
      write(1,buf,i);
}
close(fd);

However, as life is short, I recommend spawning wget so it can deal with http/ftp/https etc

porter · #4 08-08-2007

You can deal with https by using OpenSSL to provide the TCP connectivity.

cbkihong · #5 08-08-2007

Don't reinvent the wheel! Use libcurl:

libcurl - C API

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
lpr- how to print from page to page	naamas03	Shell Programming and Scripting	4	12-26-2007 03:30 AM
scp-1.2.27 man page	Tornado	Linux	4	03-16-2007 05:09 AM
Fetching file from windows server	rochitsharma	UNIX for Advanced & Expert Users	5	08-19-2006 06:51 AM
map Page Down and Page up to ] and [	buddy_amazing	AIX	0	03-01-2005 11:34 AM
PHP:page.php?id= ????	perleo	Shell Programming and Scripting	1	10-01-2003 06:29 AM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode