Sponsored Content
Top Forums UNIX for Dummies Questions & Answers When downloading a webpage by curl, what happen? Post 302895320 by bakunin on Monday 31st of March 2014 07:46:04 AM
Old 03-31-2014
Quote:
Originally Posted by postcd
when im downloading an webpage from command line (CLI) by curl or wget the target website is loaded like i load it from browser?
In principle: yes. A web page is served similar to a multipart/mime-message over e-mail. You have some header information (encoded into the URL), some "framework information" and optionally one or several additional data sources (pictures, videos, programs like flash, ...) embedded in this "framework". A browser receives such messages, displays them (quite like a mail reader would do for mails) and - driven by user actions - replies with a similar sort of messages which can range from very simple to equally complicated and similarly structured (quite like you answer a mail with a reply of your own).

Quote:
Originally Posted by postcd
meaning target server connect to database and render data from mysql? Or only static content is downloaded?
Some of the elements i talked about above only work interactively. Both cURL and wget have (limited) provisions to deal with that. That means, some aspects of a user sitting there and interactively clicking/etc. something can be emulated, some cannot.

I hope this helps.

bakunin
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

what happen when changing Hostname?

I 'm using RH 7.2 Genome in the Network Configuration I change therer are two places one for static hostname for my machine and in DNS hostname I don't know what happen when restarting my PC when connecting using dialer I can't browse the Internet also I can't use sendmail .......Server timeout... (2 Replies)
Discussion started by: atiato
2 Replies

2. Programming

Any one can tell me how this happen?

The #1 Online Store for Louis Vuitton Replicas is: http://www.opichina.com.cn. We offer Louis Vuitton Replicas and more! Whatever you call it: LV Bags, LV Replicas, Louis Vuitton Fake, Louis Vuitton Knockoffs, Louis Vuitton Bag, Louis Vuitton Purse, Louis Vuitton Wallet, Louis Vuitton Shoes,... (10 Replies)
Discussion started by: jiangyanna
10 Replies

3. UNIX for Dummies Questions & Answers

What would happen if. . .

Hi, Could someone please tell me what would happen if the following were entered into the command line: rm -i /books/*.* rm /books/* Many thanks! (3 Replies)
Discussion started by: crispy
3 Replies

4. UNIX for Dummies Questions & Answers

How Do I Set a Task to Happen in the Future?

Is it possible to set a task to happen in the future? Say I want to log-off only after 10 hours of being logged on with out doing any activity in between? (2 Replies)
Discussion started by: Slick
2 Replies

5. Programming

what would happen if a process wrote to its own stdin?

what would happen if a process wrote to its own stdin? #include<unistd.h> #include<fcntl.h> int main() { if((write(STDIN_FILENO,"arrgh!",6))==-1) { perror("error writing to file"); } } output: $ gcc temp.c $ ./a.out arrgh!$ (9 Replies)
Discussion started by: c_d
9 Replies

6. AIX

How does ITIL processing happen in AIX?

How does ITIL process is implemened in AIX? (6 Replies)
Discussion started by: AIXlearner
6 Replies

7. Homework & Coursework Questions

songs downloading using curl

Hi , I need to download songs from website using shell script.I have written script for that. The code is #!/bin/ksh curl "http://www.songs.pk/$1.html" >tmp_page 2>tmp_error grep songid tmp_page|cut -d'"' -f2 > song_links while read link; do echo $link curl "$link" >tmp_song 2>tmp_err... (1 Reply)
Discussion started by: pandu25
1 Replies

8. Shell Programming and Scripting

Downloading of dynamically generated URL using curl and sed

I've been attempting to use curl and sed to allow for downloading a file from a dynamically generated URL. I've been able to retrieve and save the HTML of the page that does the dynamic generation of the download URL using curl but I'm very new to sed and I seem to be stuck at this part. HTML: ... (1 Reply)
Discussion started by: schwein
1 Replies

9. Shell Programming and Scripting

How to get content of a webpage Curl vs Wget?

Hello, What I am trying to do is to get html data of a website automatically. Firstly I decided to do it manually and via terminal I entered below code: $ wget http://www.***.*** -q -O code.html Unfortunately code.html file was empty. When I enter below code it gave Error 303-304 $... (1 Reply)
Discussion started by: baris35
1 Replies

10. Shell Programming and Scripting

Curl - upload multiple attachment arrays to server webpage

The html page of the form data is as below <form name="uploadform" id="uploadform" action="htmlupload.php" enctype="multipart/form-data" method="post"> <table class="tborder" cellpadding="6" cellspacing="1" border="0" width="100%" align="center"> <tr> <td class="tcat"> Upload Files ... (0 Replies)
Discussion started by: jaango123
0 Replies
CURL_SETOPT_ARRAY(3)							 1						      CURL_SETOPT_ARRAY(3)

curl_setopt_array - Set multiple options for a cURL transfer

SYNOPSIS
bool curl_setopt_array (resource $ch, array $options) DESCRIPTION
Sets multiple options for a cURL session. This function is useful for setting a large amount of cURL options without repetitively calling curl_setopt(3). PARAMETERS
o $ch -A cURL handle returned by curl_init(3). o $options - An array specifying which options to set and their values. The keys should be valid curl_setopt(3) constants or their integer equivalents. RETURN VALUES
Returns TRUE if all options were successfully set. If an option could not be successfully set, FALSE is immediately returned, ignoring any future options in the $options array. EXAMPLES
Example #1 Initializing a new cURL session and fetching a web page <?php // create a new cURL resource $ch = curl_init(); // set URL and other appropriate options $options = array(CURLOPT_URL => 'http://www.example.com/', CURLOPT_HEADER => false ); curl_setopt_array($ch, $options); // grab URL and pass it to the browser curl_exec($ch); // close cURL resource, and free up system resources curl_close($ch); ?> Prior to PHP 5.1.3 this function can be simulated with: Example #2 Our own implementation of curl_setopt_array(3) <?php if (!function_exists('curl_setopt_array')) { function curl_setopt_array(&$ch, $curl_options) { foreach ($curl_options as $option => $value) { if (!curl_setopt($ch, $option, $value)) { return false; } } return true; } } ?> NOTES
Note As with curl_setopt(3), passing an array to CURLOPT_POST will encode the data as multipart/form-data, while passing a URL-encoded string will encode the data as application/x-www-form-urlencoded. SEE ALSO
curl_setopt(3). PHP Documentation Group CURL_SETOPT_ARRAY(3)
All times are GMT -4. The time now is 10:55 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy