Sponsored Content
Top Forums Shell Programming and Scripting Wget error while downloading from https website Post 302844555 by Corona688 on Monday 19th of August 2013 11:45:53 AM
Old 08-19-2013
From man wget:
Code:
       --post-data=string
       --post-file=file
           Use POST as the method for all HTTP requests and send the specified
           data in the request body.  --post-data sends string as data,
           whereas --post-file sends the contents of file.  Other than that,
           they work in exactly the same way. In particular, they both expect
           content of the form "key1=value1&key2=value2", with percent-encod-
           ing for special characters; the only difference is that one expects
           its content as a command-line paramter and the other accepts its
           content from a file.

The real question is, what data does this website expect in POST? There is no generic answer, that is up to their implementation, you'll have to look at its <form>s to see that.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Downloading info from website to database

Hi guys! I created a database using mysql in bash now i would like to download weather info from the data.(temp, date and time)...and just store this in the database to display after every 3 hours or so... i have tried to get the website using wget and now dont exactly now how to go from here... (0 Replies)
Discussion started by: vadharah
0 Replies

2. Solaris

HTTP error while downloading solaris patches using wget

Hello, I am getting a HTTP error while downloading solaris patches using wget. 'Downloading unsigned patch 113096-03. --2010-06-18 03:51:15-- http://sunsolve.sun.com/pdownload.pl?target=113096-03&method=h Resolving sunsolve.sun.com (sunsolve.sun.com)... 192.18.108.40 Connecting to... (5 Replies)
Discussion started by: sunny_a_j
5 Replies

3. Windows & DOS: Issues & Discussions

Downloading a file from Website to a Windows Folder

Hi, Is it possible to download a file using Wget or some other command from a Windows machine? Say I want to download something from https server to C:\ABC\abc.xls Any ideas, Thanks. (4 Replies)
Discussion started by: dohko
4 Replies

4. UNIX for Dummies Questions & Answers

Crontab Wget, downloading a file to a FTP

Hi there, I've got my own domain, ftp etc.. I'm using cPanel and I want to download a file periodically, every say 24 hours. I've used this command: wget -t inf http : / / www . somesite . com / webcam.jpg ftp : / / i @ MyDomain . net : Password @ ftp . MyDomain . net^no spaces... (24 Replies)
Discussion started by: zYx
24 Replies

5. UNIX for Dummies Questions & Answers

wget pdf downloading problem

Hi. I am trying to make a mirror of this free online journal: http://www.informaworld.com/smpp/title~content=t716100758~db=all Under the individual issues, the link location for the "Full Text PDF" does not have ".pdf" as an extension -- so when I use wget it misses the file. However clicking... (5 Replies)
Discussion started by: obo1234
5 Replies

6. Shell Programming and Scripting

Downloading with Wget

Hello everyone. I'm new both to the forum and to unix scripting, and this website has been very useful in putting together a script I am working on. However, I have run into a bit of a snag, which is why I have come here seeking help. First I will say what I am trying to do, and then what I have... (2 Replies)
Discussion started by: keltonhalbert
2 Replies

7. UNIX and Linux Applications

Problems with wget and https connection

Hi, I have wget for linux but I'm having trouble using it. I am trying to use it with a HTTPS connection to save cookies but it doesn't works. I do: wget --save-cookies=cookies.txt --post-data... (2 Replies)
Discussion started by: mierdatuti
2 Replies

8. AIX

wget https

Hello, can someone tell me where the certificate store on aix 6.1 is. If I want to use wget with a https site Iam getting an error that the issuer is untrusted. Thats right because its an self sign certificate. (3 Replies)
Discussion started by: ralphk
3 Replies

9. Shell Programming and Scripting

Downloading jpgs from a gallery type website

Can someone explain what this does step by step? I found this script on stackoverflow and want to customize it for personal use in downloading jpg images from a website. # get all pages curl 'http://domain.com/id/' -o '#1.html' # get all images grep -oh... (3 Replies)
Discussion started by: workisnotfun
3 Replies

10. Shell Programming and Scripting

Wget for downloading a public file (stream) as mp4

I need a hint for using wget for getting a free content from a TV station that is streaming its material for a while until it appears on any video platform, that means no use of illegal methods, because it is on air, recently published and available. But reading the manual for wget I tried the... (5 Replies)
Discussion started by: 1in10
5 Replies
curl_formadd(3) 						  libcurl Manual						   curl_formadd(3)

NAME
curl_formadd - add a section to a multipart/formdata HTTP POST SYNOPSIS
#include <curl/curl.h> CURLFORMcode curl_formadd(struct HttpPost ** firstitem, struct HttpPost ** lastitem, ...); DESCRIPTION
curl_formadd() is used to append sections when building a multipart/formdata HTTP POST (sometimes refered to as rfc1867-style posts). Append one section at a time until you've added all the sections you want included and then you pass the firstitem pointer as parameter to CURLOPT_HTTPPOST. lastitem is set after each call and on repeated invokes it should be left as set to allow repeated invokes to find the end of the list faster. After the lastitem pointer follow the real arguments. (If the following description confuses you, jump directly to the examples): CURLFORM_COPYNAME or CURLFORM_PTRNAME followed by a string is used for the name of the section. Optionally one may use CURLFORM_NAMELENGTH to specify the length of the name (allowing null characters within the name). All options that use the word COPY in their names copy the given contents, while the ones with PTR in their names simply points to the (static) data you must make sure remain until curl no longer needs it. The four options for providing values are: CURLFORM_COPYCONTENTS, CURLFORM_PTRCONTENTS, CURLFORM_FILE, or CURLFORM_FILECONTENT followed by a char or void pointer (allowed for PTRCONTENTS). CURLFORM_FILECONTENT does a normal post like CURLFORM_COPYCONTENTS but the actual value is read from the filename given as a string. Other arguments may be CURLFORM_CONTENTTYPE if the user wishes to specify one (for FILE if no type is given the library tries to provide the correct one; for CONTENTS no Content-Type is sent in this case). For CURLFORM_PTRCONTENTS or CURLFORM_COPYNAME the user may also add CURLFORM_CONTENTSLENGTH followed by the length as a long (if not given the library will use strlen to determine the length). For CURLFORM_FILE the user may send multiple files in one section by providing multiple CURLFORM_FILE arguments each followed by the file- name (and each FILE is allowed to have a CONTENTTYPE). Another possibility to send single or multiple files in one section is to use CURLFORM_ARRAY that gets a struct curl_forms array pointer as its value. Each structure element has a CURLformoption and a char pointer. For the options only CURLFORM_FILE, CURLFORM_CONTENTTYPE, and CURLFORM_END (that is used to determine the end of the array and thus must be the option of the last and no other element of the curl_forms array) are allowed. The effect of this parameter is the same as giving multiple CURLFORM_FILE options possibly with CURLFORM_CONTENTTYPE after or before each CURLFORM_FILE option. Should you need to specify extra headers for the form POST section, use CURLFORM_CONTENTHEADER. This takes a curl_slist prepared in the usual way using curl_slist_append and appends the list of headers to those Curl automatically generates for CURLFORM_CONTENTTYPE and the content disposition. The list must exist while the POST occurs, if you free it before the post completes you may experience problems. The last argument in such an array must always be CURLFORM_END. The pointers *firstitem and *lastitem should both be pointing to NULL in the first call to this function. All list-data will be allocated by the function itself. You must call curl_formfree after the form post has been done to free the resources again. This function will copy all input data except the data pointed to by the arguments after CURLFORM_PTRNAME and CURLFORM_PTRCONTENTS and keep its own version of it allocated until you call curl_formfree. When you've passed the pointer to curl_easy_setopt, you must not free the list until after you've called curl_easy_cleanup for the curl handle. If you provide a pointer as an arguments after CURLFORM_PTRNAME or CURLFORM_PTRCONTENTS you must ensure that the pointer stays valid until you call curl_form_free and curl_easy_cleanup. See example below. RETURN VALUE
0 means everything was ok, non-zero means an error occurred as <curl/curl.h> defines. EXAMPLE
struct HttpPost* post = NULL; struct HttpPost* last = NULL; char namebuffer[] = "name buffer"; long namelength = strlen(namebuffer); char buffer[] = "test buffer"; char htmlbuffer[] = "<HTML>test buffer</HTML>"; long htmlbufferlength = strlen(htmlbuffer); struct curl_forms forms[3]; char file1[] = "my-face.jpg"; char file2[] = "your-face.jpg"; /* add null character into htmlbuffer, to demonstrate that transfers of buffers containing null characters actually work */ htmlbuffer[8] = ''; /* Add simple name/content section */ curl_formadd(&post, &last, CURLFORM_COPYNAME, "name", CURLFORM_COPYCONTENTS, "content", CURLFORM_END); /* Add simple name/content/contenttype section */ curl_formadd(&post, &last, CURLFORM_COPYNAME, "htmlcode", CURLFORM_COPYCONTENTS, "<HTML></HTML>", CURLFORM_CONTENTTYPE, "text/html", CURLFORM_END); /* Add name/ptrcontent section */ curl_formadd(&post, &last, CURLFORM_COPYNAME, "name_for_ptrcontent", CURLFORM_PTRCONTENTS, buffer, CURLFORM_END); /* Add ptrname/ptrcontent section */ curl_formadd(&post, &last, CURLFORM_PTRNAME, namebuffer, CURLFORM_PTRCONTENTS, buffer, CURLFORM_NAMELENGTH, namelength, CURLFORM_END); /* Add name/ptrcontent/contenttype section */ curl_formadd(&post, &last, CURLFORM_COPYNAME, "html_code_with_hole", CURLFORM_PTRCONTENTS, htmlbuffer, CURLFORM_CONTENTSLENGTH, htmlbufferlength, CURLFORM_CONTENTTYPE, "text/html", CURLFORM_END); /* Add simple file section */ curl_formadd(&post, &last, CURLFORM_COPYNAME, "picture", CURLFORM_FILE, "my-face.jpg", CURLFORM_END); /* Add file/contenttype section */ curl_formadd(&post, &last, CURLFORM_COPYNAME, "picture", CURLFORM_FILE, "my-face.jpg", CURLFORM_CONTENTTYPE, "image/jpeg", CURLFORM_END); /* Add two file section */ curl_formadd(&post, &last, CURLFORM_COPYNAME, "pictures", CURLFORM_FILE, "my-face.jpg", CURLFORM_FILE, "your-face.jpg", CURLFORM_END); /* Add two file section using CURLFORM_ARRAY */ forms[0].option = CURLFORM_FILE; forms[0].value = file1; forms[1].option = CURLFORM_FILE; forms[1].value = file2; forms[2].option = CURLFORM_END; /* no option needed for the end marker */ curl_formadd(&post, &last, CURLFORM_COPYNAME, "pictures", CURLFORM_ARRAY, forms, CURLFORM_END); /* Add the content of a file as a normal post text value */ curl_formadd(&post, &last, CURLFORM_COPYNAME, "filecontent", CURLFORM_FILECONTENT, ".bashrc", CURLFORM_END); /* Set the form info */ curl_easy_setopt(curl, CURLOPT_HTTPPOST, post); SEE ALSO
curl_easy_setopt(3), curl_formparse(3) [deprecated], curl_formfree(3) BUGS
Surely there are some, you tell me! libcurl 7.9.8 21 May 2002 curl_formadd(3)
All times are GMT -4. The time now is 05:31 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy