Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Wget -i URLs.txt problem
Top Forums UNIX for Dummies Questions & Answers Wget -i URLs.txt problem Post 302732633 by Corona688 on Sunday 18th of November 2012 09:28:19 PM
Old 11-18-2012
You can't just dump raw post data into a page that's not expecting it, it won't work. You need to look at the page and see what it's actually doing.

In this case, the login page is ( I think ) http://resell-rights-weekly.com/members/members.php, which expects post-data like you've been given.

To save the cookies, you need to tell wget to save the cookies(including session cookies), see man wget. So you could call wget once to login and save the cookies, and then call it again, loading the cookies to download the rest.
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Sorting problem "sort -k 16,29 sample.txt > output.txt"

Hi all, Iam trying to sort the contents of the file based on the position of the file. Example: $cat sample.txt 0101020060731 ## Header record 1c1 Berger Awc ANP20070201301 4000.50 1c2 Bose W G ANP20070201609 6000.70 1c2 Andy CK ANP20070201230 28000.00... (3 Replies)
Discussion started by: ganapati
3 Replies

2. UNIX for Advanced & Expert Users

Wget FTP problem!

Hi, I've tried to download from ftp sites by wget but it failed and says "Service unavailable" but when I use sftp in binary mode and use "get" command it works perfectly. What's the problem? BTW: I tried both passive and active mode in wget. thnx for ur help (9 Replies)
Discussion started by: mjdousti
9 Replies

3. Shell Programming and Scripting

Problem with wget

Hi, I want to download some patches from SUN by using a script and I am using "wget" as the utillity for this. The website for downloading has a "https:" in its name as below https://sunsolve.sun.com/private-cgi/pdownload.pl?target=${line}&method=h and on running wget as below wget... (1 Reply)
Discussion started by: max29583
1 Replies

4. Shell Programming and Scripting

Extract urls from index.html downloaded using wget

Hi, I need to basically get a list of all the tarballs located at uri I am currently doing a wget on urito get the index.html page Now this index page contains the list of uris that I want to use in my bash script. can someone please guide me ,. I am new to Linux and shell scripting. ... (5 Replies)
Discussion started by: mnanavati
5 Replies

5. UNIX for Dummies Questions & Answers

Problem with wget no check certificate.

Hi, I'm trying to install some libraries, when running the makefile I get an error from the "wget --no check certificate option". I had a look help and the option wasn't listed. Anyone know what I'm missing. (0 Replies)
Discussion started by: davcra
0 Replies

6. UNIX for Dummies Questions & Answers

find lines in file1.txt not found in file2.txt memory problem

I have a diff command that does what I want but when comparing large text/log files, it uses up all the memory I have (sometimes over 8gig of memory) diff file1.txt file2.txt | grep '^<'| awk '{$1="";print $0}' | sed 's/^ *//' Is there a better more efficient way to find the lines in one file... (5 Replies)
Discussion started by: raptor25
5 Replies

7. Shell Programming and Scripting

Problem with wget and cookie

Dear people, I got a problem with an scrip using wget to download pdf-files from an website which uses session-cookies. Background: for university its quite nasty to look up weekly which new homeworks, papers etc. are available on the different sites of the universites chairs. So I wanted a... (1 Reply)
Discussion started by: jackomo
1 Replies

8. Shell Programming and Scripting

Download pdf's using wget convert to txt

wget -i genedx.txt The code above will download multiple pdf files from a site, but how can i download and convert these to .txt? I have attached the master list (genedx.txt - which contains the url and file names) as well as the two PDF's that are downloaded. I am trying to have those... (7 Replies)
Discussion started by: cmccabe
7 Replies

9. Proxy Server

Problem with wget

I cannot download anything using wget in centos 6.5 and 7. But I can update yum etc. # wget https://wordpress.org/latest.tar.gz --2014-10-23 13:50:23-- https://wordpress.org/latest.tar.gz Resolving wordpress.org... 66.155.40.249, 66.155.40.250 Connecting to wordpress.org|66.155.40.249|:443...... (3 Replies)
Discussion started by: nirosha
3 Replies

LEARN ABOUT DEBIAN

dillo

dillo(1)							   USER COMMANDS							  dillo(1)

NAME

       dillo - web browser

SYNOPSIS

       dillo [OPTION]...  [--] [URL|FILE]...

DESCRIPTION

       Dillo  is a lightweight graphical web browser that aims to be secure.  It handles HTTP internally, and FILE, FTP, and DATA URIs are handled
       through a plugin system (dpi). In addition, INSECURE HTTPS support can be enabled. Both FTP and Dillo's download manager  use  the  wget(1)
       downloader.

       Dillo  displays	HTML,  text,  PNG, JPEG, and GIF files.  It handles cookies, HTTP authentication (basic and digest), proxying (basic), and
       some CSS.

       Framesets are displayed as links to frames, and there is currently no support for javascript or video.

OPTIONS

       -f, --fullwindow
	      Start in full window mode: hide address bar, navigation buttons, menu, and status bar.

       -g, --geometry GEO
	      Set initial window position where GEO is WxH[{+-}X{+-}Y].

       -h, --help
	      Display this help text and exit.

       -l, --local
	      Don't load images for these URL(s).

       -v, --version
	      Display version info and exit.

       -x, --xid XID
	      Open first Dillo window in an existing window whose window ID is XID.

EXIT STATUS

       0      No error.

       1      Internal error.

       2      Error in command line arguments.

ENVIRONMENT

       HOME (or HOMEDRIVE and HOMEPATH on Cygwin)
	      User's home directory.

       http_proxy
	      URL of proxy to send HTTP traffic through.

FILES

       dpid   Dillo plugin daemon

       dpidc  Control program for dpid.

       ~/.dillo/bm.txt
	      User bookmarks

       ~/.dillo/certs/
	      Saved certificates for HTTPS.

       ~/.dillo/cookies.txt
	      Stored cookies

       ~/.dillo/cookiesrc
	      Cookie settings

       ~/.dillo/dillorc
	      Configuration file.

       ~/.dillo/dpid_comm_keys
	      Keys used in dpi daemon communication.

       ~/.dillo/dpidrc
	      Contains name of directory containing dpis, and associates dpi files with protocols.

       ~/.dillo/keysrc
	      Keybindings.

       ~/.dillo/style.css
	      User style sheet

SEE ALSO

       wget(1)

       Dillo website: http://www.dillo.org

								 October 13, 2011							  dillo(1)
All times are GMT -4. The time now is 11:05 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy