Wget Question ... Help!

Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Wget Question ... Help!
# 1  
Old 02-04-2008
Data Wget Question ... Help!

I'm having a problem in retreiving a web page that I'm requires a user name * password and then I need to post some data.

I've used a screen scrapping program to figure out what data is required.

My question, can I use wget w/ the --http-user & --http-passwd flags along with --post-file or does everything have to be within POST.

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies

2. Shell Programming and Scripting

Wget and gz

Can wget be used to goto a site and piped into a .gz extrated command? wget ftp://ftp.ncbi.nlm.nih.gov/pub/clinvar/vcf_GRCh37 | gunzip -d clinvar_20150603.vcf.gz (1 Reply)
Discussion started by: cmccabe
1 Replies

3. UNIX for Dummies Questions & Answers

Wget help

How can I download only *.zip and *.rar files from a website <index> who has multiple directories in root parent directory? I need wget to crawl every directory and download only zip and rar files. Is there anyway I could do it? (7 Replies)
Discussion started by: galford
7 Replies

4. Shell Programming and Scripting

WGET help!

Hi Friends, I have an url like this https://www.unix.com/help/ In this help directory, I have more than 300 directories which contains file or files. So, the 300 directories are like this http://unix.com/help/ dir1 file1 dir2 file2 dir3 file3_1 file3_2... (4 Replies)
Discussion started by: jacobs.smith
4 Replies

5. UNIX for Dummies Questions & Answers


...... (1 Reply)
Discussion started by: hoo
1 Replies

6. Shell Programming and Scripting

wget a directory structure question

Can you tell me how to download the directory tree just starting from "project1/" in this URL? "https://somesite.com/projects/t/project1/" This command does not seem to do what I want as it downloads also files from the upper hierarchy: wget --no-check-certificate --http-user=user... (4 Replies)
Discussion started by: majormark
4 Replies

7. UNIX for Dummies Questions & Answers

wget output question

Hello there, İ want to ask a very simple question. I want to read the output messages of wget both in terminal and also put them into a text file. i know that by using -o flag, i can log the messages into a text file but then i won't be able to see them on terminal. I'd appreciate any help... (1 Reply)
Discussion started by: sertansenturk
1 Replies

8. Shell Programming and Scripting

wget help

i am trying to ftp files/dirs with wget. i am having an issue where the path always takes me to my home dir even when i specify something else. For example: wget -m ftp://USER:PASS@IP_ADDRESS/Path/on/remote/box ...but if that path on the remote box isn't in my home dir it doesn't change to... (0 Replies)
Discussion started by: djembeplayer
0 Replies

9. Shell Programming and Scripting

wget question

Hi, I need some guidance about wget. I am able to run the script as below; which i have list of staff id in staffid.txt. But the problem is each staffid referred to the same txid ( in this case txid=123456). How i can insert unique txid for each staffid and run it? Is it i need to... (3 Replies)
Discussion started by: malaysoul
3 Replies

10. Shell Programming and Scripting

wget -r

I have noticed a lot of expensive books appearing online so I have decided to copy them to CD. I was going to write a program in java to do this, but remembered that wget GNU program some of you guys were talking about. Instead of spending two hours or so writing a program to do this.... (1 Reply)
Discussion started by: photon
1 Replies
Login or Register to Ask a Question
pure-ftpwho(8)							     Pure-FTPd							    pure-ftpwho(8)

pure-ftpwho - Report current FTP sessions SYNTAX
pure-ftpwho [-c] [-h] [-H] [-n] [-p] [-s] [-v] [-w] [-W] [-x] DESCRIPTION
pure-ftpwho shows current Pure-FTPd client sessions. Only the system administrator may run this. Output can be text (default), HTML, XML data and parser-optimized. The server has to be compiled with --with-ftpwho to support this command. OPTIONS
-c the program is called via a web server (CGI interface) . Output is a full HTML page with the initial content-type header. This option is automatically enabled if an environment variable called GATEWAY_INTERFACE is found. This is the default if you can the program from a CGI-enabled web server (Apache, Roxen, Caudium, WN, ...) . -h Output help information and exit. -H Don't resolve host names, and only show IP addresses (faster). -n A synonym for -H. -p Output Mac OSX / GNUStep plist data. -s Output only one line per client, with only numeric data, delimited by a | character. It's not very human-readable, but it's designed for easy parsing by shell scripts (cut/sed) . '|' characters in user names or file names are quoted (|) . -v Output an ASCII table (just like the default mode), with more info. The verbose output includes the local IP, the local port, the total size of transfered files and the current number of transfered bytes. -w Output a complete HTML page (web mode). -W Output an HTML page with no header and no footer. This is an embedded mode, suitable for inline calls from CGI, SSI or PHP scripts. -x Output well-formed XML data for post-processing. FILES
/var/run/pure-ftpd/ Scoreboard directory. Should always owned by root and on a lockable filesystem. ENVIRONMENT VARIABLES
GATEWAY_INTERFACE If found, automatically run in CGI mode and output HTML data. AUTHORS
Frank DENIS <j at pureftpd dot org> SEE ALSO
ftp(1), pure-ftpd(8) pure-ftpwho(8) pure-mrtginfo(8) pure-uploadscript(8) pure-statsdecode(8) pure-pw(8) pure-quotacheck(8) pure-authd(8) RFC 959, RFC 2389, RFC 2228 and RFC 2428. Pure-FTPd team 1.0.36 pure-ftpwho(8)