Wget Question ... Help!


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Wget Question ... Help!
# 1  
Old 02-04-2008
Data Wget Question ... Help!

I'm having a problem in retreiving a web page that I'm requires a user name * password and then I need to post some data.

I've used a screen scrapping program to figure out what data is required.

My question, can I use wget w/ the --http-user & --http-passwd flags along with --post-file or does everything have to be within POST.

Thanks
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies

2. Shell Programming and Scripting

Wget and gz

Can wget be used to goto a site and piped into a .gz extrated command? wget ftp://ftp.ncbi.nlm.nih.gov/pub/clinvar/vcf_GRCh37 | gunzip -d clinvar_20150603.vcf.gz (1 Reply)
Discussion started by: cmccabe
1 Replies

3. UNIX for Dummies Questions & Answers

Wget help

How can I download only *.zip and *.rar files from a website <index> who has multiple directories in root parent directory? I need wget to crawl every directory and download only zip and rar files. Is there anyway I could do it? (7 Replies)
Discussion started by: galford
7 Replies

4. Shell Programming and Scripting

WGET help!

Hi Friends, I have an url like this https://www.unix.com/help/ In this help directory, I have more than 300 directories which contains file or files. So, the 300 directories are like this http://unix.com/help/ dir1 file1 dir2 file2 dir3 file3_1 file3_2... (4 Replies)
Discussion started by: jacobs.smith
4 Replies

5. UNIX for Dummies Questions & Answers

Wget

...... (1 Reply)
Discussion started by: hoo
1 Replies

6. Shell Programming and Scripting

wget a directory structure question

Can you tell me how to download the directory tree just starting from "project1/" in this URL? "https://somesite.com/projects/t/project1/" This command does not seem to do what I want as it downloads also files from the upper hierarchy: wget --no-check-certificate --http-user=user... (4 Replies)
Discussion started by: majormark
4 Replies

7. UNIX for Dummies Questions & Answers

wget output question

Hello there, İ want to ask a very simple question. I want to read the output messages of wget both in terminal and also put them into a text file. i know that by using -o flag, i can log the messages into a text file but then i won't be able to see them on terminal. I'd appreciate any help... (1 Reply)
Discussion started by: sertansenturk
1 Replies

8. Shell Programming and Scripting

wget help

i am trying to ftp files/dirs with wget. i am having an issue where the path always takes me to my home dir even when i specify something else. For example: wget -m ftp://USER:PASS@IP_ADDRESS/Path/on/remote/box ...but if that path on the remote box isn't in my home dir it doesn't change to... (0 Replies)
Discussion started by: djembeplayer
0 Replies

9. Shell Programming and Scripting

wget question

Hi, I need some guidance about wget. I am able to run the script as below; which i have list of staff id in staffid.txt. But the problem is each staffid referred to the same txid ( in this case txid=123456). How i can insert unique txid for each staffid and run it? Is it i need to... (3 Replies)
Discussion started by: malaysoul
3 Replies

10. Shell Programming and Scripting

wget -r

I have noticed a lot of expensive books appearing online so I have decided to copy them to CD. I was going to write a program in java to do this, but remembered that wget GNU program some of you guys were talking about. Instead of spending two hours or so writing a program to do this.... (1 Reply)
Discussion started by: photon
1 Replies
Login or Register to Ask a Question
Net::DNS::Question(3)					User Contributed Perl Documentation				     Net::DNS::Question(3)

NAME
Net::DNS::Question - DNS question class SYNOPSIS
"use Net::DNS::Question" DESCRIPTION
A "Net::DNS::Question" object represents a record in the question section of a DNS packet. METHODS
new $question = Net::DNS::Question->new("example.com", "MX", "IN"); Creates a question object from the domain, type, and class passed as arguments. RFC4291 and RFC4632 IP address/prefix notation is supported for queries in in-addr.arpa and ip6.arpa subdomains. parse ($question, $offset) = Net::DNS::Question->parse($data, $offset); Parses a question section record at the specified location within a DNS packet. The first argument is a reference to the packet data. The second argument is the offset within the packet where the question record begins. Returns a Net::DNS::Question object and the offset of the next location in the packet. Parsing is aborted if the question object cannot be created (e.g., corrupt or insufficient data). qname, zname print "qname = ", $question->qname, " "; print "zname = ", $question->zname, " "; Returns the domain name. In dynamic update packets, this field is known as "zname" and refers to the zone name. qtype, ztype print "qtype = ", $question->qtype, " "; print "ztype = ", $question->ztype, " "; Returns the record type. In dymamic update packets, this field is known as "ztype" and refers to the zone type (must be SOA). qclass, zclass print "qclass = ", $question->qclass, " "; print "zclass = ", $question->zclass, " "; Returns the record class. In dynamic update packets, this field is known as "zclass" and refers to the zone's class. print $question->print; Prints the question record on the standard output. string print $qr->string, " "; Returns a string representation of the question record. data $qdata = $question->data($packet, $offset); Returns the question record in binary format suitable for inclusion in a DNS packet. Arguments are a "Net::DNS::Packet" object and the offset within that packet's data where the "Net::DNS::Question" record is to be stored. This information is necessary for using compressed domain names. COPYRIGHT
Copyright (c) 1997-2002 Michael Fuhr. Portions Copyright (c) 2002-2004 Chris Reinhardt. Portions Copyright (c) 2003,2006-2009 Dick Franks. All rights reserved. This program is free software; you may redistribute it and/or modify it under the same terms as Perl itself. SEE ALSO
perl(1), Net::DNS, Net::DNS::Resolver, Net::DNS::Packet, Net::DNS::Update, Net::DNS::Header, Net::DNS::RR, RFC 1035 Section 4.1.2 perl v5.12.1 2009-12-30 Net::DNS::Question(3)