|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Reading URL using Mechanize and dump all the contents of the URL to a file
Post 302888400 by ctsgnb on Friday 14th of February 2014 05:43:59 AM
02-14-2014
Check the wget utility, i guess it does what you need ... without having to reinvent the wheel 
|
|
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi,
I have a file with a URL text written in it within double quotes e.g.
"http://abcd.xyz.com/mno/somefile.dtd"
I want the above text to get replaced by a single space character.
I tried
cat File1.txt | sed -e 's/("http)*(dtd")/ /g' > File2.txt
But it didnt work out. Can someone... (5 Replies)
Discussion started by: dsrookie
5 Replies
2. UNIX for Advanced & Expert Users
HI
Can you please help me,how to post a xml file from Unix to URL.
Basically,i want to map contents of my file at an url
Regards
Pooja (1 Reply)
Discussion started by: PoojaM
1 Replies
3. UNIX for Advanced & Expert Users
Hi all,
I need to write a unix script in which need to call a url.
Then need to pass parameters to that url.
please help.
Regards,
gander_ss (1 Reply)
Discussion started by: gander_ss
1 Replies
4. Shell Programming and Scripting
Hi all,
I need to write a unix script in which need to call a url.
Then need to pass parameters to that url.
please help.
Regards,
gander_ss (1 Reply)
Discussion started by: gander_ss
1 Replies
5. UNIX for Dummies Questions & Answers
Hello,
I need to redirect an existing URL, how can i do that?
There's a current web address to a GUI that I have to redirect to another webaddress. Does anyone know how to do this?
This is on Unix boxes Linux.
example:
https://m45.testing.address.net/host.php
make it so the... (3 Replies)
Discussion started by: SkySmart
3 Replies
6. Shell Programming and Scripting
Hi :)
How to use dump in lynx.
$ lynx -dump http://www.google.com
So, this is an example of a lynx dump:
txt1 blabla Other txt
some text
1. http://url_of_txt1
2. http://url_of_blabla
3. http://url_of_Other_txt
4. http://url_of_some_text
...
How can i obtain this output?
... (12 Replies)
Discussion started by: aspire
12 Replies
7. Web Development
I am trying to find a way to test some code, but I need to rewrite a specific URL only from a specific HTTP_HOST
The call goes out to
http://SUB.DOMAIN.COM/showAssignment/7bde10b45efdd7a97629ef2fe01f7303/jsmodule/Nevow.Athena
The ID in the middle is always random due to the cookie.
I... (5 Replies)
Discussion started by: EXT3FSCK
5 Replies
8. Shell Programming and Scripting
HI,
I have a URL that points to a file:
LINK= "http://www.webpage.org/project/team2/file.tar"
However when I try to use wget on this variable I receive the following error.
wget $LINK
line 4: http://www.webpage.org/project/team2/file.tar: No such file or directory
wget:... (1 Reply)
Discussion started by: bashnewbee
1 Replies
9. UNIX for Dummies Questions & Answers
Here is what I have so far:
find . -name "*php*" -or -name "*htm*" | xargs grep -i iframe | awk -F'"' '/<iframe*/{gsub(/.\*iframe>/,"\"");print $2}'
Here is an example content of a PHP or HTM(HTML) file:
<iframe src="http://ADDRESS_1/?click=5BBB08\" width=1 height=1... (18 Replies)
Discussion started by: striker4o
18 Replies
10. Shell Programming and Scripting
Hello Everyone,
I am trying to write a shell script(or Perl Script) that would do the following:
I have a file that contains the following lines:
File:
https://ims-svnus.com/dev/DB/trunk/feeds/templates/shell_script.txt -r860... (5 Replies)
Discussion started by: filter
5 Replies
LEARN ABOUT DEBIAN
guess-helper
guess-helper(8) NVRAM WakeUp guess-helper(8) NAME
guess-helper - Tries to guess the configuration by comparing four dumps of the NVRAM. SYNOPSIS
guess-helper DESCRIPTION
guess-helper is a helper program from the package nvram-wakeup. It will guide you through the procedure of creating the files needed for the program guess and eventually will run guess at the end. The output will be a configuration file which might even work ;-) Don't change any other BIOS settings you are not told to change until the procedure is finished. See README.mb for more details. SEE ALSO
nvram-wakeup(8), guess(8), README.mb HOMEPAGE
http://sf.net/projects/nvram-wakeup/ AUTHOR
Written by Sergei Haller <Sergei.Haller@math.uni-giessen.de>. REPORTING BUGS
Report bugs at the bug tracking system (see HOMEPAGE) or on the mailing list nvram-wakeup-devel@lists.sourceforge.net COPYRIGHT
Copyright (C) 2001-2004 Sergei Haller. This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MER- CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA Linux Jul 07 2004 guess-helper(8)