02-16-2011
Possible to download web page's text to a file?
Hi,
Say there is a web page that contains just text only - that is, even the source code is just the text itself, nothing more. An example would be "http://mynasadata.larc.nasa.gov/docs/ocean_percent.txt"
Is there a UNIX command that would allow me to download this text and store it in a file? I tried using wget which works for any normal web page but doesn't work for this one.
Thanks!
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi all,
I am having an XML file.
And as per requirement I need to map fields of this file with various field of web page.
So how can I use wput command into it ?
Regards,
gander_ss (3 Replies)
Discussion started by: gander_ss
3 Replies
2. Shell Programming and Scripting
Hi,
I've been attempting to create a script that downloads web pages at random intervals to mimic typical user usage. However I'm struggling to link $url to the URL list and thus wget complains of a missing URL. Any ideas?
Thanks
#!/bin/sh
#URL List
url1="http://www.bbc.co.uk"... (14 Replies)
Discussion started by: shadyuk
14 Replies
3. Shell Programming and Scripting
I wrote a Bash script which checks to see if a text string exists on a web page and then sends me an email if it does (or does not e.g. "Out of stock"). I run it from my crontab, it's quite handy from time to time and I've been using it for a few years now.
The script uses wget to download an... (6 Replies)
Discussion started by: gencon
6 Replies
4. Shell Programming and Scripting
I've an HTML page where the pie chart is generated with google java code with the required input values in UNIX.
The HMTL page is generated in UNIX and then when it loads in browser, the code is interpreted thought internet and the pie chart is generated. This is done by the java code in the... (4 Replies)
Discussion started by: Amutha
4 Replies
5. UNIX for Dummies Questions & Answers
Hello,
Does anyone know of a way to list all files related to a single web page and then to download say 4 files at a time simultaneously until the entire web page has been downloaded successfully? I'm essentially trying to mimic a browser.
Thanks. (2 Replies)
Discussion started by: shadyuk
2 Replies
6. Shell Programming and Scripting
Hi I am try to use curl to send a static xml file using url encoding to a web page using post. This has to go through a particular port on our firewall as well. This is my first exposure to curl and am not having much success, so any help you can supply, or point me in the right direction would be... (1 Reply)
Discussion started by: Paul Walker
1 Replies
7. Shell Programming and Scripting
Hello.
I'm trying to create a web page which the presentation is as follows:
1 °) at the top of page an image
2 °) below the text
3 °) to complete a php function that returns information.
I tried different things but none work.
Script 1:
<!DOCTYPE html>
<html>
<head>
<style>
div {
... (5 Replies)
Discussion started by: jcdole
5 Replies
8. Shell Programming and Scripting
I need help to make a script for Ubuntu to OSCam that copy the text on this website that only contains "C: ip port randomUSERNAME password" and want to exclude the text "C:" and replace the rest with the old in my test.server file.
(line 22) device = ip,port
(line 23) user =... (6 Replies)
Discussion started by: baxarn
6 Replies
9. UNIX for Beginners Questions & Answers
Hello,
I'm new in the forum and really beginer, and also sorry form my bad english.
I use linux and want to create little program to download automaticaly some pdf (invoices) and put in a folder of my computer. I learn how to do and programme with ubuntu but the program will be implemented... (1 Reply)
Discussion started by: MarcelOrMittal
1 Replies
10. UNIX for Beginners Questions & Answers
Hello Everyone,
I have the following text file with the each field separated by newline
Text file
P
file1-en-us_US-20170718T150157Z.json
Wed 19 Jul 2017 06:10:13 AM EDT
P
file2-en-us_US-20170718T160150Z.json
Wed 19 Jul 2017 06:10:13 AM EDT
P
file3-en-us_US-20170718T163218Z.json
Wed... (9 Replies)
Discussion started by: nextStep
9 Replies
LEARN ABOUT DEBIAN
massagevendor
MASSAGEVENDOR(8) System Manager's Manual MASSAGEVENDOR(8)
NAME
massagevendor - convert the ethernet vendor codes master list to arpwatch format
SYNOPSIS
massagevendor vendorfile
DESCRIPTION
massagevendor is a program that converts a text file containing ethernet vendor codes into a format suitable for use by arpwatch(8) and
arpsnmp(8). The input vendorfile is a master text file containing vendor codes. The output is sent to stdout. Each line of the vendorfile
is expected to have a six digit hexadecimal vendor code followed by spaces followed by the name of the manufacturer.
All ethernet devices have a unique identifier which includes a vendor code specifying the manufacturer of the device. In normal operation
arpwatch(8) and arpsnmp(8) use the file ethercodes.dat to report this vendor code. massagevendor is used to generate the ethercodes.dat
file from text files containing these vendor codes.
Locations where an ethernet vendor codes master text file can be obtained are given below.
FILES
/usr/share/arpwatch - default location of the ethernet vendor list
ethercodes.dat - file containing the list of ethernet vendor codes
SEE ALSO
arpwatch(8), arpsnmp(8)
NOTES
Sources for ethernet vendor codes seen in the wild are
http://map-ne.com/Ethernet/vendor.html
ftp://ftp.cavebear.com/pub/Ethernet.txt
http://www.cavebear.com/CaveBear/Ethernet/vendor.html
Useful for comparison or completeness are the
ethernet vendor codes as assigned
by the IEEE which can be found at
http://standards.ieee.org/regauth/oui/oui.txt
BUGS
Please send bug reports to arpwatch@ee.lbl.gov.
AUTHORS
Craig Leres of the Lawrence Berkeley National Laboratory Network Research Group, University of California, Berkeley, CA.
The current version is available via anonymous ftp:
ftp://ftp.ee.lbl.gov/arpwatch.tar.gz
This manual page was contributed by Hugo Graumann.
MASSAGEVENDOR(8)