09-11-2011
Save page source, including javascript
I need to get the source code of a webpage. I have tried to use wget and curl, but it doesn't show the necessary javascript part of the source. I don't have to execute it, only to view the source.
How do I do that?
8 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
I used flot to create a graph and I would like to be able to save/export the graph as an image. In firefox on windows you can just ctl rt-click and you have a save as image feature (which I can automate with js) but...I need this to work on a linux browser. On linux in firefox I can print preview... (11 Replies)
Discussion started by: vincaStar
11 Replies
2. Shell Programming and Scripting
I want to download a particular page from the internet and get the source code of the page in html format.
I want to parse the source code to find a specific parameters using grep command.
could someone tell me the linux command to download a specific page and parse the source code of it.
... (1 Reply)
Discussion started by: ahamed
1 Replies
3. Shell Programming and Scripting
Hi all,
How to:
Run a bash script, display on the screen and save all information in a file including error information.
For example:
I have a bash script called test.sh
now I want to run the test.sh and display the output on the screen and save the output including error info to a file.
... (1 Reply)
Discussion started by: Damon sine
1 Replies
4. Shell Programming and Scripting
is it possible to pass webpages to remove all tag style information, but leave the tag...
say I have
<h1 style='font-size: xxx; color: xxxxxx'>headline 1</h1>
i want to get
<h1>headline 1</h1>
BTW, i got an oneliner here to remove all tags:
sed -n '/^$/!{s/<*>//g;p;
Thanks a... (4 Replies)
Discussion started by: dtdt
4 Replies
5. Shell Programming and Scripting
Hi Friends,
I have a bunch of URLs.
Each URL will open up an abstract page.
But, the source contains a link to the main PDF article.
I am looking for a script to do the following task
1. Read input file with URLs.
2. Parse the source and grab all the lines that has the word 'PDF'.... (1 Reply)
Discussion started by: jacobs.smith
1 Replies
6. Shell Programming and Scripting
HI Guys,
I have one command which can open page and i want to save and exit from it.
pf@home> mozilla 181.131.193.10/g/report.txt
It will open one page now how can i save it.
Thanks (1 Reply)
Discussion started by: pareshkp
1 Replies
7. Shell Programming and Scripting
Hi All
I would like to get cars DB from this web site link removed , and I am trying to right script to go and parse the web page and save the data for each cars into a file, type of cars, mark, model, but when I look to the source page I found out that the first car type is preselected and the... (3 Replies)
Discussion started by: molwiko
3 Replies
8. Web Development
Where should I put my javascript source code in order to run it "locally" by file not by http?---not sure this "locally" is the appropriate word here.
My test is when my javascript code (test.js) is put in the site default folder as the test.html in /var/www/html both worked as expected with... (2 Replies)
Discussion started by: yifangt
2 Replies
LEARN ABOUT MOJAVE
curlopt_verbose
CURLOPT_VERBOSE(3) curl_easy_setopt options CURLOPT_VERBOSE(3)
NAME
CURLOPT_VERBOSE - set verbose mode on/off
SYNOPSIS
#include <curl/curl.h>
CURLcode curl_easy_setopt(CURL *handle, CURLOPT_VERBOSE, long onoff);
DESCRIPTION
Set the onoff parameter to 1 to make the library display a lot of verbose information about its operations on this handle. Very useful for
libcurl and/or protocol debugging and understanding. The verbose information will be sent to stderr, or the stream set with CUR-
LOPT_STDERR(3).
You hardly ever want this set in production use, you will almost always want this when you debug/report problems.
To also get all the protocol data sent and received, consider using the CURLOPT_DEBUGFUNCTION(3).
DEFAULT
0, meaning disabled.
PROTOCOLS
All
EXAMPLE
CURL *curl = curl_easy_init();
if(curl) {
curl_easy_setopt(curl, CURLOPT_URL, "http://example.com");
/* ask libcurl to show us the verbose output */
curl_easy_setopt(curl, CURLOPT_VERBOSE, 1L);
/* Perform the request */
curl_easy_perform(curl);
}
AVAILABILITY
Always
RETURN VALUE
Returns CURLE_OK
SEE ALSO
CURLOPT_STDERR(3), CURLOPT_DEBUGFUNCTION(3),
libcurl 7.54.0 February 03, 2016 CURLOPT_VERBOSE(3)