Dump web page source as rendered by browser Post: 302960855

Sponsored Content

Top Forums Shell Programming and Scripting Dump web page source as rendered by browser Post 302960855 by Marmz on Friday 20th of November 2015 09:16:57 AM

11-20-2015

Registered User

Dump web page source as rendered by browser

Hi guys|

I need to retrieve a specific .m3u8 link from a web page, which makes use of iframes and JavaScript

I tried to get the full source with "wget", "lynx", "w3m" and "phantomjs", but they can't dump all the source, with the part containing the link that i need, which seems to be inside an iframe..

Also the browser "QT web", which has an option to dump to stdout everything it renders of a page, can't output all the source i need...

I tried to "wget" that specific iframe but it's not accessible, if not from the site itself (i get a "forbidden" message Smilie

)

Only with the function “inspect element“ in Chrome (right-clicking the area where the stream is loaded) i can see that part of the code (and the.m3u8 link too! Smilie

)...
If i use the "Save page" option, instead, that code is missing..

I was wondering if maybe the same Chrome (or something similar) has an option that, from the command line, allows you to write everything it renders as a “dump“.

Sice that part of the source is accessible with “inspect element“, i can't believe there's no way to get it to console stdout (or to a dump fle).

Thanks in advance to all of you.. maybe this discussion could be useful for other users Smilie

[EDIT]
I hope this is the right forum section for my question ..

Last edited by Marmz; 11-20-2015 at 10:24 AM..

Marmz

View Public Profile for Marmz

Find all posts by Marmz

8 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Web browser and web server for Unix

Hi there all I am looking for both a web browser as well as a web server (Ie. Netscape Fasttrack) that will run on HPUX 10. If you know where I can get these free via FTP, please contact me as soon as possible!! Thanks, Mark

2. UNIX for Dummies Questions & Answers

Which comand to show the source code on a web page?

Hi folks! I am using MacOsX that runs freeBSD. Could you tell me what comand to type on the Unix Terminal to display on the terminal the source code of a certain web page? I think something like #<comand> http://www.apple.com will display on the terminal's window the html source code...

3. UNIX for Dummies Questions & Answers

reading web page source in unix

is there a command that allows you to take a url and grab the source code from the page and output it to stdout? i want to know because i want to grab a page and pass it thru another program to analyze the page. any help would be appreciated thanks

4. Programming

Need simple web browser source code

Hello dear...i'm need web browser source code just the simple web browser..for my development site porn detected..thanks,,,

5. Solaris

Web browser not opening

On clicking on my WEB BROWSER . no window is appearing , only a dialog box appearing with named "ALERT" any nothing else. What is browser package name , which is by default in Solaris 10

6. Shell Programming and Scripting

web page source cleanup

is it possible to pass webpages to remove all tag style information, but leave the tag... say I have <h1 style='font-size: xxx; color: xxxxxx'>headline 1</h1> i want to get <h1>headline 1</h1> BTW, i got an oneliner here to remove all tags: sed -n '/^$/!{s/<*>//g;p; Thanks a...

7. Shell Programming and Scripting

Performing extractions on web source page

I have downloaded a web source page to a file. I then egrep a single word to extract a line containing it to another file. I then cat the second file and remove everything before a word and after a second word to capture the phrase desired. This did not work. I used vi to validate that the 2...

8. Web Development

What is Your Favorite Web Browser?

OK, please vote on your favorite web browser and comment why! Only currently supported browers please! Thanks. PS: I am a big FireFox fan. FireFox add-ons rock!

LEARN ABOUT DEBIAN

pspp-dump-sav

pspp-dump-sav(1)						    PSPP Manual 						  pspp-dump-sav(1)

NAME

       pspp-dump-sav - dissect SPSS system file

SYNOPSIS

       pspp-dump-sav [-d | --data[=maxcases]] file...
       pspp-dump-sav --help | -h
       pspp-dump-sav --version | -v

DESCRIPTION

       The  pspp-dump-sav program reads each SPSS system file file and prints its contents.  The output format is useful for debugging system file
       readers and writers and for discovering how to interpret unknown or poorly understood records.  End users may find the  output  useful  for
       providing the PSPP developers information about system files that PSPP does not accurately read.

OPTIONS

       -d[maxcases]
       --data[=maxcases]
	      By  default, pspp-dump-sav does not print any of the data in a system file, only the file headers.  Specify this option to print the
	      data as well.  If maxcases is specified, then it limits the number of cases printed.

       -h
       --help Prints a usage message on stdout and exits.

       -v
       --version
	      Prints version information on stdout and exits.

BUGS

       Some errors that prevent files from being interpreted successfully cause pspp-dump-sav to exit without reading any additional  files  given
       on the command line.

AUTHORS

       Ben Pfaff and John Darrington.

SEE ALSO

       pspp(1), psppire(1).

PSPP
								   January 2012 						  pspp-dump-sav(1)