wget returns different data from web browsers


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting wget returns different data from web browsers
# 1  
Old 05-12-2010
wget returns different data from web browsers

I am facing a strange issue with wget.
I am not able to get the same data that I can get from my firefox web browser. I tried setting the user agent to firefox but i am still not able to get the same data.. Hope anyone can help point me to the correct direction.


This is the command i used :
Code:
wget -O 2387 -U 'Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.3) Gecko/20100423 Ubuntu/10.04 (lucid) Firefox/3.6.3'  http://www.singaporepools.com.sg/Lottery?page=toto_past&drawNo=2387

PS: I am trying to make a program to automatically get the lottery data....

---------- Post updated 05-13-10 at 12:19 AM ---------- Previous update was 05-12-10 at 11:49 PM ----------

I managed to find the answer. I should have used the post data option....
This is the working version...

Code:
wget -O 2387 --post-data="page=toto_past&drawNo=2387"  http://www.singaporepools.com.sg/Lottery

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. What is on Your Mind?

Instructions to Clear Data Cache in Safari, Chrome, Firefox, Opera Browsers (Pictures)

Here are instructions to clear the data cache for four browsers, Safari, Chrome, Firefox, Opera. In these examples I'm using MacOS Mojave, but it should be similar for any OS. You can use these instructions to to clear and reload the cache if you have any issues with the Vue.js UserCP (current... (1 Reply)
Discussion started by: Neo
1 Replies

2. Shell Programming and Scripting

Wget and curl to post data

i'm using this command to post data to a remote host: wget --post-data="My Data" http://<my-ip>:80 -O /dev/null -q and curl --data "My Data" http://<my-ip>:80 however, when i run the above, i see the following in my access log on the remote host: Wget: 10.10.10.10 - - "POST /... (1 Reply)
Discussion started by: SkySmart
1 Replies

3. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies

4. Shell Programming and Scripting

Read URL data from UNIX-CLI without Wget,CURL,w3m,LWP

Hi Experts, Problem statement : We have an URL for which we need to read the data and get parsed inside the shell scripts.My Aix has very limited perl utility, i cant install any utility as well. Precisely, wget,cURL,Lynx,w3m and Lwp cant be used as i got these utilities only when i googled it.... (12 Replies)
Discussion started by: scott_cog
12 Replies

5. UNIX for Dummies Questions & Answers

Read URL data from UNIX without wget,curl,lynx,w3m.

Hi Experts, Problem statement : We have an URL for which we need to read the data and get parsed inside the shell scripts. My Aix has very limited perl utility, i cant install any utility as well. Precisely, wget,cURL,Lynx,w3m and Lwp cant be used as i got these utilities only when i googled... (0 Replies)
Discussion started by: scott_cog
0 Replies

6. Shell Programming and Scripting

Random web page download wget script

Hi, I've been attempting to create a script that downloads web pages at random intervals to mimic typical user usage. However I'm struggling to link $url to the URL list and thus wget complains of a missing URL. Any ideas? Thanks #!/bin/sh #URL List url1="http://www.bbc.co.uk"... (14 Replies)
Discussion started by: shadyuk
14 Replies

7. Shell Programming and Scripting

How to close the Web browsers in Shell Script?

Hi, Is there anyway to close all the Open tabs in Web Browser via Shell Script. Like browser.close( ) or something like that. Pls do help me soon, Thanks in Advance :) (1 Reply)
Discussion started by: Megala
1 Replies

8. Solaris

Web Browsers

How and what other web browsers can I install for Solaris 11 86_64? (1 Reply)
Discussion started by: Fingerz
1 Replies

9. Shell Programming and Scripting

dispalying the data on a web address

Hi Team, My requirement is to get the details from a file or DB (sources) and post it on a web address from where users can see latest data. Please help me in following : 1. How to create a web address that could be shared to multiple users. 2. How to post the this data on that web address... (5 Replies)
Discussion started by: sanjaydubey2006
5 Replies

10. UNIX for Dummies Questions & Answers

browsers

hello all, to see what browsers exist on solaris server what is the path and then how can i acces the internet? i appreciate your help. thanks, grep (4 Replies)
Discussion started by: grep
4 Replies
Login or Register to Ask a Question
GIT-WEB--BROWSE(1)						    Git Manual							GIT-WEB--BROWSE(1)

NAME
git-web--browse - Git helper script to launch a web browser SYNOPSIS
git web--browse [OPTIONS] URL/FILE ... DESCRIPTION
This script tries, as much as possible, to display the URLs and FILEs that are passed as arguments, as HTML pages in new tabs on an already opened web browser. The following browsers (or commands) are currently supported: o firefox (this is the default under X Window when not using KDE) o iceweasel o seamonkey o iceape o chromium (also supported as chromium-browser) o google-chrome (also supported as chrome) o konqueror (this is the default under KDE, see Note about konqueror below) o opera o w3m (this is the default outside graphical environments) o elinks o links o lynx o dillo o open (this is the default under Mac OS X GUI) o start (this is the default under MinGW) o cygstart (this is the default under Cygwin) o xdg-open Custom commands may also be specified. OPTIONS
-b <browser>, --browser=<browser> Use the specified browser. It must be in the list of supported browsers. -t <browser>, --tool=<browser> Same as above. -c <conf.var>, --config=<conf.var> CONF.VAR is looked up in the Git config files. If it's set, then its value specifies the browser that should be used. CONFIGURATION VARIABLES
CONF.VAR (from -c option) and web.browser The web browser can be specified using a configuration variable passed with the -c (or --config) command line option, or the web.browser configuration variable if the former is not used. browser.<tool>.path You can explicitly provide a full path to your preferred browser by setting the configuration variable browser.<tool>.path. For example, you can configure the absolute path to firefox by setting browser.firefox.path. Otherwise, git web--browse assumes the tool is available in PATH. browser.<tool>.cmd When the browser, specified by options or configuration variables, is not among the supported ones, then the corresponding browser.<tool>.cmd configuration variable will be looked up. If this variable exists then git web--browse will treat the specified tool as a custom command and will use a shell eval to run the command with the URLs passed as arguments. NOTE ABOUT KONQUEROR
When konqueror is specified by a command line option or a configuration variable, we launch kfmclient to try to open the HTML man page on an already opened konqueror in a new tab if possible. For consistency, we also try such a trick if browser.konqueror.path is set to something like A_PATH_TO/konqueror. That means we will try to launch A_PATH_TO/kfmclient instead. If you really want to use konqueror, then you can use something like the following: [web] browser = konq [browser "konq"] cmd = A_PATH_TO/konqueror Note about git-config --global Note that these configuration variables should probably be set using the --global flag, for example like this: $ git config --global web.browser firefox as they are probably more user specific than repository specific. See git-config(1) for more information about this. GIT
Part of the git(1) suite Git 1.8.5.3 01/14/2014 GIT-WEB--BROWSE(1)