|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Read URL data from UNIX-CLI without Wget,CURL,w3m,LWP
Post 302860779 by scott_cog on Monday 7th of October 2013 07:51:40 AM
10-07-2013
Read URL data from UNIX-CLI without Wget,CURL,w3m,LWP
Hi Experts,
Problem statement :
We have an URL for which we need to read the data and get parsed inside the shell scripts.My Aix has very limited perl utility, i cant install any utility as well.
Precisely, wget,cURL,Lynx,w3m and Lwp cant be used as i got these utilities only when i googled it.
And also i found one solution in Unix.com itself in below thread
URL call from SHELL script
Since i dont have enough posts am not able to post the complete link sorry for that
but i have given the later part of the title that is , thread name.
and in that cfajohnson has mentioned about some bash scripting and of that only one link is accessible and other one is not accessible( 1st link).
Please dont think am dusting the old one's am really in need of that script. Please help me .
Even if we have any solution for this, would be greatly appreciated.
Any help would be really appreciated.
Problem statement :
We have an URL for which we need to read the data and get parsed inside the shell scripts.My Aix has very limited perl utility, i cant install any utility as well.
Precisely, wget,cURL,Lynx,w3m and Lwp cant be used as i got these utilities only when i googled it.
And also i found one solution in Unix.com itself in below thread
URL call from SHELL script
Since i dont have enough posts am not able to post the complete link sorry for that
but i have given the later part of the title that is , thread name.
and in that cfajohnson has mentioned about some bash scripting and of that only one link is accessible and other one is not accessible( 1st link).
Please dont think am dusting the old one's am really in need of that script. Please help me .
Even if we have any solution for this, would be greatly appreciated.
Any help would be really appreciated.
| Moderator's Comments: | ||
|
Last edited by bakunin; 10-07-2013 at 11:56 AM..
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I all,
I wrote an script which starts a Weblogic server and waits until its loaded to deploy several apps. The way I checked was something like:
while ; do
wget --spider <URL>:<port>/console > /dev/null 2>&1
rc=$?
done
This works perfectly because it's an HTML site and when server is... (2 Replies)
Discussion started by: AlbertGM
2 Replies
2. Shell Programming and Scripting
I need a proxy that would enable me to use cli curl/wget with another ip address.
How do I find a paid proxy server that supports curl/wget? (1 Reply)
Discussion started by: locoroco
1 Replies
3. Shell Programming and Scripting
I'm using a proxy service with an ip address and a port number.
How do I use the proxy with wget or cli curl? (1 Reply)
Discussion started by: locoroco
1 Replies
4. Shell Programming and Scripting
I have a script that uses cli curl, and it would be easier if it was possible to pass variables like this:
curl -c $cookie -d $data www.********.comThis doesn't work, instead I have to generate a string and use eval.
Is there another, easier way to pass variables to cli curl? (1 Reply)
Discussion started by: locoroco
1 Replies
5. Shell Programming and Scripting
Hello,
I am wondering does anyone know of a method using curl/wget or other where by I could specify the IP address of the server I wish to query for a website.
Something similar to editing /etc/hosts but that can be done directly from the command line. I have looked through the man pages... (4 Replies)
Discussion started by: colinireland
4 Replies
6. UNIX for Dummies Questions & Answers
Hi All,
I want to launch "ex: http://gmail.com" from the cmd window and validate the credentials with username and password, is it possible?
I have found something like this
"wget --http-user=USER' --http-password=PASSWORD http://gmail.com" am new to this and unable to find a solution, i... (0 Replies)
Discussion started by: harsha85
0 Replies
7. UNIX for Dummies Questions & Answers
Hi Experts,
Problem statement :
We have an URL for which we need to read the data and get parsed inside the shell scripts.
My Aix has very limited perl utility, i cant install any utility as well.
Precisely, wget,cURL,Lynx,w3m and Lwp cant be used as i got these utilities only when i googled... (0 Replies)
Discussion started by: scott_cog
0 Replies
8. Shell Programming and Scripting
Hi,
I need help in wget or curl command to invoke a REST client services.
This is the format i need to send request
wget -H "tokenId: F6" -H "Authorization: Basic <64 bit encoded username:password>" -H "https://example.com" -H "Accept: application/Json" -o download.xml... (1 Reply)
Discussion started by: zen01234
1 Replies
9. Shell Programming and Scripting
i'm using this command to post data to a remote host:
wget --post-data="My Data" http://<my-ip>:80 -O /dev/null -q
and
curl --data "My Data" http://<my-ip>:80
however, when i run the above, i see the following in my access log on the remote host:
Wget:
10.10.10.10 - - "POST /... (1 Reply)
Discussion started by: SkySmart
1 Replies
10. Web Development
What can I use instead of wget/curl when I need to log into websites that use javascript?
Wget and curl don't handle javascript. (6 Replies)
Discussion started by: locoroco
6 Replies
LEARN ABOUT SUNOS
script
script(1) User Commands script(1) NAME
script - make record of a terminal session SYNOPSIS
script [-a] [filename] DESCRIPTION
The script utility makes a record of everything printed on your screen. The record is written to filename. If no file name is given, the record is saved in the file typescript. See WARNINGS. The script command forks and creates a sub-shell, according to the value of $SHELL, and records the text from this session. The script ends when the forked shell exits or when Control-d is typed. OPTIONS
The following option is supported: -a Appends the session record to filename, rather than overwriting it. NOTES
script places everything that appears on the screen in filename, including prompts. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWcsu | +-----------------------------+-----------------------------+ |CSI |Enabled | +-----------------------------+-----------------------------+ SEE ALSO
attributes(5) WARNINGS
script can pose a security risk when used in directories that are writable by other users (for example, /tmp), especially when run by a privileged user, that is, root. Be sure that typescript is not a link before running script. SunOS 5.10 30 Jan 2004 script(1)