10-05-2013
Read URL data from UNIX without wget,curl,lynx,w3m.
Hi Experts,
Problem statement :
We have an URL for which we need to read the data and get parsed inside the shell scripts.
My Aix has very limited perl utility, i cant install any utility as well.
Precisely, wget,cURL,Lynx,w3m and Lwp cant be used as i got these utilities only when i googled it.
And also i found one solution in Unix.com itself in below thread
37182-url-call-shell-script-6
Since i dont have enough posts am not able to post the complete link sorry for that
but i have given the later part of the title that is , thread name.
and in that cfajohnson has mentioned about some bash scripting and of that only one link is accessible and other one is not accessible( 1st link).
Please dont think am dusting the old one's am really in need of that script. Please help me . Any help would be really appreciated.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi :)
How to use dump in lynx.
$ lynx -dump http://www.google.com
So, this is an example of a lynx dump:
txt1 blabla Other txt
some text
1. http://url_of_txt1
2. http://url_of_blabla
3. http://url_of_Other_txt
4. http://url_of_some_text
...
How can i obtain this output?
... (12 Replies)
Discussion started by: aspire
12 Replies
2. Shell Programming and Scripting
I all,
I wrote an script which starts a Weblogic server and waits until its loaded to deploy several apps. The way I checked was something like:
while ; do
wget --spider <URL>:<port>/console > /dev/null 2>&1
rc=$?
done
This works perfectly because it's an HTML site and when server is... (2 Replies)
Discussion started by: AlbertGM
2 Replies
3. Shell Programming and Scripting
We are trying to invoke a https service from our unix script using curl command. The service is not getting invoked because it is SSL configured. Bypassing certification (using curl –k) does not work.
curl -k https://site
curl -k -x IP:Port https://site
curl -k -x IP:443 https://id:pwd@site
... (0 Replies)
Discussion started by: dineshbabu01
0 Replies
4. Shell Programming and Scripting
Hi, for my own interest I want to scrape a lot of data off the Maple Story game rankings page.
The problem is, when I want to get the data at this page
maplestory(dot)nexon(dot)net/Rankings/OverallRanking.aspx?type=overall&s=&world=0&job=0&pageIndex=6
It gives me the data at this page
... (3 Replies)
Discussion started by: seagaia
3 Replies
5. Shell Programming and Scripting
Hello,
I am wondering does anyone know of a method using curl/wget or other where by I could specify the IP address of the server I wish to query for a website.
Something similar to editing /etc/hosts but that can be done directly from the command line. I have looked through the man pages... (4 Replies)
Discussion started by: colinireland
4 Replies
6. UNIX for Dummies Questions & Answers
Hi All,
I want to launch "ex: http://gmail.com" from the cmd window and validate the credentials with username and password, is it possible?
I have found something like this
"wget --http-user=USER' --http-password=PASSWORD http://gmail.com" am new to this and unable to find a solution, i... (0 Replies)
Discussion started by: harsha85
0 Replies
7. Shell Programming and Scripting
Hi Experts,
Problem statement :
We have an URL for which we need to read the data and get parsed inside the shell scripts.My Aix has very limited perl utility, i cant install any utility as well.
Precisely, wget,cURL,Lynx,w3m and Lwp cant be used as i got these utilities only when i googled it.... (12 Replies)
Discussion started by: scott_cog
12 Replies
8. Shell Programming and Scripting
Hi,
I need help in wget or curl command to invoke a REST client services.
This is the format i need to send request
wget -H "tokenId: F6" -H "Authorization: Basic <64 bit encoded username:password>" -H "https://example.com" -H "Accept: application/Json" -o download.xml... (1 Reply)
Discussion started by: zen01234
1 Replies
9. Shell Programming and Scripting
i'm using this command to post data to a remote host:
wget --post-data="My Data" http://<my-ip>:80 -O /dev/null -q
and
curl --data "My Data" http://<my-ip>:80
however, when i run the above, i see the following in my access log on the remote host:
Wget:
10.10.10.10 - - "POST /... (1 Reply)
Discussion started by: SkySmart
1 Replies
10. Web Development
What can I use instead of wget/curl when I need to log into websites that use javascript?
Wget and curl don't handle javascript. (6 Replies)
Discussion started by: locoroco
6 Replies
LEARN ABOUT REDHAT
qt2kdoc
QT2KDOC(1) KDOC Documentation System QT2KDOC(1)
NAME
qt2kdoc -- Generates cross-reference file suitable for use with KDOC from Qt Toolkit HTML documentation.
SYNOPSIS
qt2kdoc [-u URL] [-o <destdir>] [-z] <path to qt html>
DESCRIPTION
qt2kdoc generates a kdoc(1) cross-reference file from the classes.html file that is included with the Qt GUI Toolkit HTML documentation.
The resulting file can be used to cross-reference documentation generated with KDOC for other classes with the Qt HTML documentation.
OPTIONS
--url <url>, -u <url>
The URL by which the Qt documentation can be accessed. This will allow other libraries to link to the Qt documentation.
--outdir <path>, -o <path>
The directory where the generated index file will be written.
--compress, -z
Compress the generated index with gzip. KDOC can read these compressed index files.
EXAMPLES
qt2kdoc -u "http://www.mydomain/src/qthtml/"
$HOME/web/src/qthtml
ENVIRONMENT
KDOCLIBS
If set, it is used as the default output path. It is overridden by the --outdir option.
FILES
classes.html, functions.html
The files from which information about the Qt library is read. They are parsed by qt2kdoc.
qt.kdoc
A kdoc(1) cross-reference file that will be generated by qt2kdoc and can be used to link documentation generated by kdoc with the Qt
documentation.
SEE ALSO
This script is a utility for kdoc(1).
BUGS
Dependent on format of Qt documentation.
AUTHOR
Sirtaj S. Kang <taj@kde.org>, 1998.
2.0a54 2002-03-18 QT2KDOC(1)