Scripts to Interact with Webpages


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Scripts to Interact with Webpages
# 1  
Old 10-21-2011
Scripts to Interact with Webpages

Hi,

Is it possible to have a script to interact with webpages. I want to create a script that logs a user into a specific site, and is able to get/post information.

Would anyone give me instructions on how it's should be done, and where I can find information on starting it out.

I know how to create scripts on a website, and get them to accept all sorts of information, just wondering how I can do it with other sites.

Thanks
# 2  
Old 10-21-2011
Depends entirely on the website. Logging into some is straightforward. Logging into others involves the right user agent strings, javascript, and cookies.

See the manual page for wget, and --post-data in particular.
# 3  
Old 10-21-2011
Maybe this link: cURL - Tutorial helps you.

It uses another unix command called: cURL

I used it once to do something similar to what you want, but I cannot find it!

Hope it helps.
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Expect and interact

I am trying to log on to server as a normal user and then sudo to root. I am using below expect script. $ cat SC.orig expect <<EOF # | tee -a $LOGFILE spawn sshpass -p "mypassword" ssh -l myid nim expect "$" send "sudo su - root\n" expect "Password:" send "mypassword\n"; sleep 4... (3 Replies)
Discussion started by: sri243
3 Replies

2. Shell Programming and Scripting

Expect script - Interact help

Hi Guys, Further to my post yesterday I have got round the issue of not being able to use expect by using one of our unix machines to have the script running instead of the jumpbox itself. However my issue is I now have an extra bit it the script which is shh to the jumpbox which requires a ras... (1 Reply)
Discussion started by: mutley2202
1 Replies

3. UNIX for Dummies Questions & Answers

Methods of reducing latency with downloading webpages?

I've been wondering how I can reduce latency in downloading webpages. I've been pointed to network sockets (This guide in specific, beej's guide to network programming ) as some method to do so, but I can't figure out how to apply it in the way I need it. I am iterating through webpages like... (0 Replies)
Discussion started by: seagaia
0 Replies

4. Hardware

Use of SSD for serving webpages

I have seen research articles and forum postings that demonstrate that SSDs are poor at reading large files: the larger the file, the slower the SSD compared to traditional hard disk drives. The difference with hard disk drives becomes apparent at medium size files, say 20KB. Does this mean that... (2 Replies)
Discussion started by: figaro
2 Replies

5. UNIX for Dummies Questions & Answers

Hosting webpages(jspx) on Linux

Hi guys, I have developed a small website using jspx pages. Now i want to host the website to a server which is a linux machine. The linux machine which i m referring to is already hosting some web pages(jspx) through a web server Which is running at port 8888. My first question would be... (0 Replies)
Discussion started by: pinga123
0 Replies

6. Shell Programming and Scripting

AWK script to detect webpages from file

Hi guys I'm very new to unix and I have to create an awk script that detects webpage addresses from a file/webpage and outputs how many times each webpage was detected.e.g. if my file was: www.google.com www.facebook.com www.google.com the output should be: www.google.com x2... (2 Replies)
Discussion started by: ROFL
2 Replies

7. Shell Programming and Scripting

AWK script to detect webpages from file

Hi guys I'm very new to unix and I have to create an awk script that detects webpage addresses from a file/webpage and outputs how many times each webpage was detected.e.g. if my file was: (Note: The symbol " was added to stop them being created into links) "www.google.com"... (1 Reply)
Discussion started by: ROFL
1 Replies

8. UNIX for Dummies Questions & Answers

Threaded Discussions for Webpages

Dear All, I run a website for a non-profit. Does anyone know where I can get free or cheap software to run threaded discussions for our website? Our website is obviously running off a unix platform. Thanks (4 Replies)
Discussion started by: evertk
4 Replies
Login or Register to Ask a Question