Grabbing data from a secured website


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Grabbing data from a secured website
# 1  
Old 02-07-2013
Grabbing data from a secured website

Hello there,
I am a beginner in Perl, and I have a challenging project:
I have to create a program that checks regularly on an online bank account for new operations, it should then feed a database keeping track of all the money going in and out.
Of course the login details of this online banking access are known.

Could you please share your thoughts with us here on how to do that?
Which libraries or CPAN modules should I look at?
I guess this program will vary very much depending on how the online bank account is built, but what are the main rules when you want to automatically grab data from a website protected with personal access codes?

Many thanks for your help and keep up the great work!
freddie50
# 2  
Old 02-07-2013
Well at a minimum I think your going to need cURL. I've tried something similar using php a few years back, but I would imagine that banking sites would be on a whole new level, they are likely to have all sorts of tricks to stop this type of thing.

I would personally be very scared of having any sort of automated script accessing my banking information, especially one coded by a Perl beginner.
This User Gave Thanks to Chubler_XL For This Post:
# 3  
Old 02-14-2013
Thank you for the advice,

I especially take good note of the piece on web banking and security!
Let's say now that I will only collect and use data from the manually downloaded XL spreadsheet from the internet banking.
What module would you use to extract this data from the XL bank statement?
Many thanks for your help and keep up the great work!
freddie50
# 4  
Old 02-14-2013
Do you mean MS Excel format? If so you'll need Spreadsheet-ParseExcel

But I'd advise trying to export the info in CSV or XML format if at all possible, as it would be far less difficult.
# 5  
Old 02-14-2013
Don't overlook the mobile m.sites for banks, where the dialog and pages are much simpler.

I think the PERL with GNU-Cash does this sort of thing already, and it is free.
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Read info from api website and show retrieved data

good evening, i'm still new in scripting but i'm learning every day and i'm enjoying it. so i have api website (htt p://api.nobelprize.org/v1/prize.json), i want to make a script that allows me to give it two arguments like ./test.sh 2005 physics, 2000 is for the year and physics is category... (1 Reply)
Discussion started by: kalbsghir
1 Replies

2. Shell Programming and Scripting

Grabbing data between 2 points in text file

I have a text file that shows the output of my solar inverters. I want to separate this into sections. overview , device 1 , device 2 , device 3. Each device has different number of lines. but they all have unique starting points. Overview starts with 6 #'s, Devices have 4#'s and their data starts... (6 Replies)
Discussion started by: Mikey
6 Replies

3. UNIX for Advanced & Expert Users

Accessing secured server using shell script

Hi, I was trying to connect secure server using SFTP, but end up in error. Im looking for a shell script which will connect my secured FTP server For EG: hostname = example.com username = fed password = pass port = 993 Destination = web Push some tar file into web folder which is in... (3 Replies)
Discussion started by: Paulwintech
3 Replies

4. Programming

Building app. to send data to website

Hi. I plan to build an application which takes text data from a user. It then sends this to a website, login required. The business case being this site contains many text fields, mostly redundant to user. My application would only prompt user for necessary text. What language, methods... (4 Replies)
Discussion started by: cic
4 Replies

5. Shell Programming and Scripting

Using Python to grab data from a website

Hello Everyone, I'm trying to write a python script that will go to the following website and grab all the data on the page. The page refreshes regularly and the number of flights is different. Untitled Document What I wanted to do was grab all the data (except for top three row containing... (5 Replies)
Discussion started by: jl487
5 Replies

6. Linux

Secured encrypted files via Linux

I need to encrypt a ".txt" file with password settings and it should decrypt the file automatoically when end user types correct password. Can some one help me on this. Thank you (3 Replies)
Discussion started by: rlmadhav
3 Replies

7. UNIX for Dummies Questions & Answers

Help grabbing data of a link

Hi folks; I have a temperature sensor that configured with an IP address so we can open a browser to see the temperatures in our 3 labs all showing in one screen. I'm trying to write a script to call this link then email me the results/output so i don't have to open a browser manually every... (3 Replies)
Discussion started by: Katkota
3 Replies

8. Shell Programming and Scripting

Store data from dynamic website table

hi everybody, Asking for something that I´m not sure if it´s possible to implement. I hope be clear enough. Well, my issue is that I´m looking how to copy or extract a particular table content of a website. I get the content from a external feed (Iframe format), the content is updated every... (1 Reply)
Discussion started by: cgkmal
1 Replies

9. Shell Programming and Scripting

Grabbing URL's from a website

Hi everyone, Need your help creating a script that downloads a website after entering the URL e.g. Google, and parses its contents for URL's and appends the output to a text file in this format: http://grabbed-url-from-downloaded-website.com/ http://another-url-from-downloaded-website.com/ ... (3 Replies)
Discussion started by: ogoy
3 Replies
Login or Register to Ask a Question