Shell Programming and Scripting

If that's an authorized access then you might potentially have web services with properly defined contracts for the APIs, which will give easier for accessing the link. Otherwise you will have to take the other route of using LWP, perl to access the page, scrape the contents, restructure the data.

perl and lwp

If you are saying about crawling and scraping the data from one source and providing a modified view in another source, you need to fetch the data and restructure.

Automatically updating can be dealt in two ways
1. When latency in update delay is accepted, you can configure a job that does the above and keep updating for every 'n' units of time.
2. When latency in updation has to be low latency or ~0 latency, then you need to have a listener that will listen to the changes in the source, receive them, reprocess as required and update the secondary source /destination.

Hope this gives some clarity!