Downloading info from website to database


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Downloading info from website to database
# 1  
Old 03-28-2008
Question Downloading info from website to database

Hi guys!

I created a database using mysql in bash now i would like to download weather info from the data.(temp, date and time)...and just store this in the database to display after every 3 hours or so...

i have tried to get the website using wget and now dont exactly now how to go from here

any ideas?

how to filter this info from the website??


i know i have to use crontab for the display but dont know how??
and to do a query to insert the data in the table

Last edited by vadharah; 03-28-2008 at 04:01 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Read info from api website and show retrieved data

good evening, i'm still new in scripting but i'm learning every day and i'm enjoying it. so i have api website (htt p://api.nobelprize.org/v1/prize.json), i want to make a script that allows me to give it two arguments like ./test.sh 2005 physics, 2000 is for the year and physics is category... (1 Reply)
Discussion started by: kalbsghir
1 Replies

2. Shell Programming and Scripting

Downloading jpgs from a gallery type website

Can someone explain what this does step by step? I found this script on stackoverflow and want to customize it for personal use in downloading jpg images from a website. # get all pages curl 'http://domain.com/id/' -o '#1.html' # get all images grep -oh... (3 Replies)
Discussion started by: workisnotfun
3 Replies

3. Shell Programming and Scripting

Wget error while downloading from https website

Hi, I would like to download a file from a https website. I don't have the file name as it changes every day. I am using the following command: wget --no-check-certificate -r -np --user=ABC --password=DEF -O temp.txt https://<website/directory> I am getting followin error in my... (9 Replies)
Discussion started by: pinnacle
9 Replies

4. Shell Programming and Scripting

CRON Job to copy database and replace existing database

I have a reseller account with hostgator, which means i have WHM and Cpanel. I have set up a staging environment for one of my wordpress installations (client website), which is essentially sitting at staging.domain.com (live site is at domain.com). The staging website is a complete copy of the... (1 Reply)
Discussion started by: nzrobert
1 Replies

5. Solaris

Can't create database after Oracle Database installation

I installed Oracle 10 software on Solaris 11 Express, everything was fine execpt I can't create database using dbca.rsp file. I populated file with following options. OPERATION_TYPE = "createDatabase" GDBNAME = "solaris_user.domain.com" SID = "solaris_user" TEMPLATENAME = "General... (0 Replies)
Discussion started by: solaris_user
0 Replies

6. Solaris

redirect solaris database from linux database..

hi.. i have a need .. my php runs on my linux redhat box with mysql.. i want my php code to refer another mysql database which is in solaris 10 x86... can u tell me the procedure .. how it can be done through php .. sorry am new to php... is it possible to redirect from linux mysql to... (7 Replies)
Discussion started by: senkerth
7 Replies

7. Windows & DOS: Issues & Discussions

Downloading a file from Website to a Windows Folder

Hi, Is it possible to download a file using Wget or some other command from a Windows machine? Say I want to download something from https server to C:\ABC\abc.xls Any ideas, Thanks. (4 Replies)
Discussion started by: dohko
4 Replies

8. UNIX for Advanced & Expert Users

extracting info from Unix database to construct a visual diagram

Ok heres the situation, We use Solaris 8 at work with Sybase for the db. I need to be able to easily create visual diagrams of some of our more complex systems. I've been using Visio which is such a manual process and takes a while. I was thinking maybe using Visio somehow in conjunction... (0 Replies)
Discussion started by: fusion99
0 Replies

9. Post Here to Contact Site Administrators and Moderators

Database Errors - Post Info Here to Help Debug - Thanks

Please post the 'Style" you are using and what activity you were doing if have received any database error recently. I'm not getting any errors, but they are in the log files. Thanks, Neo (0 Replies)
Discussion started by: Neo
0 Replies
Login or Register to Ask a Question
cleanup_digikamdb(1)													      cleanup_digikamdb(1)

NAME
cleanup_digikamdb - Cleanup the digiKam databases to reduce their sizes and increase access speed SYNOPSIS
cleanup_digikamdb [-t] [-T] [-p] [-h] OPTIONS
-t Include thumbnail databases. -T Only cleanup thumbnail databases. -p path Specify a different database path. If the specified path is invalid, the entry from the configuration file will be used. -h Show command line options. DESCRIPTION
cleanup_digikamdb will cleanup and optimize the digiKam database file. This will, in most cases, lead to a smaller database file size and an increased access speed, because unneeded elements are removed from the database and data is optimized. The program will make sure that no instance of digiKam is running, because it is more safe to have no database access during the optimiza- tion process. It then will read the digiKam configuration file and determine the database location. In a final step the database will be optimized by invoking the sqlite command 'VACUUM;' on it. If more then one database is found in this location, cleanup_digikamdb will op- timize every database found in this path and below. For further explanation, see the following description of the VACUUM command from the sqlite3 website: When an object (table, index, or trigger) is dropped from the database, it leaves behind empty space. This empty space will be reused the next time new information is added to the database. But in the meantime, the database file might be larger than strictly necessary. Also, frequent inserts, updates, and deletes can cause the information in the database to become fragmented - scrattered out all across the data- base file rather than clustered together in one place. The VACUUM command cleans the main database by copying its contents to a temporary database file and reloading the original database file from the copy. This eliminates free pages, aligns table data to be contiguous, and otherwise cleans up the database file structure. AUTHOR
cleanup_digikamdb was written by Andi Clemens <andi dot clemens at gmx dot net> cleanup_digikamdb 14 October 2009 cleanup_digikamdb(1)