MySQL Database Analytics with InfiniDB from Calpont – Part

 
Thread Tools Search this Thread
Top Forums Web Development MySQL DevZone RSS MySQL Database Analytics with InfiniDB from Calpont – Part
# 1  
Old 10-27-2009
MySQL Database Analytics with InfiniDB from Calpont – Part

Let's be honest: working with big databases is a lot of fun. There's something cool about dealing with tables that have hundreds of millions or billions of rows in them, loading huge amounts of data, building star and snowflake schemas for data warehouses/marts, optimizing query performance, and all that jazz. Yes, working with big databases is a lot of fun.On the other hand, let's be honest: working with big databases is not a lot of fun. There's a lot of pain in dealing with tables that have hundreds of millions or billions of rows in them, waiting for huge amounts of data to be loaded only to have the load job toss its cookies and fail when it's 99% done, building special schemas that you wonder whether make any difference at all, and trying to figure out why just a simple two-way join query has been hanging for over an hour. Yes, working with big databases is not a lot of fun.

More...
Login or Register to Ask a Question

Previous Thread | Next Thread

5 More Discussions You Might Find Interesting

1. Programming

Need help on Insert data to mySQL database

Hi guys, I would like to seek help on inserting data whenever the switch is on or off to my sensor mySQL database in phpMyAdmin from my control.php. I'm using Raspberry PI as my hardware and follow a few tutorials to create my own Web Control Interface, it works perfectly without insert method.... (1 Reply)
Discussion started by: aoiregion
1 Replies

2. Programming

Mailx recipient from mysql database

Dear All, Can I make Mailx to read recipient address from a mysql database? I already tried emailing with bash script: SUBJECT="TEST" export EMAIL_ADDRESS=`mysql -uroot -pabcde smsd -e "SELECT email FROM recipient"` mysql -uroot -pabcde smsd -e "SELECT ID, SenderName, Body FROM inbox" |... (2 Replies)
Discussion started by: jazzyzha
2 Replies

3. UNIX for Dummies Questions & Answers

SSH import mysql database

Hi all, I am trying to import a database in putty with the syntax: mysql –u database_username –p database_name < filename.mysql As you can see in the screenshot it asks me for the database password - which suggests that the syntax is correct - but then after I enter the password it gives... (2 Replies)
Discussion started by: Juc1
2 Replies

4. Web Development

Updating Records in Mysql Database

so when i issue a command like the below: # mysql --pager=/usr/bin/less -u cactiman -p -e 'select * from data_input' cacti Enter password: ... (2 Replies)
Discussion started by: SkySmart
2 Replies

5. Shell Programming and Scripting

How to backup a particular Database in MYSQL?

Hi All, Thanks in Advance!! How to backup a particular Databases..through Bash script!! For example i have 6 databases; Anish linux Software Questions Rhce Google these are the databases i have from that i want to take "Anish" and "questions" database backup regularly.... (4 Replies)
Discussion started by: anishkumarv
4 Replies
Login or Register to Ask a Question
MYDUMPER(1)							     mydumper							       MYDUMPER(1)

NAME
mydumper - multi-threaded MySQL dumping SYNOPSIS
mydumper [OPTIONS] DESCRIPTION
mydumper is a tool used for backing up MySQL database servers much faster than the mysqldump tool distributed with MySQL. It also has the capability to retrieve the binary logs from the remote server at the same time as the dump itself. The advantages of mydumper are: o Parallelism (hence, speed) and performance (avoids expensive character set conversion routines, efficient code overall) o Easier to manage output (separate files for tables, dump metadata, etc, easy to view/parse data) o Consistency - maintains snapshot across all threads, provides accurate master and slave log positions, etc o Manageability - supports PCRE for specifying database and tables inclusions and exclusions OPTIONS
The mydumper tool has several available options: --help Show help text --host, -h Hostname of MySQL server to connect to (default localhost) --user, -u MySQL username with the correct privileges to execute the dump --password, -p The corresponding password for the MySQL user --port, -P The port for the MySQL connection. Note For localhost TCP connections use 127.0.0.1 for --host. --socket, -S The UNIX domain socket file to use for the connection --database, -B Database to dump --table-list, -T A comma separated list of tables to dump --threads, -t The number of threads to use for dumping data, default is 4 Note Other threads are used in mydumper, this option does not control these --outputdir, -o Output directory name, default is export-YYYYMMDD-HHMMSS --statement-size, -s The maximum size for an insert statement before breaking into a new statement, default 1,000,000 bytes --rows, -r Split table into chunks of this many rows, default unlimited --compress, -c Compress the output files --compress-input, -C Use client protocol compression for connections to the MySQL server --build-empty-files, -e Create empty dump files if there is no data to dump --regex, -x A regular expression to match against database and table --ignore-engines, -i Comma separated list of storage engines to ignore --no-schemas, -m Do not dump schemas with the data --long-query-guard, -l Timeout for long query execution in seconds, default 60 --kill-long-queries, -k Kill long running queries instead of aborting the dump --version, -V Show the program version and exit --verbose, -v The verbosity of messages. 0 = silent, 1 = errors, 2 = warnings, 3 = info. Default is 2. --binlogs, -b Get the binlogs from the server as well as the dump files --daemon, -D Enable daemon mode --snapshot-interval, -I Interval between each dump snapshot (in minutes), requires --daemon, default 60 (minutes) --logfile, -L A file to log mydumper output to instead of console output. Useful for daemon mode. --no-locks, -k Do not execute the temporary shared read lock. Warning This will cause inconsistent backups. AUTHOR
Andrew Hutchings COPYRIGHT
2011, Andrew Hutchings 0.5.1 June 09, 2012 MYDUMPER(1)