mysqldump slowing down the process?

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need Help with automatically Import from special mysqldump

Hi @ all I need a little bit help with a tricky problem ... Here�s the situation: We�ve 2 MySQL-Servers, one is productive, the other is Backup. At the productive Server there runs every 2 hours a cron Job which does a Dump from MySQL-DB with script 'automysqlbackup.sh' and copy it then...

2. UNIX for Advanced & Expert Users

awk slowing down -- why?

I have an awk script that extracts data from log files and generates a report. The script is incrementing elements in arrays, summing fields depending on contents of other fields, and then in END performing some operations on those arrays. It seemed to be taking longer than it should on my...

3. Shell Programming and Scripting

Mysqldump rotate backup

I have a very simple script that uses a cron job to take a daily backup of our orders database. echo "Dumping ORDERS database"; mysqldump -u root --password='mypassword' -h '1.1.1.1' --opt --compress ORDERS $tbl_names > /Volumes/Files_Backup_1/db_backups/orders.sql echo "Copied database to...

4. Shell Programming and Scripting

Expect slowing down / missing characters

Im writing an expect program to connect to cisco routers and run commands. my commands file has only two entries show version show running-config when I run the script, the first command is run without a problem. The second command isn't. The "s" is missing at the device command line,...

5. UNIX for Dummies Questions & Answers

Mysqldump certain tables

Hi, I have to upload part of my database periodically when i make changes to product data etc. However I only want to upload certain tables. We suffer from bandwidth chock here, so i want to write a couple of separate scripts that upload parts of the database that changed. The database is large...

6. UNIX for Dummies Questions & Answers

Sendmail process "Toomany" system slowing down

Hello Experts I have M4000 Solaris 10 server, from few many days there are too many sendmail and mail.local process starting on server and each time i need to kill mannualy using pkill send mail, some time there will 600 of them taking 30mb memory for each and hence slowing down the server,...

7. UNIX for Dummies Questions & Answers

Problem with my crontab file, using mysqldump

My crontab file tells cron to run a certain shell script at 10:30 AM every day. The shell script backs up my database with mysqldump and then runs a sed script that does some editing of the backup file. I have programmed the shell script to write an error message to a file I have in my home...

8. Shell Programming and Scripting

Help needed for mysqldump command

I want to take a backup of a database and redirect the output of the whole process to a log file. I am using the below command: mysqldump -A --add-drop-table > mysql-daily-backup.sql &> /tmp/backup_log/mysql.log Is there anything wrong with the syntax? ---------- Post updated at 08:32 PM...

9. Shell Programming and Scripting

mysqldump script without hardcode password

OS: Linux ambglx02 2.6.16.60-0.21-default #1 Tue May 6 12:41:02 UTC 2008 i686 i686 i386 GNU/Linux Shell: bash Currently I have a mysqldump script to backup my mysql database, the command is as below: /opt/novell/mysql/bin/mysqldump --add-drop-table -u root -p -h mydb > /home/john/mydb.sql ...

LEARN ABOUT DEBIAN

mydumper

MYDUMPER(1)							     mydumper							       MYDUMPER(1)

NAME

       mydumper - multi-threaded MySQL dumping

SYNOPSIS

       mydumper [OPTIONS]

DESCRIPTION

       mydumper  is a tool used for backing up MySQL database servers much faster than the mysqldump tool distributed with MySQL.  It also has the
       capability to retrieve the binary logs from the remote server at the same time as the dump itself.  The advantages of mydumper are:

	  o Parallelism (hence, speed) and performance (avoids expensive character set conversion routines, efficient code overall)

	  o Easier to manage output (separate files for tables, dump metadata, etc, easy to view/parse data)

	  o Consistency - maintains snapshot across all threads, provides accurate master and slave log positions, etc

	  o Manageability - supports PCRE for specifying database and tables inclusions and exclusions

OPTIONS

       The mydumper tool has several available options:

       --help Show help text

       --host, -h
	      Hostname of MySQL server to connect to (default localhost)

       --user, -u
	      MySQL username with the correct privileges to execute the dump

       --password, -p
	      The corresponding password for the MySQL user

       --port, -P
	      The port for the MySQL connection.

       Note   For localhost TCP connections use 127.0.0.1 for --host.

       --socket, -S
	      The UNIX domain socket file to use for the connection

       --database, -B
	      Database to dump

       --table-list, -T
	      A comma separated list of tables to dump

       --threads, -t
	      The number of threads to use for dumping data, default is 4

       Note   Other threads are used in mydumper, this option does not control these

       --outputdir, -o
	      Output directory name, default is export-YYYYMMDD-HHMMSS

       --statement-size, -s
	      The maximum size for an insert statement before breaking into a new statement, default 1,000,000 bytes

       --rows, -r
	      Split table into chunks of this many rows, default unlimited

       --compress, -c
	      Compress the output files

       --compress-input, -C
	      Use client protocol compression for connections to the MySQL server

       --build-empty-files, -e
	      Create empty dump files if there is no data to dump

       --regex, -x
	      A regular expression to match against database and table

       --ignore-engines, -i
	      Comma separated list of storage engines to ignore

       --no-schemas, -m
	      Do not dump schemas with the data

       --long-query-guard, -l
	      Timeout for long query execution in seconds, default 60

       --kill-long-queries, -k
	      Kill long running queries instead of aborting the dump

       --version, -V
	      Show the program version and exit

       --verbose, -v
	      The verbosity of messages.  0 = silent, 1 = errors, 2 = warnings, 3 = info.  Default is 2.

       --binlogs, -b
	      Get the binlogs from the server as well as the dump files

       --daemon, -D
	      Enable daemon mode

       --snapshot-interval, -I
	      Interval between each dump snapshot (in minutes), requires --daemon, default 60 (minutes)

       --logfile, -L
	      A file to log mydumper output to instead of console output.  Useful for daemon mode.

       --no-locks, -k
	      Do not execute the temporary shared read lock.

       Warning
	      This will cause inconsistent backups.

AUTHOR

       Andrew Hutchings

COPYRIGHT

       2011, Andrew Hutchings

0.5.1								   June 09, 2012						       MYDUMPER(1)

UNIX for Advanced & Expert Users