10-01-2009
1. Multithreading means "you must be stupid to do this in shell"
2. Loading 1 huge set of data at once is in general faster than loading dzylion of microsets in parallel
3. In Oracle you have SQLLoader and it has mode called "direct" - check if you cannot use similar thing in MySQL (I have no experience in MySQL)
4. If there is no option of direct loading of the data you might want to use bulk load methods
5. Loading in multiple threads means that you most probably are going to create dzylion of connections... if creation and closing of a single connection takes 1 second and inserting 1 row of data takes 0.0000000001 of a second... imagine how much slower would it work if you create multiple threads
6. Transaction is your friend - until you commit your application (executable compiled application) should be able to insert rows with only a minor performance decrease - if this is really really required by you then you might assume that there is a probable chance that you might need to create an application that loads row-by-row and commits the changes afterward.... really no bulk methods? I was thinking that MySQL is a developed database but it is not if there are no bulk operations.
9 More Discussions You Might Find Interesting
1. Programming
:confused:
Hi!
I have created a Multhreaded Application in Pro*C (using pthreads) with about 5 Threads running simultaneously. The Application is basically to Update a Centralized Table in Oracle, which updates different rows in the Table (Each Thread updates different rows!). The... (16 Replies)
Discussion started by: shaik786
16 Replies
2. Programming
Hi all, I have a query about multithreading. What I would like to do is, at the start of my main update() function, start a couple of threads in parallel, once they are all complete carry on with my main update function.
void update() {
thread1->update(); // fluid solver
... (3 Replies)
Discussion started by: memoid
3 Replies
3. UNIX for Advanced & Expert Users
Hi,
Can you please give me a suitable reference to learn multithreading programming in C in UNIX?
Thanks (3 Replies)
Discussion started by: naan
3 Replies
4. Programming
Situation:
i have multiple pthread_create calls like this:
pthread_create(...., ThreadFunc1,.....);
pthread_create(...., ThreadFunc2,.....);
.
.
which i am using to create multiple threads.All the "ThreadFunc<i>" functions are actually calling same function "Receive" of a class using same... (3 Replies)
Discussion started by: Sastra
3 Replies
5. IP Networking
hello to all
i want to use multithreading to my UDP broadcast server client program. will anyone help me by proving C code. i am working in fedora. also my requirement is POSIX compliance.please help me..... (0 Replies)
Discussion started by: moti12
0 Replies
6. Programming
hello to all
i want to use multithreading to my UDP broadcast server client program. will anyone help me by proving C code. i am working in fedora. also my requirement is POSIX compliance.please help me..... (6 Replies)
Discussion started by: moti12
6 Replies
7. Programming
Dear all,
I am having a huge XML file, as below structure
<EMPLOYEE>
<RECORD id =aaa>
<Salary>99999</Salary>
<section>ssss</section>
</RECORD>
<RECORD id =bbb>
<Salary>77777</Salary>
<section>ssss</section>
</RECORD>
</EMPLOYEE>
This is a 50 GB file I want to read this file in... (9 Replies)
Discussion started by: arunkumar_mca
9 Replies
8. What is on Your Mind?
Hi Friends
any know how became a friend in this Android Programming Language (0 Replies)
Discussion started by: ljarun
0 Replies
9. Programming
I take this question of the The Linux Programming Interface: A Linux and Unix System Programming page 652 exercise 30.1
I want someone to explain the under line statement because it sounds complex to me couldn't understand anything
30-1 Modify the program (thread_incr.c) so that each loop in... (3 Replies)
Discussion started by: fwrlfo
3 Replies
LEARN ABOUT DEBIAN
apache::session::store::mysql
Apache::Session::Store::MySQL(3pm) User Contributed Perl Documentation Apache::Session::Store::MySQL(3pm)
NAME
Apache::Session::Store::MySQL - Store persistent data in a MySQL database
SYNOPSIS
use Apache::Session::Store::MySQL;
my $store = new Apache::Session::Store::MySQL;
$store->insert($ref);
$store->update($ref);
$store->materialize($ref);
$store->remove($ref);
DESCRIPTION
Apache::Session::Store::MySQL fulfills the storage interface of Apache::Session. Session data is stored in a MySQL database.
SCHEMA
To use this module, you will need at least these columns in a table called 'sessions', or another table name if you provide the TableName
argument:
id char(32) # or however long your session IDs are.
a_session text
To create this schema, you can execute this command using the mysql program:
CREATE TABLE sessions (
id char(32) not null primary key,
a_session text
);
If you use some other command, ensure that there is a unique index on the table's id column.
CONFIGURATION
The module must know what datasource, username, and password to use when connecting to the database. These values can be set using the
options hash (see Apache::Session documentation). The options are:
DataSource
UserName
Password
TableName
Handle
Example:
tie %hash, 'Apache::Session::MySQL', $id, {
DataSource => 'dbi:mysql:database',
UserName => 'database_user',
Password => 'K00l',
TableName => 'sessions'
};
Instead, you may pass in an already-opened DBI handle to your database.
tie %hash, 'Apache::Session::MySQL', $id, {
Handle => $dbh
};
AUTHOR
This modules was written by Jeffrey William Baker <jwbaker@acm.org>
SEE ALSO
Apache::Session
perl v5.10.1 2010-10-18 Apache::Session::Store::MySQL(3pm)