01-16-2014
Parallel Execution of Command
Hi All,
We have a table that has to store around 80-100 million records. The table is partitioned by a column called Market Code. There are 30 partitions each corresponding to one MRKT_CD.
The source of this table is a join between 3-4 other tables. We are loading this table through SQLPLUS in UNIX script.The script basically iterates through a list of 30 market codes and loads data partition by partition.
My question is, is there a way to trigger these inserts in parallel since they are all going to write into different partitions? Currently each insert is sequential.
I'm not too sure how UNIX specific my question is so I'm going to post this question on the Database forum too.
Greatly appreciate any help. Thanks
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello,
I wish to run parallel process forked from one script.
Currently I doing is submit them in background.
For example:
---------------------------------------------------------------
#!/usr/bin/ksh
process1 &
process2 &
process3 &
.....
.....
#here I check for completion of... (4 Replies)
Discussion started by: RishiPahuja
4 Replies
2. AIX
Hi,
Is there any way to run parallel jobs using make command?
I am using non-GNU make utility on AIX 4.3.
I want to run 2 jobs symultaneously using make utility.
Thanks.
Suman (0 Replies)
Discussion started by: suman_jakkula
0 Replies
3. High Performance Computing
Hi All,
I am working on a project where I need to execute set of arguments (around 500) on a Simulator. If I execute this on one linux (RedHat 8.0) machine it will approximately takes 2~3 days. Since I am having more linux machines am thinking of executing these on different machines in... (7 Replies)
Discussion started by: 123an
7 Replies
4. Shell Programming and Scripting
Hi All,
At present I am using a UNIX Script which is running a set of JOBS. These JOBS are to be repeated for 20 times, means the same set of JOBS are repeated by just passing different arguments (From 1 to 20).
Is there any way by which I can execute them parallel?
At present its all... (4 Replies)
Discussion started by: Prashantckc
4 Replies
5. Shell Programming and Scripting
how can i process jobs parallel with conditions below.
Script1.ksh
Script2.ksh
Script3.ksh
Script4.ksh
Script5.ksh
Script6.ksh
Script7.ksh
Script8.ksh
Script9.ksh
Script10.ksh
After successful completion of Script1.ksh I need to run Script7.ksh.
After successful... (4 Replies)
Discussion started by: ford2020
4 Replies
6. Shell Programming and Scripting
I am haveing 2 scripts, 1st script calls 2ed script for each parameter.(parameters are kept in a different txt file)
1st script
for x in `cat Export_Tables_List.txt`
do
sh Exp_Table.sh $x &
done
echo -e "1) following tables are successfully exported : \n" > temp
cat... (1 Reply)
Discussion started by: sbmk_design
1 Replies
7. Programming
Since there've been a few requests for a method to execute commands on multiple CPUs (logical or physical), with various levels of shell-, make-, or Perl-based solutions, ranging from well-done to well-meant, and mostly specific to a certain problem, I've started to write a C-based solution... (4 Replies)
Discussion started by: pludi
4 Replies
8. Shell Programming and Scripting
Hi,
I am using Ubuntu 10.04 LTS 32-bit. I would like to execute a command in two or more servers (multiple remote hosts) in parallel. The commands "shmux" or "on" are not available in Ubuntu. Could anyone tell me what other equivalent commands available in Ubuntu to accomplish this task? (1 Reply)
Discussion started by: royalibrahim
1 Replies
9. Shell Programming and Scripting
Hi all, I have the requirement to generate the file containing following command
eval /path/ dsjob -logdetail projectname JOBNAME /path/
1. The file contains the above command say about 150 times i,e only the JOBNAME changes in every command
2. The commands must be written in such a way... (2 Replies)
Discussion started by: sanjay mn
2 Replies
10. Shell Programming and Scripting
I have few very huge files ~ 2 Billion rows of 130 column(CDR data) in a folder, I have written shell script need to read on each file in a folder and will create a new files based on some logic.
But problem is it's taking time to create a new file due to the size , So i dont want to corrupt... (6 Replies)
Discussion started by: rspwilliam
6 Replies
dkio(4) Kernel Interfaces Manual dkio(4)
Name
dkio - disk interface
Syntax
#include <sys/fs.h>
#include <sys/ioctl.h>
Description
This section describes the ioctl (input/output controller) codes for all disk drivers. The basic ioctl (input/output controller) format
is:
#include <sys/fs.h>
#include <sys/ioctl.h>
ioctl(fildes, code, arg)
struct pt *arg;
The applicable codes are:
DIOCGETPT Indicates to the driver to store the information in the current partition table in the address pointed to by arg. The file
descriptor must be opened on the raw partitions, a or c.
DIOCGETPT does not change the partition table, but it does provide access to the partition table information.
DIOCSETPT Indicates to the driver to modify the current partition table with the information pointed to by arg.
The file descriptor must be opened on the raw partitions, a or c.
If the a or c partition is not mounted, only the partition table in the driver is modified. This temporarily modifies the
partition table of the disk. The modifications are overwritten with the default table when the disk is turned off and on.
If the a or c partition is mounted, both the partition table in the driver and the partition table in the primary
superblock are modified. This permanently modifies the partition table of the disk. This is not recommended. To change a
partition table permanently, use the command.
DIOCDGTPT Indicates to the driver to store the default information of the current partition table in the address pointed to by arg.
The file descriptor must be opened on the raw partitions a or c.
DIOCGETPT does not change the partition table, but it does provide access to the partition table information.
DKIOCGET Allows the user to receive generic disk information as defined in structdevget.
DKIOCACC This code is defined in It is currently unused.
Restrictions
These restrictions apply when using the DIOCSETPT ioctl code:
o You must have superuser privileges.
o You cannot shrink or change the offset of a partition with a file system mounted on it or with an open file descriptor on the entire
partition.
o You cannot change the offset of the a partition.
Examples
This example shows how to use the DIOGETPT ioctl code to print the length and offset of the a partition of an RZ23 disk:
#include <sys/types.h>
#include <sys/param.h>
#include <sys/fs.h>
#include <sys/ioctl.h>
main()
{
struct pt arg;
int fd, i;
/* Open the "a" partition of the disk you want to see */
if ( (fd = open("/dev/rz0a",0)) < 0 ) {
printf("Unable to open device
");
exit(2);
}
/* Get the partition information */
if ( ioctl(fd,DIOCGETPT,&arg) < 0 )
printf("Error in ioctl
");
printf("Length Offset
");
for ( i = 0; i <= 7; i++ ) {
printf("%d %d
",arg.pt_part[i].pi_nblocks,
arg.pt_part[i].pi_blkoff );
}
}
Files
See Also
rz(4), disktab(5), fstab(5), chpt(8), diskpart(8), fsck(8), MAKEDEV(8), mkfs(8), tunefs(8)
RISC dkio(4)