01-16-2014
Parallel Execution of Command
Hi All,
We have a table that has to store around 80-100 million records. The table is partitioned by a column called Market Code. There are 30 partitions each corresponding to one MRKT_CD.
The source of this table is a join between 3-4 other tables. We are loading this table through SQLPLUS in UNIX script.The script basically iterates through a list of 30 market codes and loads data partition by partition.
My question is, is there a way to trigger these inserts in parallel since they are all going to write into different partitions? Currently each insert is sequential.
I'm not too sure how UNIX specific my question is so I'm going to post this question on the Database forum too.
Greatly appreciate any help. Thanks
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello,
I wish to run parallel process forked from one script.
Currently I doing is submit them in background.
For example:
---------------------------------------------------------------
#!/usr/bin/ksh
process1 &
process2 &
process3 &
.....
.....
#here I check for completion of... (4 Replies)
Discussion started by: RishiPahuja
4 Replies
2. AIX
Hi,
Is there any way to run parallel jobs using make command?
I am using non-GNU make utility on AIX 4.3.
I want to run 2 jobs symultaneously using make utility.
Thanks.
Suman (0 Replies)
Discussion started by: suman_jakkula
0 Replies
3. High Performance Computing
Hi All,
I am working on a project where I need to execute set of arguments (around 500) on a Simulator. If I execute this on one linux (RedHat 8.0) machine it will approximately takes 2~3 days. Since I am having more linux machines am thinking of executing these on different machines in... (7 Replies)
Discussion started by: 123an
7 Replies
4. Shell Programming and Scripting
Hi All,
At present I am using a UNIX Script which is running a set of JOBS. These JOBS are to be repeated for 20 times, means the same set of JOBS are repeated by just passing different arguments (From 1 to 20).
Is there any way by which I can execute them parallel?
At present its all... (4 Replies)
Discussion started by: Prashantckc
4 Replies
5. Shell Programming and Scripting
how can i process jobs parallel with conditions below.
Script1.ksh
Script2.ksh
Script3.ksh
Script4.ksh
Script5.ksh
Script6.ksh
Script7.ksh
Script8.ksh
Script9.ksh
Script10.ksh
After successful completion of Script1.ksh I need to run Script7.ksh.
After successful... (4 Replies)
Discussion started by: ford2020
4 Replies
6. Shell Programming and Scripting
I am haveing 2 scripts, 1st script calls 2ed script for each parameter.(parameters are kept in a different txt file)
1st script
for x in `cat Export_Tables_List.txt`
do
sh Exp_Table.sh $x &
done
echo -e "1) following tables are successfully exported : \n" > temp
cat... (1 Reply)
Discussion started by: sbmk_design
1 Replies
7. Programming
Since there've been a few requests for a method to execute commands on multiple CPUs (logical or physical), with various levels of shell-, make-, or Perl-based solutions, ranging from well-done to well-meant, and mostly specific to a certain problem, I've started to write a C-based solution... (4 Replies)
Discussion started by: pludi
4 Replies
8. Shell Programming and Scripting
Hi,
I am using Ubuntu 10.04 LTS 32-bit. I would like to execute a command in two or more servers (multiple remote hosts) in parallel. The commands "shmux" or "on" are not available in Ubuntu. Could anyone tell me what other equivalent commands available in Ubuntu to accomplish this task? (1 Reply)
Discussion started by: royalibrahim
1 Replies
9. Shell Programming and Scripting
Hi all, I have the requirement to generate the file containing following command
eval /path/ dsjob -logdetail projectname JOBNAME /path/
1. The file contains the above command say about 150 times i,e only the JOBNAME changes in every command
2. The commands must be written in such a way... (2 Replies)
Discussion started by: sanjay mn
2 Replies
10. Shell Programming and Scripting
I have few very huge files ~ 2 Billion rows of 130 column(CDR data) in a folder, I have written shell script need to read on each file in a folder and will create a new files based on some logic.
But problem is it's taking time to create a new file due to the size , So i dont want to corrupt... (6 Replies)
Discussion started by: rspwilliam
6 Replies
LEARN ABOUT SUNOS
mlib_imagelookup2
mlib_ImageLookUp2(3MLIB) mediaLib Library Functions mlib_ImageLookUp2(3MLIB)
NAME
mlib_ImageLookUp2 - table lookup
SYNOPSIS
cc [ flag... ] file... -lmlib [ library... ]
#include <mlib.h>
mlib_status mlib_ImageLookUp2(mlib_image *dst, const mlib_image *src, const void **table, const mlib_s32 *offsets, mlib_s32 channels);
DESCRIPTION
The mlib_ImageLookUp2() function maps the source image to the destination image by using the user-specified lookup table and an offset.
The source and destination images must have the same width and height.
The source and destination images can have different data types. See the following table for available variations of the table lookup func-
tion on image types:
Type [*] BYTE SHORT USHORT INT FLOAT DOUBLE
MLIB_BIT Y
MLIB_BYTE Y Y Y Y Y Y
MLIB_SHORT Y Y Y Y Y Y
MLIB_USHORT Y Y Y Y Y Y
MLIB_INT Y Y Y Y Y Y
[*] Each row represents a source data type. Each column represents a destination data type.
The source and destination images also can have a different number of channels. The source image can be a single-channel image or can have
the same number of channels as the destination image. The lookup table can have one channel or have the same channels as the destination
image. See the following table for possible variations on the number of channels in the images and the lookup table:
# of channels in # of channels in # of channels in
the input image the lookup table the output image
1 n n
n 1 n
n n n
where, n = 1, 2, 3, 4.
Each of the following equations is used in the corresponding case shown in the table above.
dst[x][y][i] = table[i][src[x][y][0] - offsets[i]]
dst[x][y][i] = table[0][src[x][y][i] - offsets[0]]
dst[x][y][i] = table[i][src[x][y][i] - offsets[i]]
PARAMETERS
The function takes the following arguments:
dst Pointer to destination image.
src Pointer to source image.
table Pointer to lookup table. The data type of the lookup table is the same as that of the destination image.. The format of the
lookup table is:
table[channel][index]
The entries are indexed from 0 to 1, 2, ..., and so on. It is the user's responsibility to provide a lookup table that has
enough entries to cover all possible values of the pixel components deducted by the offset in each channel of the source
image.
offsets Offset values subtracted from the src pixel before table lookup.
channels Number of channels in the lookup table. If the number of channels equals 1, then the same table is applied to all chan-
nels. Otherwise, the number of channels must be no less than the number of channels in the destination image.
RETURN VALUES
The function returns MLIB_SUCCESS if successful. Otherwise it returns MLIB_FAILURE.
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Interface Stability |Evolving |
+-----------------------------+-----------------------------+
|MT-Level |MT-Safe |
+-----------------------------+-----------------------------+
SEE ALSO
mlib_ImageLookUp(3MLIB), mlib_ImageLookUp_Inp(3MLIB), mlib_ImageLookUpMask(3MLIB), attributes(5)
SunOS 5.10 10 Nov 2004 mlib_ImageLookUp2(3MLIB)