01-10-2006
split process files in parallel and rejoin
Hi
I need to split a huge file into multiple smaller files using split command.
After that i need to process each file in the back ground with sql loader .Sql loader is a utlity to load CSV files into oracle .
Check the status of each of these sqlloaders and then after sucessfull completion join the file back again.
Any idea on how to do run the process in background and then check for their sucessful execution
regards
Hrishy
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi guys:
I have a an oracle job which uses 10 parallel hints and would like to killit when it hangs. I want to kill all the processes that have been spawned. what I do right now is get the pid of the scheduler process which initiated theis job and the do a ps -ef| grep 'pid' and trace through... (1 Reply)
Discussion started by: oracle8
1 Replies
2. UNIX and Linux Applications
There is a unix process process in oracle running and i see running by typing ps -fea|grep GE_CLIENTES.
The question is How can i see if this process is running in paralel. I dont know with a Unix command or specifically its a comand from Oracle.
I kow a Parallel process ia a process that... (1 Reply)
Discussion started by: alexcol
1 Replies
3. Shell Programming and Scripting
HI All,
I have scenerio where I need to call sub modules through for loop
for (i=0; i<8000 ;i++)
{
..
BLOCKA
}
BLOCKA
{
..
..
subroutine 1;
subroutine 2;
}
I want this to be run in parallel
process1 BLOCKA
{ (6 Replies)
Discussion started by: gvk25
6 Replies
4. Programming
Hello;
Please Are both threads execute in parallel?
Thank you (4 Replies)
Discussion started by: chercheur857
4 Replies
5. UNIX for Dummies Questions & Answers
i am having 4 process,have to run parallel and not after one by one.
sample1.sh
sample2.sh
sample3.sh
sample4.sh
Thanks in advance.
i (11 Replies)
Discussion started by: sagar_1986
11 Replies
6. Shell Programming and Scripting
Hi,
I have a file which has a list of 200 tables e.g: table.txt
I need to do a count for each table and store it in a file.
So I did something like this:
for TABLE in `cat table.txt`
do
T_CNT=$(sqlplus -s -l / as sysdba <<EOF
set echo off heading off feadback off
SELECT count(*)
FROM... (1 Reply)
Discussion started by: wahi80
1 Replies
7. Shell Programming and Scripting
File examples
f17_mar_01_02_03_04_fsw1.xml
f17_mar_01_02_03_04_fsw2.xml
f17_mar_01_02_03_04_fsw3.xml
f17_feb_13_20_49_06_fsw1.xml
f17_feb_13_20_49_06_fsw2.xml
f17_feb_13_20_49_06_fsw3.xml
I have many xml files that are grouped with same file name, but are numbered from 1-to-many... (2 Replies)
Discussion started by: aachave1
2 Replies
8. Shell Programming and Scripting
I am writing a script to kick off a process to gather logs on multiple nodes in parallel using "&". These processes create individual log files. Which I would like to filter and convert in CSV format after they are complete. I am facing following issues:
1. Monitor all Processes parallelly.... (5 Replies)
Discussion started by: shunya
5 Replies
9. UNIX for Beginners Questions & Answers
Hello,
I need to split a file by number of records and rename each split file with actual filename pre-pended with 3 digit split number.
What I have tried is the below command with 2 digit numeric value
split -l 3 -d abc.txt F (# Will Produce split Files as F00 F01 F02)
How to produce... (19 Replies)
Discussion started by: techedipro
19 Replies
10. UNIX for Beginners Questions & Answers
i use the split command to split a one terabyte backup file into 10 chunks of 100 GB each. The files are split one after the other. While the files is being split, I will like to scp the files one after the other as soon as the previous one completes, from server A to Server B. Then on server B ,... (2 Replies)
Discussion started by: malaika
2 Replies
LEARN ABOUT MOJAVE
zipsplit
zipnote(1) General Commands Manual zipnote(1)
NAME
zipsplit - split a zipfile into smaller zipfiles
SYNOPSIS
zipsplit [-t] [-i] [-p] [-s] [-n size] [-r room] [-b path] [-h] [-v] [-L] zipfile
ARGUMENTS
zipfile Zipfile to split.
OPTIONS
-t Report how many files it will take, but don't make them.
-i Make index (zipsplit.idx) and count its size against first zip file.
-n size
Make zip files no larger than "size" (default = 36000).
-r room
Leave room for "room" bytes on the first disk (default = 0).
-b path
Use path for the output zip files.
-p Pause between output zip files.
-s Do a sequential split even if it takes more zip files.
-h Show a short help.
-v Show version information.
-L Show software license.
DESCRIPTION
zipsplit reads a zipfile and splits it into smaller zipfiles.
EXAMPLES
To be filled in.
BUGS
Does not yet support large (> 2 GB) or split archives.
SEE ALSO
zip(1), unzip(1)
AUTHOR
Info-ZIP
v3.0 of 8 May 2008 zipnote(1)