Monitoring processes in parallel and process log file after process exits
I am writing a script to kick off a process to gather logs on multiple nodes in parallel using "&". These processes create individual log files. Which I would like to filter and convert in CSV format after they are complete. I am facing following issues:
1. Monitor all Processes parallelly. whichever process completes first I would like to convert o/p log file of corresponding process to csv format. Sometimes process might take more than 30 mins to complete. Problem with my code is it will go serially converting files and not any process which completes or releases the file first. Please help
I have following code ---------- Post updated at 11:42 PM ---------- Previous update was at 11:38 PM ----------
Hi guys:
I have a an oracle job which uses 10 parallel hints and would like to killit when it hangs. I want to kill all the processes that have been spawned. what I do right now is get the pid of the scheduler process which initiated theis job and the do a ps -ef| grep 'pid' and trace through... (1 Reply)
Hi
I need to split a huge file into multiple smaller files using split command.
After that i need to process each file in the back ground with sql loader .Sql loader is a utlity to load CSV files into oracle .
Check the status of each of these sqlloaders and then after sucessfull... (6 Replies)
hi all,
i would like to write the shell script to monitoring the processing, but if i passing the parameter the number of process is incorrect
how to slove it? many thx
got the correct number of process as following script:
===========================================================... (3 Replies)
There is a unix process process in oracle running and i see running by typing ps -fea|grep GE_CLIENTES.
The question is How can i see if this process is running in paralel. I dont know with a Unix command or specifically its a comand from Oracle.
I kow a Parallel process ia a process that... (1 Reply)
I am a new member of this forum and am also new to unix shell scripting.
I joined the forum to seek for help to achieve my task as this forum helps people.
here's what i do manually on daily basis
1)Loginto different unix box
2)Ftp the log files (morethan 50 each dir) to windows
3)use text pad... (3 Replies)
I had issues with processes locking up. This script checks for processes and kills them if they are older than a certain time.
Its uses some functions you'll need to define or remove, like slog() which I use for logging, and is_running() which checks if this script is already running so you can... (0 Replies)
HI All,
I have scenerio where I need to call sub modules through for loop
for (i=0; i<8000 ;i++)
{
..
BLOCKA
}
BLOCKA
{
..
..
subroutine 1;
subroutine 2;
}
I want this to be run in parallel
process1 BLOCKA
{ (6 Replies)
Hi,
I have a file which has a list of 200 tables e.g: table.txt
I need to do a count for each table and store it in a file.
So I did something like this:
for TABLE in `cat table.txt`
do
T_CNT=$(sqlplus -s -l / as sysdba <<EOF
set echo off heading off feadback off
SELECT count(*)
FROM... (1 Reply)
Discussion started by: wahi80
1 Replies
LEARN ABOUT DEBIAN
tablix2_benchmark
TABLIX(1) Tablix User's Manual TABLIX(1)NAME tablix2_benchmark - Tablix benchmark utilitySYNOPSIS tablix2_benchmark benchmark [ options ] " Tablix options " file
DESCRIPTION Tablix is a powerful free software kernel for solving general timetabling problems. It uses a coarse-grained parallel genetic algorithm in combi-
nation with other techniques to construct sensible timetables from XML formatted problem descriptions. Tablix can run on a single host as well as
on a heterogeneous parallel virtual machine using PVM3.tablix2_benchmark is used to test the effect of different Tablix command line options on the final result. In most tests Tablix is started multi-ple times with the same input file to provide more reliable results. Each time Tablix is started, three variables are measured: the fitness value
of the resulting timetable, serial number of the last generation and elapsed time (in seconds). When a test is finished, the average for each
variable, as well as the maximum and minimum values are printed on standard output. The exact format depends on each test.The actual timetables that are generated during these tests are stored under a temporary file names in the current directory and are deleted aftertablix2_benchmark exits.In some cases tests can take several days to complete. Because the genetic algorithm can in some cases go into an endless loop, it is always
advisable to limit Tablix execution time with the -t option. This way at least the maximum execution time for a test can be calculated.
tablix2_benchmark will detect when the time limit set by the -t option was reached. This information will be included in the final statistics.OPTIONS The following tests are supported:
tablix2_benchmark --single "OPTIONS" file
Execute a single Tablix run using and print the results. OPTIONS parameter is mandatory and contains options that will be passed to the tablix2
process.
tablix2_benchmark --multiple N "OPTIONS" FILE
Execute N Tablix runs and print the statistics. OPTIONS parameter is mandatory and contains options that will be passed to the tablix2 process.
tablix2_benchmark --graph START STEP STOP "OPTIONS" FILE
Execute multiple Tablix runs. The character " N " in OPTIONS is substituted for an integer that is changed from START to STOP by STEP . Output is
gnuplot friendly.
tablix2_benchmark --multi-graph M START STEP STOP "OPTIONS" FILE
Execute multiple Tablix runs. The character " N " in OPTIONS is substituted for an integer that is changed from START to STOP by STEP . M Tablix
runs are executed for each value of N . Output is gnuplot friendly (use errorbars).
EXAMPLES The following test can be for example used to see the minimum grade, that can be reached with this configuration file:
tablix2_benchmark --multiple 5 "-t 90 -n 5" sample.xml
Tablix will be started five times. Each time with five computing nodes and with 90 minute time limit.tablix2_benchmark can also provide useful data for developers. Following test can be used to check the effect of the number of computing nodes on
the total time required to obtain the result:
tablix2_benchmark --multi-graph 5 1 1 10 "-t 90 -n N" sample.xml > stats.txt
Tablix will be started 50 times. 5 times for each value of N (which in this case means the number of nodes). Ten values of N will be probed: from
1 to 10 with steps of 1. The output will be redirected to stats.txt . A graph of average computing time versus number of nodes can then be pro-duced in gnuplot with the following command:
plot "test.txt" using ($1):($8):($9):($10) with yerrorbars
BUGS tablix2_benchmark utility depends on a number of common UNIX programs (mktemp, grep, sed, awk, ...) that may not be available on all systems. Thescript is not currently capable of properly detecting if any required programs are missing.AUTHOR Tomaz Solc (tomaz.solc@tablix.org)
SEE ALSO tablix2(1), Tablix User's Manual, Tablix modules HOWTO, Tablix on Morphix HOWTO
Tomaz Solc 2005-09-03 TABLIX(1)