How to make parallel processing rather than serial processing ??
Hello everybody,
I have a little problem with one of my program. I made a plugin for collectd (a stats collector for my servers) but I have a problem to make it run in parallel.
My program gathers stats from logs, so it needs to run in background waiting for any new lines added in the log files.
My problem is that I call my program in a bash script that tails my log files, like this :
The problem is that it does not work very well. So I would like to make the "tail -f" parallel processing directly in my perl program.
Here is the perl program (collection.pl) I'd like to make parallel processing with :
I have seen that parallel processing could be done with fork or something like that but I don't really understand how to do it. Does anyone has an idea of how I could do that ?
Hi All,
I am working on solaris 8 sparc machine with 2 cpu.
I am trying to run my application which generates files. I run multiple instance of the application, but the results don't seem to show as if it were runing parallely.
When i run the application once it takes 12 secs to generate a... (1 Reply)
Hi
I want to run two shell script files parallely. These two scripts are interacting with the database. can any body help on this Pls
Regards
Audippa naidu.M (3 Replies)
Hi
I am looking for some kind of feature in unix that will help me write a script that can invoke multiple processes in parallel. And make sure that the multiple parallel processes complete successfully before I proceed to the next step.
Someone suggested something called timespid or... (6 Replies)
hi i am preparing a set of batches for a set of files sequentially
There is a folder /xyz where all the files reside
now all the files starting with
01 - will be appended for one below other to form a batch batch01
then all the files starting with
02 - will be appended for one below other to... (7 Replies)
Hey, I just wanted to know how many algorithms there are that cannot be accelerated by parallel processing. I know one such algorithm is Euclid's Algorithm (for GCF). does anyone know any other algorithms that cannot be accelerated by pp? if so please list the names and a general sentence of what... (2 Replies)
HI All,
I have scenerio where I need to call sub modules through for loop
for (i=0; i<30 ;i++)
{
..
..
..
subroutine 1;
subroutine 2;
}
I want this to be run in parallel
process1
{
...
...
subroutine 1;
subroutine 2; (0 Replies)
Need urgent help on thread: the goal here is the separtemask will take each image and separate different contours and for each contour in the image it will call handleobject thread. So every for loop will call the handeobject thread. However, object index variable needs to be passed in each... (0 Replies)
Unix OS : Linux 2.6x
Shell type : Korn
Hi all ,
This is a requirement to incorporate parallel processing of a Unix code .
I have two pieces of unix code , one of which will act as a parent process .
This script will invoke multiple ( say four ) instances of the second script at one go... (13 Replies)
Hi,
I am taking up the cue from where I was left in my earlier post ( link given below )
https://www.unix.com/shell-programming-scripting/231107-implement-parallel-processing.html
I actually wanted to know the significance of using the Unix "wait" , which returns
the control from background to... (3 Replies)
I have 10,000 + files, each of which I need to zip using bzip2.
Is ti possible to use bash to create 8 parallel streams sending a new file to be processed from the list when one of the others has finished? (1 Reply)
Discussion started by: garethsays
1 Replies
LEARN ABOUT HPUX
yppush
yppush(1M)yppush(1M)NAME
yppush - force propagation of Network Information Service database
SYNOPSIS
domain] host] maxm] mint] mapname
Remarks
The Network Information Service (NIS) was formerly known as Yellow Pages (YP). Although the name has changed, the functionality of the
service remains the same.
DESCRIPTION
copies a Network Information Service (NIS) map (database), mapname, from the map's master NIS server to each slave NIS server. It is usu-
ally executed only on the master NIS server by shell script which is run either after changes are made to one or more of the master's NIS
databases or when the NIS databases are first created. See ypmake(1M) and ypinit(1M) for more information on these processes.
constructs a list of NIS server host names by reading the NIS map within the domain. Keys within the map are the host names of the
machines on which the NIS servers run. then sends a "transfer map" request to the NIS server at each host, along with the information
needed by the transfer agent (the program that actually moves the map) to call back
When the transfer attempt is complete, whether successful or not, and the transfer agent sends a status message, the results can be printed
to standard output. Messages are printed when a transfer is not possible, such as when the request message is undeliverable or when the
timeout period on responses expires.
Refer to ypfiles(4) and ypserv(1M) for an overview of Network Information Service.
Options
recognizes the following options:
Copy mapname to the NIS servers in domain rather than to the domain returned by (see domainname(1)).
Propagate the map(s) only to the specified host.
Attempt to run
maxm transfers in parallel to as many servers simultaneously. Without the option, attempts to transfer a map to each
server, one at a time. When a network has many servers, such serial transfers can result in long delays to complete all
transfers. A maxm value greater than 1 reduces total transfer time through better utilization of CPU time at the mas-
ter. maxm can be any value from 1 through the number of NIS servers in the domain.
Set the minimum timeout value to
mint seconds. When transferring to one slave at a time, waits up to 80 seconds for the transfer to complete, after
which it begins transferring to the next slave. When multiple parallel transfers are attempted by use of the option, it
may be necessary to set the transfer timeout limit to a value larger than the default 80 seconds to prevent timeouts
caused by network delays related to parallel transfers.
Verbose mode:
messages are printed when each server is called and when each response is received. If this option is omitted, only
error messages are printed.
WARNINGS
In the current implementation (Version 2 NIS protocol), the transfer agent is ypxfr(1M) which is started by the ypserv(1M) program at
yppush's request (see ypxfr(1M) and ypserv(1M)).
Starting with ONCplus version B.11.31.02, the NIS Version 1 protocol is no longer available.
AUTHOR
was developed by Sun Microsystems, Inc.
FILES
SEE ALSO
domainname(1), ypserv(1M), ypxfr(1M), ypfiles(4).
yppush(1M)