06-03-2002
Writing fast and efficiently - how ?
I have a lot of processes all of which need to write quite
a lot of data to the filesystem ( to a single file).
This is managed today in the following way : all the processes
write the data to a shared memory block, which is manged by a process that empties it to a file, thus allowing more space for
writing by the other processes.
It is now argued that this is slow and time- consuming,
specifically in times of high load on the shmem resource
(since each read/write is performed via a lock management
facility).
My question is : Will it be faster to dump the whole idea
of the shared memory and use the buffers that the O.S
provudes ? What type of locking will then be necessary ?
I am working on a AIX , RS6000 machine.
Thank you in advance for your comments !
9 More Discussions You Might Find Interesting
1. IP Networking
Do anyone telle me please how to use PING command to verify connection (TCP/IP) between serveurs.
thanks (1 Reply)
Discussion started by: hoang
1 Replies
2. Programming
I have a lot of processes all of which need to write quite
a lot of data to the filesystem ( to a single file).
This is managed today in the following way : all the processes
write the data to a shared memory block, which is manged by a process that empties it to a file, thus allowing more... (7 Replies)
Discussion started by: Seeker
7 Replies
3. Shell Programming and Scripting
Hi all,
Were currently using xapply to run multiple ssh instances that then calls
a script that returns the PID of a webserver process.
Currently we have like 30 xapply statements in a script call checkit which
checks various webserver processes on various unix/linux boxes.
My question... (0 Replies)
Discussion started by: bdsffl
0 Replies
4. UNIX Desktop Questions & Answers
hi friens, :)
if i need to find files with extension .c++,.C++,.cpp,.Cpp,.CPp,.cPP,.CpP,.cpP,.c,.C
wat is the pattern for finding them
:confused: (2 Replies)
Discussion started by: arunsubbhian
2 Replies
5. Shell Programming and Scripting
I am new to the boards and to shell programming and have a requirement to name new files received with a unique sequence number. I need to look at a particular file pattern that exists and then to increment a sequence by 1 and write the new file.
Example of file names and sequence #
... (4 Replies)
Discussion started by: sandiego_coder
4 Replies
6. Shell Programming and Scripting
Hi
I have a set of options in the form of key value in a file. Need to find a particular value of 'a' and delete all lines till the next 'a' keyword .
Ex :
a bbb
c ddd
e fff
g hhh
a sss
c ggg
e xxx
f sss
a ddd
d sss
r sss
g hhh (5 Replies)
Discussion started by: TDUser
5 Replies
7. UNIX for Dummies Questions & Answers
Hi,
Often when I use echo statements in scripts I echo a line of #'s above and below. For example:
echo #####
echo hello world
echo #####
However, I generally have a series of about 75 #'s. For example:
echo #(x 75)
echo hello world
echo #(X 75)
While this helps to delineate... (7 Replies)
Discussion started by: msb65
7 Replies
8. Shell Programming and Scripting
Hello all,
I have a script that has to get variables remotely. Rather than having the script login to the remote server 3 separate times, is there a faster way to get each variable?
##Server comes from input or list##
CHKINSTALL=`ssh server "swlist | grep -i program" | grep -v... (2 Replies)
Discussion started by: LinuxRacr
2 Replies
9. Shell Programming and Scripting
Hi
I have a requirement wherein i need to purge some directories.
I have more than 2000 directories where i need to keep data for 10 days and delete the rest. What i am looking for is an efficient way to achieve this.
There are four mount points from where i need to delete the files.
... (3 Replies)
Discussion started by: Apoorvbarwa
3 Replies
LEARN ABOUT HPUX
pthread_rwlockattr_setpshared
pthread_rwlockattr_getpshared(3T) pthread_rwlockattr_getpshared(3T)
NAME
pthread_rwlockattr_getpshared(), pthread_rwlockattr_setpshared() - get or set the process-shared attribute
SYNOPSIS
PARAMETERS
attr Pointer to the read-write lock attributes object whose attributes are to be set/retrieved.
pshared This parameter either specifies the new value of the process-shared attribute (set function) or points to the memory loca-
tion where the process-shared attribute of attr is to be returned (get function).
DESCRIPTION
The attributes object attr must have been previously initialized with the function before these functions are called.
Read-Write locks can be used only by threads within the process or shared by threads in multiple processes. The process-shared attribute in
a read-write lock attributes object describes who may use the read-write lock. The legal values for the process-shared attribute are:
This option permits a read-write lock to be operated upon by any thread
that has access to the memory where the read-write lock is allocated. The application is responsible for allocating the
read-write lock in memory that multiple processes can access.
The read-write lock can only be operated upon by threads created within
the same process as the thread that initialized the read-write lock. If threads of differing processes attempt to operate on
such read-write lock, the behavior is undefined.
The default value of process-shared is
is used to set the process-shared attribute in the initialized attributes object attr. The new value of the process-shared attribute of
attr is set to the value specified in the pshared parameter.
retrieves the value of the process-shared attribute from the read-write lock attributes object attr. The value of the process-shared
attribute of attr is returned in the pshared parameter.
RETURN VALUE
Upon successful completion, and return zero. Otherwise, an error number is returned to indicate the error (the variable is not set).
ERRORS
If any of the following occur, the and functions return the corresponding error number:
is not defined and these functions are not supported.
For each of the following conditions, if the condition is detected, the and functions return the corresponding error number:
The value specified by
attr is invalid.
The value specified by
pshared is not a legal value.
The value pshared points to an illegal address.
WARNINGS
If a read-write lock is created with the process-shared attribute defined as the cooperating processes should have access to the memory in
which the read-write lock is allocated.
AUTHOR
and were developed by X/Open.
SEE ALSO
pthread_create(3T), pthread_rwlockattr_init(3T), pthread_rwlock_init(3T).
STANDARDS CONFORMANCE
Pthread Library pthread_rwlockattr_getpshared(3T)