Login or Register to Ask a Question and Join Our Community


Filesystems, Disks and Memory

Writing fast and efficiently - how ?

 
Thread Tools Search this Thread
Special Forums Hardware Filesystems, Disks and Memory Writing fast and efficiently - how ?
Prev   Next
# 1  
Old 06-03-2002
Question Writing fast and efficiently - how ?
I have a lot of processes all of which need to write quite
a lot of data to the filesystem ( to a single file).
This is managed today in the following way : all the processes
write the data to a shared memory block, which is manged by a process that empties it to a file, thus allowing more space for
writing by the other processes.
It is now argued that this is slow and time- consuming,
specifically in times of high load on the shmem resource
(since each read/write is performed via a lock management
facility).
My question is : Will it be faster to dump the whole idea
of the shared memory and use the buffers that the O.S
provudes ? What type of locking will then be necessary ?

I am working on a AIX , RS6000 machine.

Thank you in advance for your comments !
 
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Purging 2000+ directories efficiently

Hi I have a requirement wherein i need to purge some directories. I have more than 2000 directories where i need to keep data for 10 days and delete the rest. What i am looking for is an efficient way to achieve this. There are four mount points from where i need to delete the files. ... (3 Replies)
Discussion started by: Apoorvbarwa
3 Replies

2. Shell Programming and Scripting

Getting remote variables more efficiently

Hello all, I have a script that has to get variables remotely. Rather than having the script login to the remote server 3 separate times, is there a faster way to get each variable? ##Server comes from input or list## CHKINSTALL=`ssh server "swlist | grep -i program" | grep -v... (2 Replies)
Discussion started by: LinuxRacr
2 Replies

3. UNIX for Dummies Questions & Answers

Efficiently Repeat Text

Hi, Often when I use echo statements in scripts I echo a line of #'s above and below. For example: echo ##### echo hello world echo ##### However, I generally have a series of about 75 #'s. For example: echo #(x 75) echo hello world echo #(X 75) While this helps to delineate... (7 Replies)
Discussion started by: msb65
7 Replies

4. Shell Programming and Scripting

Parse and delete lines efficiently

Hi I have a set of options in the form of key value in a file. Need to find a particular value of 'a' and delete all lines till the next 'a' keyword . Ex : a bbb c ddd e fff g hhh a sss c ggg e xxx f sss a ddd d sss r sss g hhh (5 Replies)
Discussion started by: TDUser
5 Replies

5. Shell Programming and Scripting

How to parse a string efficiently

I am new to the boards and to shell programming and have a requirement to name new files received with a unique sequence number. I need to look at a particular file pattern that exists and then to increment a sequence by 1 and write the new file. Example of file names and sequence # ... (4 Replies)
Discussion started by: sandiego_coder
4 Replies

6. UNIX Desktop Questions & Answers

how to search files efficiently using patterns

hi friens, :) if i need to find files with extension .c++,.C++,.cpp,.Cpp,.CPp,.cPP,.CpP,.cpP,.c,.C wat is the pattern for finding them :confused: (2 Replies)
Discussion started by: arunsubbhian
2 Replies

7. Shell Programming and Scripting

Using xapply efficiently?

Hi all, Were currently using xapply to run multiple ssh instances that then calls a script that returns the PID of a webserver process. Currently we have like 30 xapply statements in a script call checkit which checks various webserver processes on various unix/linux boxes. My question... (0 Replies)
Discussion started by: bdsffl
0 Replies

8. Programming

Writing fast and efficiently - how ?

I have a lot of processes all of which need to write quite a lot of data to the filesystem ( to a single file). This is managed today in the following way : all the processes write the data to a shared memory block, which is manged by a process that empties it to a file, thus allowing more... (7 Replies)
Discussion started by: Seeker
7 Replies

9. IP Networking

how to use PING command efficiently

Do anyone telle me please how to use PING command to verify connection (TCP/IP) between serveurs. thanks (1 Reply)
Discussion started by: hoang
1 Replies
Login or Register to Ask a Question

LEARN ABOUT OSX

xfs_freeze

xfs_freeze(8)						      System Manager's Manual						     xfs_freeze(8)

NAME

       xfs_freeze - suspend access to an XFS filesystem

SYNOPSIS

       xfs_freeze -f | -u mount-point

DESCRIPTION

       xfs_freeze suspends and resumes access to an XFS filesystem (see xfs(5)).

       xfs_freeze  halts  new access to the filesystem and creates a stable image on disk.  xfs_freeze is intended to be used with volume managers
       and hardware RAID devices that support the creation of snapshots.

       The mount-point argument is the pathname of the directory where the filesystem is mounted.  The filesystem must be  mounted  to	be  frozen
       (see mount(8)).

       The  -f flag requests the specified XFS filesystem to be frozen from new modifications.	When this is selected, all ongoing transactions in
       the filesystem are allowed to complete, new write system calls are halted, other calls which modify the	filesystem  are  halted,  and  all
       dirty data, metadata, and log information are written to disk.  Any process attempting to write to the frozen filesystem will block waiting
       for the filesystem to be unfrozen.

       Note that even after freezing, the on-disk filesystem can contain information on files that are still in the process of	unlinking.   These
       files will not be unlinked until the filesystem is unfrozen or a clean mount of the snapshot is complete.

       The  -u	flag  is used to un-freeze the filesystem and allow operations to continue.  Any filesystem modifications that were blocked by the
       freeze are unblocked and allowed to complete.

       One of -f or -u must be supplied to xfs_freeze.

NOTES

       A copy of a frozen XFS filesystem will usually have the same universally unique identifier (UUID) as the original, and  thus  may  be  pre-
       vented from being mounted.  The XFS nouuid mount option can be used to circumvent this issue.

       In  Linux  kernel version 2.6.29, the interface which XFS uses to freeze and unfreeze was elevated to the VFS, so that this tool can now be
       used on many other Linux filesystems.

SEE ALSO

       xfs(5), lvm(8), mount(8).

																     xfs_freeze(8)