06-15-2006
1. Holding the entire content of a file in an array (a slurp) for a huge file is likely to be inefficient, or just consume lots of memory. Try to rewrite your script so that each line is read as is processed.
2. In the loop you are opening a lot of PLFILE but you are not closing any one of them. If you do a lot of I/Os you should try to close filehandles as early as they are not needed.
As for "clipping", I have not experienced any of such behaviour myself.
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
I have discovered a curious phenomenon in GCI. I need some advice from someone far more adept. Is this a bug or potential security weakness?
Context: Redhat 8.0 on xx86 (pentium 3) Apache 2.0, Perl 5.80
Background:
I've been trying to harden a web application which accepts user uploaded... (0 Replies)
Discussion started by: andyj
0 Replies
2. UNIX for Dummies Questions & Answers
Could somebody give links for memory detector for perl?
Thanks :) (4 Replies)
Discussion started by: matrixmadhan
4 Replies
3. Shell Programming and Scripting
I have a program that opens a file handle that reads a lot of logs, it uses globbing, for example ba* matches bananas.log, bank.log, etc. I have seven different names, each with several logs that I run to a grep pattern. I have subroutines for each match and a loop w/o args that processes this. ... (5 Replies)
Discussion started by: nj78
5 Replies
4. Shell Programming and Scripting
Hi,
Is there any known trick that will consume all of my memory and force my machine to swap? I'm scripting a monitor in perl that will alert me when available memory is dangerously low and system is swapping, and I would like to simulate the scenario. I am clueless how to make my system lack... (4 Replies)
Discussion started by: marcpascual
4 Replies
5. Shell Programming and Scripting
I currently have a statistics gathering script i run on my Linux servers. One of the stat i gather is total memory in the machine. The script is all perl with the exception of gathering the memory for that i use the following command:
$ram = (`cat /proc/meminfo | grep "MemTotal" | awk... (1 Reply)
Discussion started by: insania
1 Replies
6. Shell Programming and Scripting
I am running a program written in perl script and it is stopped with "Out of memory!" error. This is very strange because at the time then the program is aborted, it only used 4GB RAM and there are still 30GB free physical memory left in the system. I check the perl script and found the program... (3 Replies)
Discussion started by: lilili07
3 Replies
7. Shell Programming and Scripting
Experts,
We used to receive our source files with '~^' as row delimiter. This file contains 2500K records and two of the columns having value in HTML formats within the file.
While running the below commands against the file, we are encountering out of memory, could you please help to... (3 Replies)
Discussion started by: srivijay81
3 Replies
8. Shell Programming and Scripting
Hi ,
when one of the perl script is being executed i am getting the following
error as out of memory,
when i check memory utilisation it is showing as 60% .
cp utilisation as 11%.
swap is free for 19 gb.
can anyone guide me to sort the above isssue.i want to know the root cause. (2 Replies)
Discussion started by: Ajoy
2 Replies
9. Shell Programming and Scripting
Hi I am working with a 3.0 GB file and running the following script to process it. After running for 15 minutes, the script stops saying Out of memory or Killed.
Can the experts suggest where my code can be improved to save memory?
Thanks in advance.
#! usr/bin/perl
use warnings;
open... (3 Replies)
Discussion started by: polsum
3 Replies
10. Shell Programming and Scripting
I am getting a out of memory issue while executing the perl program.
Per version : /opt/acc_perl/lib/site_perl/5.14.2
Read in 54973 total records
Read in 54973 table records from table.
Out of memory!
so the job get failed due to out of memory. need to get rid of the out of memory... (3 Replies)
Discussion started by: ramkumar15
3 Replies
LEARN ABOUT DEBIAN
roarvio
roarvio(7) System Manager's Manual: RoarAuido roarvio(7)
NAME
libroar - RoarAudio sound library
roarvio - RoarAudio virtual IO layer
SYNOPSIS
#include <roaraudio.h>
struct roar_vio_calls;
DESCRIPTION
The RoarAudio VIO interface is RoarAudio's IO abstraction layer. It provides basic IO functions such as read and write independing on the
underlaying IO. For Example can you open a plain or a gziped file via the VIO layer. After a successful open both objects behave the same,
libroar takes care about the compression in the gzip case.
TUTORIALS
Tutorials can be found in roartutvio(7).
IMPORTANT FUNCTIONS
There are several important functions. This is a small list of the most important ones.
Opening
roar_vio_open_file(3), roar_vio_open_fh(3), roar_vio_open_stdio(3), roar_vio_open_dstr(3), roar_vio_open_proto(3).
While there are a lot functions important for opening files the most important one is roar_vio_open_dstr(3). It opens a stream based
on URLs that can point to local files or files on remote machines. It also can handle compression and encryption.
Closing
roar_vio_close(3), roar_vio_shutdown(3)
Reading and writing
roar_vio_read(3), roar_vio_write(3)
Seeking and positioning
roar_vio_lseek(3)
Non-Blocking and Asyncron IO
roar_vio_nonblock(3), roar_vio_sync(3), roar_vio_select(3)
Networking and Sockets
roar_vio_accept(3)
String handling
roar_vio_printf(3)
BUGS
A lot...
SEE ALSO
roar-config(1), roartypes(1), roartutvio(7), RoarAudio(7).
RoarAudio May 2011 roarvio(7)