Slow Perl script: how to speed up? Post: 302506325

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

network speed is slow

Hello, everyone: i encounter a problem these days , pls help me ,thanks in advance. my env: machine: ES40 A ES40 B os: true64 Unix 4.0f note: src.tar 8M network card speed 100M my problem: ...

2. Shell Programming and Scripting

Optimize/speed-up perl extraction

Hi, Is there a way I can extract my data faster. You know my data is 1.2 GB text file with 8Million rows with 38 columns/fields. Imagine how huge this is. How I can optimized the data extraction using perl. That is why I'm creating a script to filter only those informations that I need. Is...

3. UNIX for Advanced & Expert Users

speed test +20,000 file existance checks too slow

Need to make a very fast file existence checker. Passing in 20-50K num of files In the code below ${file} is a file with a listing of +20,000 files. test_speed is the script. I am commenting out the results of <time test_speed try>. The normal "test -f" is much much too slow when a system...

4. Shell Programming and Scripting

Speed up this script!

I have a script that processes a fair amount of data -- say, 25-50 megs per run. I'd like ideas on speeding it up. The code is actually just a preprocessor -- I'm using another language to do the heavy lifting. But as it happens, the preprocessing takes much more time than the final processing...

5. Filesystems, Disks and Memory

data from blktrace: read speed V.S. write speed

I analysed disk performance with blktrace and get some data: read: 8,3 4 2141 2.882115217 3342 Q R 195732187 + 32 8,3 4 2142 2.882116411 3342 G R 195732187 + 32 8,3 4 2144 2.882117647 3342 I R 195732187 + 32 8,3 4 2145 ...

6. Shell Programming and Scripting

Net::SSH::Perl slow to login.

I have some sample code that's supposed to ssh to another machine using Net::SSH::Perl, execute a command, and print the output of that command. It's very basic, and it works. However, I noticed that upon logging in: $ssh->login('username','password'); It takes roughly 10-13 seconds to...

7. Shell Programming and Scripting

How can i speed this script up?

Hi, Im quite new to scripting and would like a bit of assistance with trying to speed up the following script. At the moment it is quite slow.... Any way to improve it? total=111120 while do total=`expr $total + 1` INCREMENT=$total firstline = "blablabla" secondline = "blablabla"...

8. Shell Programming and Scripting

Help me with speed up this script

hey guys i have a perl script wich use to compare hashes but it tookes a long time to do that so i wich i will have the soulition to do it soo fast he is the code <redacted>

9. Solaris

Rsync quite slow (using very little cpu): how to improve its speed?

I have "inherited" a OmniOS (illumos based) server. I noticed rsync is significantly slower in respect to my reference, FreeBSD 12-CURRENT, running on exactly same hardware. Using same hardware, same command with same source and target disks, OmniOS r151026 gives: test@omniosce:~# time...

LEARN ABOUT CENTOS

scandeps

SCANDEPS(1p)						User Contributed Perl Documentation					      SCANDEPS(1p)

NAME

       scandeps - Scan file prerequisites

SYNOPSIS

	   % scandeps *.pm	    # Print PREREQ_PM section for *.pm
	   % scandeps -e 'STRING'      # Scan an one-liner
	   % scandeps -B *.pm	    # Include core modules
	   % scandeps -V *.pm	    # Show autoload/shared/data files
	   % scandeps -R *.pm	    # Don't recurse
	   % scandeps -C CACHEFILE  # use CACHEFILE to cache dependencies

DESCRIPTION

       scandeps is a simple-minded utility that prints out the "PREREQ_PM" section needed by modules.

       If you have CPANPLUS installed, modules that are part of an earlier module's distribution with be denoted with "S"; modules without a
       distribution name on CPAN are marked with "?".

       Also, if the "-B" option is specified, module belongs to a perl distribution on CPAN (and thus uninstallable by "CPAN.pm" or "CPANPLUS.pm")
       are marked with "C".

       Finally, modules that has loadable shared object files (usually needing a compiler to install) are marked with "X"; with the "-V" flag,
       those files (and all other files found) will be listed before the main output. Additionally, all module files that the scanned code depends
       on but were not found (and thus not scanned recursively) are listed. These may include genuinely missing modules or false positives. That
       means, modules your code does not depend on (on this particular platform) but that were picked up by the heuristic anyway.

OPTIONS

       -e STRING
	   Scan STRING as a string containing perl code.

       -c  Compiles the code and inspects its %INC, in addition to static scanning.

       -x  Executes the code and inspects its %INC, in addition to static scanning.

       -B  Include core modules in the output and the recursive search list.

       -R  Only show dependencies found in the files listed and do not recurse.

       -V  Verbose mode: Output all files found during the process; show dependencies between modules and availability.

	   Additionally, warns of any missing dependencies. If you find missing dependencies that aren't really dependencies, you have probably
	   found false positives.

       -C CACHEFILE
	   Use CACHEFILE to speed up the scanning process by caching dependencies.  Creates CACHEFILE if it does not exist yet.

SEE ALSO

       Module::ScanDeps, CPANPLUS::Backend, PAR

ACKNOWLEDGMENTS

       Simon Cozens, for suggesting this script to be written.

AUTHORS

       Audrey Tang <autrijus@autrijus.org>

COPYRIGHT

       Copyright 2003, 2004, 2005, 2006 by Audrey Tang <autrijus@autrijus.org>.

       This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

       See <http://www.perl.com/perl/misc/Artistic.html>

perl v5.14.2							    2012-02-24							      SCANDEPS(1p)