09-11-2011
Quote:
Originally Posted by
yazu
It's hard and unpleasant to read code without the description of your problem, comments and sample input/output. I'm going to admire a man who can help you.
sorry - I didnt think the purpose of code is relevant here. But these are the steps I am following in the code.
I have a 3 GB text file with DNA sequence reads.
1. I extract reads at specific line numbers
2. substitute reads containing some expressions. These expressions are chopped from a single DNA adapter sequence.
3. count the duplicates
4. extract reads of only >14 length.
5. add > sign and serial number and length to each read to make it suitable for downstream purposes.
It appears that the problem is stemming from too much usage of arrays. If I split the code and use filehandles, it is able to execute the code but still its taking a very long time.
I started to think that AWK is much faster than Perl.
thanks.
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
I have discovered a curious phenomenon in GCI. I need some advice from someone far more adept. Is this a bug or potential security weakness?
Context: Redhat 8.0 on xx86 (pentium 3) Apache 2.0, Perl 5.80
Background:
I've been trying to harden a web application which accepts user uploaded... (0 Replies)
Discussion started by: andyj
0 Replies
2. Programming
Hi, I try to marshal a unsigned int and a char * into a buffer, and then unmarshal them later to get them out. I need to put the char * in the front and unsigned int at the end of the buffer. However, my system always give me "BUS ERROR". I am using Sun Sparcs Sloris 2.10.
My code to marshal... (6 Replies)
Discussion started by: nj302
6 Replies
3. Shell Programming and Scripting
I dont know whether this is a common error but it seems my PERL program is running out of buffer memory. Inside a loop I am processing an array (reading elements and displaying in it--note: for every iteration of the loop the WHOLE array is being scanned once--...the array was created by reading a... (5 Replies)
Discussion started by: Abhishek Ghose
5 Replies
4. UNIX for Dummies Questions & Answers
Could somebody give links for memory detector for perl?
Thanks :) (4 Replies)
Discussion started by: matrixmadhan
4 Replies
5. Shell Programming and Scripting
I have a program that opens a file handle that reads a lot of logs, it uses globbing, for example ba* matches bananas.log, bank.log, etc. I have seven different names, each with several logs that I run to a grep pattern. I have subroutines for each match and a loop w/o args that processes this. ... (5 Replies)
Discussion started by: nj78
5 Replies
6. Shell Programming and Scripting
Hi,
Is there any known trick that will consume all of my memory and force my machine to swap? I'm scripting a monitor in perl that will alert me when available memory is dangerously low and system is swapping, and I would like to simulate the scenario. I am clueless how to make my system lack... (4 Replies)
Discussion started by: marcpascual
4 Replies
7. Shell Programming and Scripting
I currently have a statistics gathering script i run on my Linux servers. One of the stat i gather is total memory in the machine. The script is all perl with the exception of gathering the memory for that i use the following command:
$ram = (`cat /proc/meminfo | grep "MemTotal" | awk... (1 Reply)
Discussion started by: insania
1 Replies
8. Shell Programming and Scripting
Hi ,
when one of the perl script is being executed i am getting the following
error as out of memory,
when i check memory utilisation it is showing as 60% .
cp utilisation as 11%.
swap is free for 19 gb.
can anyone guide me to sort the above isssue.i want to know the root cause. (2 Replies)
Discussion started by: Ajoy
2 Replies
9. Shell Programming and Scripting
Hi,
I am having .csv files contains some row -
Info: Value of field name 'SecurityExchange' is not supported ","Original Order Tuple
Please see the below perl code carefully-
/Info: (+),Original (\w+) Tuple/ and do {
($category, $type) = ($1, $2);
if($type eq 'Execution')... (1 Reply)
Discussion started by: pspriyanka
1 Replies
10. Shell Programming and Scripting
I am getting a out of memory issue while executing the perl program.
Per version : /opt/acc_perl/lib/site_perl/5.14.2
Read in 54973 total records
Read in 54973 table records from table.
Out of memory!
so the job get failed due to out of memory. need to get rid of the out of memory... (3 Replies)
Discussion started by: ramkumar15
3 Replies
LEARN ABOUT DEBIAN
bio::tools::analysis::dna::esefinder
Bio::Tools::Analysis::DNA::ESEfinder(3pm) User Contributed Perl Documentation Bio::Tools::Analysis::DNA::ESEfinder(3pm)
NAME
Bio::Tools::Analysis::DNA::ESEfinder - a wrapper around ESEfinder server
SYNOPSIS
use Bio::Tools::Analysis::DNA::ESEfinder;
use strict;
my $seq; # a Bio::PrimarySeqI or Bio::SeqI object
$seq = Bio::Seq->new(
-primary_id => 'test',
-seq=>'atgcatgctaggtgtgtgttttgtgggttgtactagctagtgat'.
-alphabet=>'dna');
my $ese_finder = Bio::Tools::Analysis::DNA::ESEfinder->
new(-seq => $seq);
# run ESEfinder prediction on a DNA sequence
$ese_finder->run();
die "Could not get a result"
unless $ese_finder->status =~ /^COMPLETED/;
print $ese_finder->result; # print raw prediction to STDOUT
foreach my $feat ( $ese_finder->result('Bio::SeqFeatureI') ) {
# do something to SeqFeature
# e.g. print as GFF
print $feat->gff_string, "
";
# or store within the sequence - if it is a Bio::SeqI
$seq->add_SeqFeature($feat)
}
DESCRIPTION
This class is a wrapper around the ESEfinder web server which uses experimentally defined scoring matrices to identify possible exonic
splicing enhancers in human transcripts.
The results can be retrieved in 4 ways.
1. "$ese_finder->result('')" retrieves the raw text output of the program
2. "$ese_finder->result('all')" returns a Bio::Seq::Meta::Array object with prediction scores for all residues in the sequence
3. "$ese_finder->result('Bio::SeqFeatureI')" returns an array of Bio::SeqFeature objects for sequences with significant scores. Feature
tags are score, motif, SR_protein and method
4. "$ese_finder->result('raw')" returns an array of significant matches with each element being a reference to [SR_protein, position,
motif, score]
See <http://rulai.cshl.edu/tools/ESE2/>
This the second implentation of Bio::SimpleAnalysisI which hopefully will make it easier to write wrappers on various services. This class
uses a web resource and therefore inherits from Bio::WebAgent.
SEE ALSO
Bio::SimpleAnalysisI, Bio::WebAgent
FEEDBACK
Mailing Lists
User feedback is an integral part of the evolution of this and other Bioperl modules. Send your comments and suggestions preferably to one
of the Bioperl mailing lists. Your participation is much appreciated.
bioperl-l@bioperl.org - General discussion
http://bioperl.org/wiki/Mailing_lists - About the mailing lists
Support
Please direct usage questions or support issues to the mailing list:
bioperl-l@bioperl.org
rather than to the module maintainer directly. Many experienced and reponsive experts will be able look at the problem and quickly address
it. Please include a thorough description of the problem with code and data examples if at all possible.
Reporting Bugs
Report bugs to the Bioperl bug tracking system to help us keep track the bugs and their resolution. Bug reports can be submitted via the
web:
https://redmine.open-bio.org/projects/bioperl/
AUTHORS
Richard Adams, Richard.Adams@ed.ac.uk, Heikki Lehvaslaiho, heikki-at-bioperl-dot-org
APPENDIX
The rest of the documentation details each of the object methods. Internal methods are usually preceded with a _
perl v5.14.2 2012-03-02 Bio::Tools::Analysis::DNA::ESEfinder(3pm)