Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to make this run in multiple threads
Top Forums Shell Programming and Scripting How to make this run in multiple threads Post 302504516 by kzenthil on Monday 14th of March 2011 07:52:53 PM
Old 03-14-2011
Run Perl script in multiple threads
Hi,
I have a list of URLs in a csv file which I'm checking for page status. It just prints the URL and the status as output. This works perfectly fine.
I'm looking to run this in multiple threads to make this process faster.

I'm pretty new to Perl and I managed to complete this. It would be helpful if someone help me out with multiple threading.

Right now I use
Code:
perl checkURLs.pl check.csv > /tmp/results.txt

Code:
#!/usr/bin/perl

use strict;

while (my $line = <>){
  my $url = $line;
  $url =~ s/[ *\\]*\n//g;
  my $page = `curl -s -D - $url`;
  if ($page =~ /^HTTP\/\d.\d (\d+)/){
    print "$url status: $1\n";
  } else {
    print "Could not get page status\n";
  }
}

Last edited by kzenthil; 03-14-2011 at 10:22 PM..
 

10 More Discussions You Might Find Interesting

1. Programming

How to use pipe() in multiple threads?

Hi, I have a program that runs two threads in stead of two processes. I want to use pipe to redirect the output of the first thread to the input of the second thread. One thread is continuously writing to a pipe, and the other thread will read from the pipe. How do I do that? Is there... (2 Replies)
Discussion started by: wminghao
2 Replies

2. Programming

synchronizing multiple threads in unix

hi all! I wanted to know how to synchronize multiple threads in unix It would be better if someone give some code samples Thanx (1 Reply)
Discussion started by: bankpro
1 Replies

3. IP Networking

How to choose Multiple process or Multiple threads?

Hi All, Please explain me when i have to use multiple process and when I have to use Multiple threads? Please give me an example.It will be very helpful for me. Thanks in advance. (0 Replies)
Discussion started by: ashleykumar
0 Replies

4. Programming

how can I get to know what threads run within process java.exe on windows

I am writing java application on windows. There are more than 100 threads run within java.exe. I want to know what threads run within process java.exe so that I can find out if there are abnormal java threads. (4 Replies)
Discussion started by: mika
4 Replies

5. UNIX for Dummies Questions & Answers

Copy files in Multiple Threads

Hello all, I have a directory of files of varying sizes. I want to copy all these files in n number of threads to another directory such that each copy set is more or less the same size. Example : Say /mydirA It has around say 23 files of various sizes. Number of copy... (0 Replies)
Discussion started by: samoo
0 Replies

6. Shell Programming and Scripting

Multiple Threads/Tasks to run parallely using the shell script

Scenario: I have two PCs (named as A & B) which would send some traps to my third PC (named as C). In PC C, I have to write a shell script such that it should accept the datas from both the PC-A & B parallely. So my question is, is it possible to have two different child threads/tasks... (2 Replies)
Discussion started by: nthiruvenkatam
2 Replies

7. Shell Programming and Scripting

Make script that run with argument if not run from configuration file argument

Hello, Is there any method thorugh which script can take argument if pass otherwise if argument doesn't pass then it takes the argument from the configuration file i.e I am workiing on a script which will run through crontab and the script will chekout the code ,zip and copy to the... (3 Replies)
Discussion started by: rohit22hamirpur
3 Replies

8. Shell Programming and Scripting

How to start multiple threads in Solaris?

Hello, In a unix Solaris environment, (for simulation) how to start multiple threads (as Light Weight Process, not background process)? thanks, J. (7 Replies)
Discussion started by: seafan
7 Replies

9. Shell Programming and Scripting

Need to create multiple threads

Hi , i need to run multiple scripts parallely ,on my server....i have 8 cpus . planning to run minimum of 6 scripts paralley ....could you please suggest someone . thanks in advance , (3 Replies)
Discussion started by: Huvan
3 Replies

10. Shell Programming and Scripting

Run a shell script in a loop with max number of threads

hi guys. i have a question for you i have a one file and inside this file there are 1000 lines and each line is a linux command running this commands takes long time so i want to create one bash script and run this lines in a loop with max number of threads for example i want to run... (2 Replies)
Discussion started by: avtaritet
2 Replies

LEARN ABOUT DEBIAN

dimbl

dimbl(1)						      General Commands Manual							  dimbl(1)

NAME

       dimbl - Distributed Timbl

SYNOPSYS

       dimbl [timbl options] [-S <num of threads>]

DESCRIPTION

       dimbl extends timbl with the possibility to run the classification task on multiple threads.  This is done by splitting up the Instancebase
       in parts that are handled in parallel. Every test instance is tested against each partial Instancebase.	The results are  merged  and  then
       the k Nearest Neighbours are calculated.

NOTES

       dimbl only works for the IB1 variants of timbl.

       Not all timbl options are fully supported.

       Documentation is lacking.

OPTIONS

       -S <threads>
	      run the server on 'threads' parallel threads.

       all timbl options are documenented in timbl(1)

       dimbl handles most of them in the same way as timbl except for

       -i filename

       and

       -I filename

       -I will create 'threads' Instancebase files and store their names in 'filename' together with the name of the weighting file.

       -i  will use such a file to read back in 'threads' Instancebases for a classifying task. The -S option is ignored in that case.	dimbl will
       use the number of files found in 'filename'.

BUGS

       possibly

AUTHORS

       Ko van der Sloot Timbl@uvt.nl

       Antal van den Bosch Timbl@uvt.nl

SEE ALSO

       timbl(1)

								 2010 december 09							  dimbl(1)
All times are GMT -4. The time now is 07:14 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy