Parallel processing for functions in xargs


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Parallel processing for functions in xargs
# 8  
Old 05-19-2015
There is no reason to moan about rule 5. You joined the forum and accepted the rules. This forum is not meant to grow by redundant threads so it's absolutely legit to make you notice.
The rules are made by the people that provide this forum - it is not your forum.

So please stop moaning about the absolutely legit answers. If you have the feeling to continue making a drama where there is no need at all, you can do this elsewhere.
So the choice is yours and if you need help with that, speak up.

Last edited by zaxxon; 05-19-2015 at 08:51 AM..
These 2 Users Gave Thanks to zaxxon For This Post:
# 9  
Old 05-19-2015
Hi.
Quote:
Originally Posted by jawsnnn
I came to realize that implementing this within my solution would require too much complexity for a small performance gain. I would use parallel but that requires installation of the utility (not an option for me unfortunately.). I am going with my original approach for
The post by tange ( the author of parallel -- History of GNU Parallel - GNU Project - Free Software Foundation ) says install, but, for me, that is simply placing the code (a perl script) someplace in my PATH (like many people, I use ~/bin). Not complicated, does not require special permissions.

I update parallel every now and then, and am currently using parallel GNU parallel 20111122. The latest appears to be from 22-Apr-2015.

Best wishes ... cheers, drl
This User Gave Thanks to drl For This Post:
# 10  
Old 08-07-2015
Quote:
Originally Posted by zaxxon
There is no reason to moan about rule 5. You joined the forum and accepted the rules. This forum is not meant to grow by redundant threads so it's absolutely legit to make you notice.
The rules are made by the people that provide this forum - it is not your forum.

So please stop moaning about the absolutely legit answers. If you have the feeling to continue making a drama where there is no need at all, you can do this elsewhere.
So the choice is yours and if you need help with that, speak up.
I did make the choice of not contributing to this forum anymore shortly after checking out which is why I did not see your reply. Sorry if this comes too late, but I believe you are in violations of rules 1, 2 and 3 yourself.

Frankly, the whole thread leaves a bad taste in my mouth. I did not believe that a technical forum could have such a high level of finger pointing for a question that is definitely not "how do I list out files in my current directory" simple.

I find your post offensive, irrelevant to the discussion and your usage of certain terms (drama, moan) obnoxious, but that's just me. Others may see it differently and agree with you because believe it or not, I agree that the original post by sea had merit. But know that your manner of pointing it out was the absolute worst amongst all who cared to do so.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Parallel processing

I have 10,000 + files, each of which I need to zip using bzip2. Is ti possible to use bash to create 8 parallel streams sending a new file to be processed from the list when one of the others has finished? (1 Reply)
Discussion started by: garethsays
1 Replies

2. Shell Programming and Scripting

Pass parameters to a function and running functions in parallel

Hi , I have a script which is using a text file as I/P. I want a code where it reads n lines from this file and pass the parameters to a function and now this script should run in such a way where a function can be called in parallel with different parameters. Please find below my script, it... (1 Reply)
Discussion started by: Ravindra Swan
1 Replies

3. Shell Programming and Scripting

Calling multiple functions in parallel

Hello, I have multiple functions within a shell script. eg. function_database_backup, unix_tar_creation, etc. I would like to run these functions in parallel, as each is independent of the other. If these were simple commands, I could have probably run each of the commands in background. ... (1 Reply)
Discussion started by: neil.k
1 Replies

4. Programming

Algorithms for Parallel Processing

Hey, I just wanted to know how many algorithms there are that cannot be accelerated by parallel processing. I know one such algorithm is Euclid's Algorithm (for GCF). does anyone know any other algorithms that cannot be accelerated by pp? if so please list the names and a general sentence of what... (2 Replies)
Discussion started by: azar.zorn
2 Replies

5. Shell Programming and Scripting

How to make parallel processing rather than serial processing ??

Hello everybody, I have a little problem with one of my program. I made a plugin for collectd (a stats collector for my servers) but I have a problem to make it run in parallel. My program gathers stats from logs, so it needs to run in background waiting for any new lines added in the log... (0 Replies)
Discussion started by: Samb95
0 Replies

6. Shell Programming and Scripting

Using xargs for multiple functions

Hi Experts, I am trying to parse some syslog outputs into a separate file per node using the below syntax but am having issues when it comes to my Xargs statements. The command which I was intending on using was: cat syslogs | nawk '/From/ { print $3 }' | uniq | xargs -I {} grep {}... (5 Replies)
Discussion started by: krypton
5 Replies

7. Shell Programming and Scripting

parallel processing

hi i am preparing a set of batches for a set of files sequentially There is a folder /xyz where all the files reside now all the files starting with 01 - will be appended for one below other to form a batch batch01 then all the files starting with 02 - will be appended for one below other to... (7 Replies)
Discussion started by: mad_man12
7 Replies

8. Shell Programming and Scripting

Need Help With Parallel Processing

Hi I am looking for some kind of feature in unix that will help me write a script that can invoke multiple processes in parallel. And make sure that the multiple parallel processes complete successfully before I proceed to the next step. Someone suggested something called timespid or... (6 Replies)
Discussion started by: imnewtothis23
6 Replies

9. Shell Programming and Scripting

parallel processing

Hi I want to run two shell script files parallely. These two scripts are interacting with the database. can any body help on this Pls Regards Audippa naidu.M (3 Replies)
Discussion started by: audippa
3 Replies

10. UNIX for Dummies Questions & Answers

How to do parallel processing??

Hi All, I am working on solaris 8 sparc machine with 2 cpu. I am trying to run my application which generates files. I run multiple instance of the application, but the results don't seem to show as if it were runing parallely. When i run the application once it takes 12 secs to generate a... (1 Reply)
Discussion started by: zing
1 Replies
Login or Register to Ask a Question