Sponsored Content
Full Discussion: Parallel processing
Top Forums Shell Programming and Scripting Parallel processing Post 302969164 by garethsays on Friday 18th of March 2016 10:56:45 PM
Old 03-18-2016
Parallel processing

I have 10,000 + files, each of which I need to zip using bzip2.

Is ti possible to use bash to create 8 parallel streams sending a new file to be processed from the list when one of the others has finished?
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to do parallel processing??

Hi All, I am working on solaris 8 sparc machine with 2 cpu. I am trying to run my application which generates files. I run multiple instance of the application, but the results don't seem to show as if it were runing parallely. When i run the application once it takes 12 secs to generate a... (1 Reply)
Discussion started by: zing
1 Replies

2. Shell Programming and Scripting

parallel processing

Hi I want to run two shell script files parallely. These two scripts are interacting with the database. can any body help on this Pls Regards Audippa naidu.M (3 Replies)
Discussion started by: audippa
3 Replies

3. Shell Programming and Scripting

Need Help With Parallel Processing

Hi I am looking for some kind of feature in unix that will help me write a script that can invoke multiple processes in parallel. And make sure that the multiple parallel processes complete successfully before I proceed to the next step. Someone suggested something called timespid or... (6 Replies)
Discussion started by: imnewtothis23
6 Replies

4. Shell Programming and Scripting

parallel processing

hi i am preparing a set of batches for a set of files sequentially There is a folder /xyz where all the files reside now all the files starting with 01 - will be appended for one below other to form a batch batch01 then all the files starting with 02 - will be appended for one below other to... (7 Replies)
Discussion started by: mad_man12
7 Replies

5. Shell Programming and Scripting

How to make parallel processing rather than serial processing ??

Hello everybody, I have a little problem with one of my program. I made a plugin for collectd (a stats collector for my servers) but I have a problem to make it run in parallel. My program gathers stats from logs, so it needs to run in background waiting for any new lines added in the log... (0 Replies)
Discussion started by: Samb95
0 Replies

6. Shell Programming and Scripting

script parallel processing

How to write script which run multiple scripts parllely, i have script called A,which has to execute B,C,D,E scripts parllely.. (2 Replies)
Discussion started by: machpee
2 Replies

7. Shell Programming and Scripting

PARALLEL PROCESSING IN PERL

HI All, I have scenerio where I need to call sub modules through for loop for (i=0; i<30 ;i++) { .. .. .. subroutine 1; subroutine 2; } I want this to be run in parallel process1 { ... ... subroutine 1; subroutine 2; (0 Replies)
Discussion started by: gvk25
0 Replies

8. Shell Programming and Scripting

Parallel processing in bash?

Hi Say I am interested in processing a big data set over shell, and each process individually takes a long time, but many such processes can be pipe-lined, is there a way to do this automatically or efficiently in shell? For example consider pinging a list addresses upto 5 times each. Of... (5 Replies)
Discussion started by: jamie_123
5 Replies

9. Shell Programming and Scripting

Implement parallel processing

Unix OS : Linux 2.6x Shell type : Korn Hi all , This is a requirement to incorporate parallel processing of a Unix code . I have two pieces of unix code , one of which will act as a parent process . This script will invoke multiple ( say four ) instances of the second script at one go... (13 Replies)
Discussion started by: kumarjt
13 Replies

10. Shell Programming and Scripting

Parallel processing - continued

Hi, I am taking up the cue from where I was left in my earlier post ( link given below ) https://www.unix.com/shell-programming-scripting/231107-implement-parallel-processing.html I actually wanted to know the significance of using the Unix "wait" , which returns the control from background to... (3 Replies)
Discussion started by: kumarjt
3 Replies
ARK(1)								 KDE User's Manual							    ARK(1)

NAME
ark - KDE archiving tool SYNOPSIS
ark [-b] [-a] [-e] [-c] [-f suffix] [-p] [-t file] [-d] [-o directory] [KDE Generic Options] [Qttm Generic Options] DESCRIPTION
Ark is a program for managing various compressed file formats within KDE. Archives can be viewed, extracted, created and modified with Ark. The program can handle various formats such as tar, gzip, bzip2, zip, rar (when the appropriate libraries or command-line programs are in- stalled). OPERATION MODES
Ark can be used either as a stand-alone GUI program as well as a command-line program in order to perform some specific tasks. If invoked without the -b (--batch) or -c (--add) options, Ark is started as a normal GUI program. When the -b (--batch) option is used, Ark can be used to extract the contents of one or more files directly from the command-line, without launching its GUI. When the -c (--add) option is used, Ark prompts for files that should be added to a new archive or to an existing archive. OPTIONS
-d, --dialog Show a dialog for specifying the options for a batch or add operation. -o, --destination directory Default the extraction directory to directory. If not passed, the current path is used. Options for adding files -c, --add Query the user for an archive filename and add specified files to it. Quit when finished. -t, --add-to filename Add the specified files to filename. Create archive if it does not exist. Quit when finished. -p, --changetofirstpath Change the current directory to the first entry and add all other entries relative to this one. -f, --autofilename suffix Automatically choose a filename, with the selected suffix (for example rar, tar.gz, zip or any other supported types). Options for batch extraction b, --batch Use the batch interface instead of the usual dialog. This option is implied if more than one url is specified. -e, --autodestination The destination argument will be set to the path of the first file supplied. -a, --autosubfolder Archive contents will be read, and if detected to not be a single folder archive, a subfolder by the name of the archive will be created. EXAMPLES
ark --batch archive.tar.bz2 Will extract archive.tar.bz2 into the current directory without showing any GUI. ark -b -d archive.tar.bz2 archive2.zip Will first show an extraction options dialog and then extract both archive.tar.bz2 and archive2.zip into the directory chosen in the dialog. ark --add-to my-archive.zip photo1.jpg text.txt Will create my-archive.zip if does not exist and then add photo1.jpg and text.txt to it. AUTHORS
Ark is currently maintained by Harald Hvaal <haraldhv@stud.ntnu.no> and Raphael Kubo da Costa <kubito@gmail.com>. This man page was first written by Lauri Watts <lauri@kde.org> in 2005 for KDE 3.4, and was later updated in 2009 by Raphael Kubo da Costa <kubito@gmail.com>. AUTHORS
Lauri Watts, Raphael Kubo da Costa. K Desktop Environment 2009-09-10 ARK(1)
All times are GMT -4. The time now is 11:01 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy