pegasus-transfer - Handles data transfers in Pegasus workflows.
[-l level] [-f inputfile]
pegasus-transfer takes a list of url pairs, either on stdin or with an input file, determines the correct tool to use for the transfer and
executes the transfer. Some of the protocols pegasus-transfer can handle are GridFTP, SRM, Amazon S3, HTTP, and local cp/symlinking. Failed
transfers are retried.
OPTIONS -h, --help
Prints a usage summary with all the available command-line options.
-l level, --loglevel level
The debugging output level. Valid values are: debug, info, warning, error. Default value is info.
-f inputfile, --file inputfile
File with input pairs. If not given, stdin will be used.
Maximum number of attempts for retrying failed transfers.
Pegasus Team http://pegasus.isi.edu
Check Out this Related Man Page
pegasus-remove - removes a workflow that has been planned and submitted using pegasus-plan and pegasus-run
pegasus-remove [-d dagid] [-v] [rundir]
The pegasus-remove command remove a submitted/running workflow that has been planned and submitted using pegasus-plan and pegasus-run. The
command can be invoked either in the planned directory with no options and arguments or just the full path to the run directory.
By default pegasus-remove does not require any options or arguments if invoked from within the planned workflow directory. If running the
command outside the workflow directory then a full path to the workflow directory needs to be specified or the dagid of the workflow to be
pegasus-remove takes the following options:
-d dagid, --dagid dagid
The workflow dagid to remove
Raises debug level. Each invocation increase the level by 1.
Is the full qualified path to the base directory containing the planned workflow DAG and submit files. This is optional if
pegasus-remove command is invoked from within the run directory.
If the workflow is removed successfully pegasus-remove returns with an exit code of 0. However, in case of error, a non-zero exit code
indicates problems. An error message clearly marks the cause.
The following files are opened:
This file is located in the rundir. pegasus-remove uses this file to find out paths to several other files.
The path variable is used to locate binary for condor_rm.
SEE ALSO pegasus-plan(1), pegasus-run(1)AUTHORS
Gaurang Mehta <gmehta at isi dot edu>
Jens-S. Vockler <voeckler at isi dot edu>
Pegasus Team http://pegasus.isi.edu
I have a huge matrix file containing some 1.5 million rows and 6000 columns. The matrix looks something like this:
1 2 3
4 5 6
7 8 9
3 4 5
I want to add all the numbers in the columns of this matrix and display the result to my stdout. This means that the numbers in the first column are:
... (2 Replies)
Just trying to get to grips with sed and awk for some reporting for work and I need some assistance:
I have a file that lists policy names on the first line and then on the second line whether the policy is active or not.
Policy Name: Policy1
Policy... (8 Replies)
version info :
vi availabe with RHEL 5.4
I have a text file with 10,000 lines. I want to copy lines from 5000th line to 7000th and redirect to a file. Any idea how I can do this?
The above scenario is just an example. In my actual requirement, the file has 14 million lines and I want... (9 Replies)
I know the following questions are noobish questions but I am asking them because I am confused about the basics of history behind UNIX and LINUX.
Ok onto business, my questions are-:
Was/Is UNIX ever an open source operating system ?
If UNIX was... (21 Replies)
I couldn't find an actual introduction thread, so I decided to just put this here.
I go by d0wngrade online. I have been programming in multiple languages for about 15+ years. I started with standard web design languages like HTML and CSS, but I then advanced from design to development... (2 Replies)
The first active code line in AudioScope.sh is set -u .
This causes a complete exit if a variable is used/found but has not been allocated at the start of the program.
However, apart from writing code to do the task, is there a switch to to check which variables have been... (17 Replies)
In thread https://www.unix.com/shell-programming-and-scripting/267833-grouping-counting.html rovf and I had a mini-discussion on grep and awk.
Here is a demo script that compares the awk and grep approaches for this single problem:
# @(#) s2 Demonstrate group... (1 Reply)
I have to fish out some specific columns from a file based on the header value. I have the list of columns I need in a different file. I thought I could read in the list of headers I need,
# file with header names of required columns in required order
# read contents... (11 Replies)
For those interested in installing dash shell on OSX Lion to help test POSIX compliancy of shell scripts, it is quite easy. I did it like this:
If you don't have gcc on your system:
0. Download and install the Command Line Tools for Xcode package from Sign In - Apple *
1. Download the dash... (2 Replies)
Hello and thanks in advance for any help anyone can offer me
I'm trying to learn the find command and thought I was understanding it... Apparently I was wrong. I was doing compound searches and I started getting weird results with the -size test. I was trying to do a search on a 1G file owned by... (14 Replies)
I have data of an excel files as given below,
org1_1 1 1 2.5 100
org1_2 1 2 5.5 98
org1_3 1 3 7.2 88
org2_1 1 1 2.5 100
org2_2 1 2 5.5 56
org2_3 1 3 7.2 70
I have multiple excel files as above shown.
I have to copy column 1, column 4 and paste into a new excel file as... (26 Replies)
Taking a break from Vue.js coding for the site, SEO and YT videos; and hopefully addressing some well deserved criticism from some here that I have been too focused on the visual aspects of the forums versus the substance and the community....
While the "current generation... (9 Replies)
Well guys and gals, I jumped in at the deep end and found things that PERL cannot do by default.
Many tricky terminal escape codes are not catered for so I had to create workarounds.
One thing I searched for was this:
Passing perl variable to shell command
AND, @Neo this was... (15 Replies)