Hi all,
Today, I want to ask how to submit multiple qsub jobs.
I want to submit 100 .sh files for the simulations.
The name of files is run_001.sh, run_002.sh, run_003.sh,
.....
..... run_100.sh
Submitting each file manually are time-consuming, hence, I want to make another .sh file (runAllFile.sh) for just submitting those files at once.
The code of runAllFile.sh is as follows:
I think if I submit the runAllFile.sh file, it will submit all run_*.sh files to the machine.
However, I have received an error when I try to submit runAllFile.sh by "qsub runAllFile.sh".
This is an error message:
Could you please help me solve this problem?
Thanks for your time and consideration.
Last edited by Don Cragun; 10-30-2015 at 06:58 PM..
Reason: Add CODE and ICODE tags.
You could also get an error message like that if you created runAllFile.sh with an editor that uses DOS (<carriage-return><newline>) line terminators instead of UNIX/Linux (<newline>) line terminators.
So, if tcsh on your system is in /usr/bin/tcsh (instead of /bin/tcsh where it is located on many systems) try:
and look for characters displayed as \r.
I found that, if this is "bash", "foreach" does not work.
I use "for" instead.
Hence, I have modified the code as follows:
Nonetheless, I have received an error:
I have two scripts which I'm tying to run one after the other- this is what I've tried:
00 14 * * * /path/one.sh && /path/two.sh
I've also tried putting each script on a different line:
00 14 * * * /path/one.sh
00 14 * * * /path/two.sh
Can this be done? (1 Reply)
I have multiple jobs and each job dependent on other job.
Each Job generates a log and If job completed successfully log file end's with JOB ENDED SUCCESSFULLY message and if it failed then it will end with JOB ENDED with FAILURE.
I need an help how to start.
Attaching the JOB dependency... (3 Replies)
Hi
I am new to submitting jobs. I am trying to submit my perl file to the cluster.
This is what my shell file looks like (shell1.sh):
#!/bin/sh
#$ -S /bin/sh
cd data/projects/mydir/abbc
perl autocorro.pl
followed by qsub shell1.sh
It takes the qsub, but does nothing. I check... (1 Reply)
Hi,
I ran two crontab commands
using:
crontab program1
crontab program2
However when I type crontab -l only the second cron job shows up, how do I see all cron jobs running and how do I edit all at the same time
Thanks in Advance
S:D (10 Replies)
I have a sequence of tasks that I routinely run and I'm trying to parallelize certain portions of the sequence. Specifically, there are 3 tasks which all read from the same file, each performing different operations and writing to their own seperate file. I was wondering if I could execute these... (3 Replies)
Hello,
I have a perl script that takes in one file of input and outputs to a file. I would like to run this script on several input files, and I would like to run it with qsub, something like this:
Input files:
FileListDssp.txt.numaa
FileListDssp.txt.numab
FileListDssp.txt.numac
etc..
... (1 Reply)
Hello,
I would like to write a perl script which executes several jobs. The key thing is I only want 4 jobs to be executed at one time (that's because my machine as 4 cpu, and I want one job per cpu). Is there any way that I can get perl to co-operate with me in this?
Thanks! (1 Reply)
I have a list of jobs. their expected start time and their expected duration.
my needs are
monitor multiple jobs (starting at different time and their execution time also differs)
Need to mail if any of the job running longer than its expected duration.
Whats the efficient way to scripting... (1 Reply)
Is there any way I can submit a job to a remote machine and return immediately without withing for the job to finish?
What I mean is this...using rsh I can submit a job to a remote machine like this:
rsh remotemac1 job.sh
But this doesn't return untill the job has finished and as a... (3 Replies)
I have an ftp user, which has been setup to run ftp jobs to a specific machine (different jobs). for the first job i created .netrc in the ftp users home directory and added the appropriate commands
machine FTPBOX01 login user1 password xxx
macdef init
etc
etc
get file
bye
I use the... (3 Replies)