Sun Grid Engine (SGE) scripts - processors?

 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers Sun Grid Engine (SGE) scripts - processors?
# 1  
Old 03-31-2017
Sun Grid Engine (SGE) scripts - processors?

Hi,

I was trying to run a program that calls 8 processors (with max. RAM of 2 GB per processor). I want to run this program on my cluster that runs SGE. The cluster has 2 nodes, and each node has 62 cores, and 248GB/node. Currently, I use the scripts below, but the program (softx below) crashes out after a little while (it runs but exits without any exception) and I am wondering if I am doing something wrong. Here are my scripts:

submit.sh:
=========
Code:
#!/bin/bash

#$ -l mem_free=32G

softx /home/pc/code/test.sh

==========

I submit this on SGE with the following command:

Code:
qsub -q long.q submit.sh

Should I be specifying the number of processors that are generated by softx? If so, how do I do that?

thanks!


Moderator's Comments:
Mod Comment Please use CODE tags as required by forum rules!


---------- Post updated at 10:20 AM ---------- Previous update was at 06:04 AM ----------

Here are the details. Which limit was exceeded? And how can I rectify?


Code:
  % qacct -j 7408
==============================================================
qname        long.q
hostname     node02.local
department   defaultdepartment
jobname      submit.sh
jobnumber    7408
taskid       undefined
account      sge
priority     0
qsub_time    Fri Mar 31 08:44:26 2017
start_time   Fri Mar 31 08:44:41 2017
end_time     Fri Mar 31 09:11:09 2017
granted_pe   NONE
slots        1
failed       37  : qmaster enforced h_rt, h_cpu, or h_vmem limit
exit_status  137                  (Killed)
ru_wallclock 1588s
ru_utime     0.110s
ru_stime     0.190s
ru_maxrss    5.520KB
ru_ixrss     0.000B
ru_ismrss    0.000B
ru_idrss     0.000B
ru_isrss     0.000B
ru_minflt    25267
ru_majflt    0
ru_nswap     0
ru_inblock   0
ru_oublock   176
ru_msgsnd    0
ru_msgrcv    0
ru_nsignals  0
ru_nvcsw     351
ru_nivcsw    95
cpu          10096.930s
mem          429.730GBs
io           76.911GB
iow          0.000s
maxvmem      8.635GB
arid         undefined
ar_sub_time  undefined
ar_sub_time  undefined

category     -q long.q -l h_rt=172800,mem_free=48G


Moderator's Comments:
Mod Comment SERIOUSLY: Please use CODE tags for code AND data as required by forum rules!

Last edited by RudiC; 03-31-2017 at 02:18 PM.. Reason: Added CODE tags.
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Submit a qsub script SGE

Hello, I'm working on a SGE cluster and trying to echo the variables passed to the qsub command. My script is as follows #!/bin/bash #$ -V #$ -cwd #$ -pe make 10 if ; then echo "Variable is not set" else echo "Variable says: $StatedUserName" fi and I run the... (1 Reply)
Discussion started by: nans
1 Replies

2. Shell Programming and Scripting

SGE submit script

Hi, I'm trying to edit my working bash script to an SGE script in order to submit it as a job to the cluster. Currently I have: #!/bin/bash # Perform fastqc on files in a specified directory. for ((j=1; j <=17; j++)) do directory=/data4/una/batch"$j"/ ... (0 Replies)
Discussion started by: una1992
0 Replies

3. UNIX and Linux Applications

Looking to reduce the number a cpus available for SGE

Hey all Im looking to reduce the number of cpus available on a certain node in our cluster available for jobs using SGE. i.e. we have one node that has 24 cpus available for jobs on SGE, i would like to reduce that to 16. Thanks (1 Reply)
Discussion started by: olifu02
1 Replies

4. Shell Programming and Scripting

Request for help with SGE submission script manipulation

Hi, I have the following SGE submission (HPC calculation) script, which is just a Bash script: #!/bin/bash -l #$ -S /bin/bash #$ -l h_rt=1:00:0 #$ -l mem=4G #$ -N XXX #$ -pe qlc 24 #$ -P XXX #$ -wd /home/uccaxxx/Scratch/222PdT/3vac/c0001/ mpirun -m $TMPDIR/machines -np $NSLOTS... (2 Replies)
Discussion started by: crunchgargoyle
2 Replies

5. Hardware

sun x4100 M2 processors

hi please how to know that a sun x4100 m2 server has one or two processors installed ?? the OS installed on this server is windows 2003 Enterprise Edition. thanks (2 Replies)
Discussion started by: bahjatm
2 Replies

6. Solaris

How to activate "high" priority queues for codine (Sun Grid Engine) under solaris 10

How to activate "high" priority queues for codine (Sun Grid Engine) under solaris 10? What are the steps? (0 Replies)
Discussion started by: ionrivera
0 Replies

7. High Performance Computing

Alternative to Sun Grid Engine

Does anybody know of a good alternative to Sun Grid Engine? It seems that Oracle is now charging for this software. I am running a HPC cluster that has Solaris 10 machines and I am adding some nodes that will be running Ubuntu 10.04, eventually the Solaris machines will be migrating to Ubuntu. (0 Replies)
Discussion started by: ccj4467
0 Replies

8. Shell Programming and Scripting

2 shell scripts in Sun Solaris

Hi, Can somebody pls help me? I need to write 2 shell scripts in Sun Solaris operating system which would do this: 1. go to the specified directory - I am using alias for it at the moment 2. start the particular sql script with the output log as same as the script but with timestamp e. g.... (4 Replies)
Discussion started by: balco
4 Replies
Login or Register to Ask a Question