Sponsored Content
Full Discussion: Linux cluster
Special Forums UNIX and Linux Applications High Performance Computing Linux cluster Post 302384152 by otheus on Monday 4th of January 2010 07:23:20 AM
Old 01-04-2010
You indeed have a cluster of Linux servers. What you are trying to do is to get your cluster to perform certain tasks in parallel. There are three different kinds of tasks you can do: (1) system administration, (2) compilation and making, and (3) task execution. So far people have commented on a solution for (2) -- pdcc and make -j can be used for this -- and for (3) SGE, but also openmpi. For (1) -- administration -- having only 5 computers is small enough to do it by hand -- ie, use command-line and scripts to synchronize the hosts. But but you can also use parallelizing remote execution tools such as pdsh or mussh, or cluster tools such as flamethrower and rdist to make your life easier.

To get all of the above from scratch, I highly recommend ROCKS, which will install a standardized linux framework on all the hosts, complete with monitoring, and a fully integrated parallel execution environment based on whichever "Rolls" you select (ie, SGE or Torque; OpenMPI or MPICH; Intel CC or GNU CC; etc).
 

7 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

linux cluster

I have created a linux cluster using ROCKS. I have 4 comps hooked up now. front-end plus 3 nodes. Looking for way to test the system to see how effective it is (and if it actually works). Any help would be appreciated. (1 Reply)
Discussion started by: skatinsky
1 Replies

2. Linux

How to setup Parallel Cluster in Linux

Hi, Hi, I work in NGO. They are migrating from windows to Linux. They can't spend so much money on servers. They have around 50 PCs. So I want to setup cluster on 2-3 PCs or more than that for setting up server. I am excepted to get their collective output. So that it will be compatible with... (5 Replies)
Discussion started by: neel.gurjar
5 Replies

3. High Performance Computing

Building a Linux Virtual Server cluster

Hi Guys, I'm busy building a LVS-NAT cluster on Red-Hat server 5.1 and I need a kernel that has LVS capabilities for a red-hat server 5.1. Is the anyone who can advise me where I can get this kernel. I have already visited the following site Ultra Monkey: and this has old kernels e.g. 2.4.20... (2 Replies)
Discussion started by: Linux Duke
2 Replies

4. Red Hat

HA Cluster solution for Linux - which one to use?

Hi all experts, I need your kind suggestions or feedback on choice of clustering software for red hat linux nodes running certain applications which I need to make highly available. Minimum requirement is 2 nodes; all nodes shall be active-active running distinct applications e.g. node 1 runs... (1 Reply)
Discussion started by: pshaikh
1 Replies

5. Shell Programming and Scripting

linux cluster

Hi all, we have setup one cluster with two nodes. -drbd -corosync -pacemaker -mysql -piranha sometimes, we loose connection between the two nodes (node 1 and node 2). When this happens, the two nodes starts both the services as masters,because they don't see each other. is there any way... (2 Replies)
Discussion started by: arrals_vl
2 Replies

6. Red Hat

Linux Cluster failover issue

Hi Guys, I am not much aware of clusters but i have few questions can someone provide the overview as it would be very helpful for me. How can i perform cluster failover test to see all the services are failing back to other node ? If it is using veritas cluster then what kind of... (2 Replies)
Discussion started by: munna529
2 Replies

7. UNIX for Dummies Questions & Answers

Linux Cluster or HA

hi guys Back in 2009 and 2010 I configured some clusters using Linux HA Heartbeat version 2.1.4 for suse 10 SP3 now I see Linux HA heartbeat is kind of outdated last release 2011, since I have to configure 2 new clusters I was wondering what do you recommend for cluster tool nowadays? I... (0 Replies)
Discussion started by: karlochacon
0 Replies
CD-HIT-2D-PARA.PL(1)						   User Commands					      CD-HIT-2D-PARA.PL(1)

NAME
cd-hit-2d-para.pl - divide a big clustering job into pieces to run cd-hit-2d or cd-hit-est-2d jobs SYNOPSIS
cd-hit-2d-para.pl options DESCRIPTION
This script divide a big clustering job into pieces and submit jobs to remote computers over a network to make it parallel. After all the jobs finished, the script merge the clustering results as if you just run a single cd-hit-2d or cd-hit-est-2d. You can also use it to divide big jobs on a single computer if your computer does not have enough RAM (with -L option). Requirements: 1 When run this script over a network, the directory where you run the scripts and the input files must be available on all the remote hosts with identical path. 2 If you choose "ssh" to submit jobs, you have to have passwordless ssh to any remote host, see ssh manual to know how to set up passwordless ssh. 3 I suggest to use queuing system instead of ssh, I currently support PBS and SGE 4 cd-hit-2d cd-hit-est-2d cd-hit-div cd-hit-div.pl must be in same directory where this script is in. Options -i input filename for 1st db in fasta format, required -i2 input filename for 2nd db in fasta format, required -o output filename, required --P program, "cd-hit-2d" or "cd-hit-est-2d", default "cd-hit-2d" --B filename of list of hosts, requred unless -Q or -L option is supplied --L number of cpus on local computer, default 0 when you are not running it over a cluster, you can use this option to divide a big clustering jobs into small pieces, I suggest you just use "--L 1" unless you have enough RAM for each cpu --S Number of segments to split 1st db into, default 2 --S2 Number of segments to split 2nd db into, default 8 --Q number of jobs to submit to queue queuing system, default 0 by default, the program use ssh mode to submit remote jobs --T type of queuing system, "PBS", "SGE" are supported, default PBS --R restart file, used after a crash of run -h print this help More cd-hit-2d/cd-hit-est-2d options can be speicified in command line Questions, bugs, contact Weizhong Li at liwz@sdsc.edu cd-hit-2d-para.pl 4.6-2012-04-25 April 2012 CD-HIT-2D-PARA.PL(1)
All times are GMT -4. The time now is 01:05 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy