Newbie With Linux Clustering, Need Help!!

Tags
cluster, hpc, mesos, openstack, ubuntu, ubuntu 14.04

 
Thread Tools Search this Thread
# 1  
Old 08-05-2016
Newbie With Linux Clustering, Need Help!!

Hi All,
I am new user here and a new one to try clustering with Ubuntu nodes, and need help. If I should be in another place please mention.

I have a two nodes with Ubuntu 14.04 installed on them. I need to make a cluster consisting of these two nodes with purpose of experimentation with cloud and HPC technologies.

My question is , is there something basic I should be doing without getting into big names like Hadoop, Openstack , Mesos etc, which I assume should be discussed after a simple cluster is setup?

Can someone point me or mention a way to setup a simple test cluster of the two nodes , which run ubuntu 14.04, and then mention what to install to keep track of resources and running HPC applications on the cluster.

Many thanks and sorry if this is naiive. I intend not to remain so anymore Smilie Appreciate any help.
# 2  
Old 08-05-2016
There are different types of clusters, and hence, different cluster software.
Some of it is free opensource.

Here is a sort of chart about types of cluster functions and the software that you need. Pick one. That runs Ubuntu.
Comparison of cluster software - Wikipedia, the free encyclopedia.

Your question was vague, this is the best I can do without asking lots of questions that will require you to make decisions. Like: do I need another, third box? Or not.

Based on your two box setup, you may need to consider something called a quorum controller (master is another name) which is a member of the cluster that acts as a referee or even the main controller. Often this means having more than two boxes in a cluster. Read about the cluster software and see.

Edit:
Here is an example of what installing an Ubuntu cluster means:
MpichCluster - Community Help Wiki

Last edited by jim mcnamara; 08-05-2016 at 10:20 PM..
# 3  
Old 08-06-2016
Jim,
Thanks so much. I understand that the question was a bit vague, but it was because of too much information about relevant and related technologies going around.
I could not ask clearly that I need to start with a simple cluster and then try out some of these sophisticated tools.

I will make use of the chart and the link about the MPICH cluster.
I can try it alright, but there is a potential problem in near future that I can foresee. I have an application to run with OpenMPI. So if I install a MPICH cluster, can I then Install OpenMPI and run the MPI application with it instead of MPICH implementation??

thanks again!!
# 4  
Old 08-06-2016
A lot of cluster technologies use openMPI. I do not know for sure. I do know that Sun Solaris cluster V7 was based MPI and Sun actively contributed to development. Oracle does not do that now, AFAIK.

Try it. You will have openMPI installed already BTW. Why do you think MPI would no longer function? It is simply a "layer".

|
Thread Tools Search this Thread
Search this Thread:
Advanced Search

More UNIX and Linux Forum Topics You Might Find Helpful
Application clustering in Linux Ubuntu Jewel100 Ubuntu 2 11-29-2012 11:35 PM
Linux os clustering mohitj.engg Linux 2 06-21-2012 11:11 AM
Need help with simple Linux commands - NEWBIE here! loverangerguy UNIX for Dummies Questions & Answers 1 02-03-2012 12:05 PM
Linux newbie scripting help needed (timer) Pop45398 Shell Programming and Scripting 1 01-03-2012 01:38 AM
Linux Clustering karlochacon UNIX for Dummies Questions & Answers 0 08-04-2011 12:45 AM
newbie: Linux Server Names & Types..!!! salman103 Red Hat 3 09-16-2009 01:13 AM
Newbie at Linux Kernel programming! rohitrajjain Fedora 7 08-29-2009 11:16 AM
Clustering Red Hat Enterprise linux Advanced Platform 5.2 (x86-64 bit) kgayyar Red Hat 1 04-20-2009 12:30 PM
Newbie Linux balumankala Red Hat 6 07-29-2008 05:03 PM
Clustering solution for RH Linux AS and Solaris x86/AMD 64 izy100 UNIX for Advanced & Expert Users 3 03-03-2005 12:01 AM
Newbie: RH Linux: Mounting vfat as readable D-Lexy Filesystems, Disks and Memory 4 11-17-2002 09:41 PM
Linux Newbie sajjan2 UNIX for Dummies Questions & Answers 1 04-05-2002 08:24 AM
linux newbie question... Corey UNIX for Dummies Questions & Answers 5 02-10-2002 05:31 PM
Unix/Linux Newbie(ish) Question - IPC/Signals theultimatechuf Programming 2 01-20-2002 11:38 PM
Is Linux 7.2 Redhat a good start for a newbie derek UNIX for Dummies Questions & Answers 6 01-09-2002 11:16 PM