Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Newbie question about using a Cluster: using memory
Special Forums UNIX and Linux Applications High Performance Computing Newbie question about using a Cluster: using memory Post 302310359 by joespr on Friday 24th of April 2009 12:23:24 PM
Old 04-24-2009
Thanks Yogesh for the suggestion.

Hadoop does indeed looks very powerful, and somewhat overwhelming. It seems to have the ability to handle larger memory requirements than locally available, but in looking at the doc, I think it is overkill.

Also, it requires writing the application to meet Hadoop's requirements. Which won't fly in my situation.

The app I am dealing with is already written. What I get to start with is an executable, with no possibility of it being rewritten. So the environment needs to be standard Linux (there is a Windows version too, so that's a possibility too I guess, but I am trying to avoid the Windows world...).

Maybe I made an incorrect assumption that a possible use of a cluster might solve the problem. Perhaps there is an easier way?

Is there some Linux feature that would allow use of, say, local disk space that could be used to 'fake out' the application so the app sees that disk space as if it were memory (like maybe swap space)? That way if I had say a 1GB free amount of disk space, I could use it as if it was memory for an application that needed/required 1GB of memory even if the local machine only had 512MB of memory?

(Is this possible? Am I deluding myself about this as a possibility?)

Thanks for any advice.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

newbie question

hi im thinking of getting unix but i have no idea where to start I know that its an OS similar to linux but what hardware does in run on? i've heard of solaris but im not quit sure what it is thankxs (3 Replies)
Discussion started by: ninja
3 Replies

2. UNIX for Dummies Questions & Answers

Newbie Question...

Okay, I succesfully installed Redhat Linux 7.2 on my comp. I got some Linux drivers for my network card off the manufacturers site, but said driver is just some C source code. Does anybody have any idea what I do with it? Sorry for being vague... any help is greatly appreciated. (4 Replies)
Discussion started by: flopper
4 Replies

3. UNIX Desktop Questions & Answers

Newbie Question

I am fairly new to *nix/linux and I have just installed SuSe 8.2. I am wondering what skills would be good to learn. I know that I will need to learn how to write scripts, but what scripting languages should I learn. I greatly appreciate any and all comments. ... (5 Replies)
Discussion started by: Ntalektual
5 Replies

4. UNIX for Dummies Questions & Answers

Very new newbie question

sorry if im not asking inthe right spot but, how do you turn the beeping off every time you hit a key onthe keyboard. I tried the click -n but it told me it didnt recognize click any help would be greatly appreciated ( the beeping is not going over well in the surrounding cubicles) thank you... (4 Replies)
Discussion started by: Split100
4 Replies

5. UNIX for Dummies Questions & Answers

Newbie question?

What is the best way to learn UNIX on the web, with out buying books? any link would be much help. Thank you in advance, L (1 Reply)
Discussion started by: lsoria1
1 Replies

6. High Performance Computing

newbie in veritas cluster server

Hello, This might not be the right place to post my questions. - I installed VCS 5.0 on the 2 nodes. What's next? I want to test the HA of NFS: i.e. the shared disk always accessible if one node goes down. How to do that? - The management console was not installed. This is the GUI to manage... (2 Replies)
Discussion started by: melanie_pfefer
2 Replies

7. Programming

Newbie question

Dear all, I have a question related to parallel programing and if you can give me some hints on how to deal with it, it would be really great. I would like to run a small application on a supercompter of 128 CPUs. Unfortunately, on this machine only jobs which require 32 CPUs are allowed to... (1 Reply)
Discussion started by: Eduard
1 Replies

8. UNIX for Dummies Questions & Answers

UNIX newbie NEWBIE question!

Hello everyone, Just started UNIX today! In our school we use solaris. I just want to know how do I setup Solaris 10 not the GUI one, the one where you have to type the commands like ECHO, ls, pwd, etc... I have windows xp and I also have vmware. I hope I am not missing anything! :p (4 Replies)
Discussion started by: Hanamachi
4 Replies

9. Shell Programming and Scripting

perl newbie . &&..programming newbie (question 2)

Hello everyone, I am having to do a lot of perl scripting these days and I am learning a lot. I have this problem I want to move files from a folder and all its sub folders to one parent folder, they are all .gz files.. there is folder1\folder2\*.gz and there are about 50 folders... (1 Reply)
Discussion started by: xytiz
1 Replies

10. Solaris

Sun cluster and Veritas cluster question.

Yesterday my customer told me to expect a vcs upgrade to happen in the future. He also plans to stop using HDS and move to EMC. Am thinking how to migrate to sun cluster setup instead. My plan as follows leave the existing vcs intact as a fallback plan. Then install and build suncluster on... (5 Replies)
Discussion started by: sparcguy
5 Replies

LEARN ABOUT OPENSOLARIS

scds_get_resource_name

scds_get_resource_name(3HA)				 Sun Cluster HA and Data Services			       scds_get_resource_name(3HA)

NAME

       scds_get_resource_name - retrieve the resource name

SYNOPSIS

       cc [flags...] -I /usr/cluster/include file -L /usr/cluster/lib  -l  dsdev
       #include <rgm/libdsdev.h>

       const char *scds_get_resource_name(scds_handle_t handle

DESCRIPTION

       The  scds_get_resource_name()  function	returns  a pointer to a character string containing the name of the resource passed to the calling
       program. The pointer is to memory belonging to the DSDL. Do not modify this memory. A call to scds_close() invalidates the pointer.

PARAMETERS

       The following parameters are supported:

       handle		   The handle returned from scds_initialize()

ERRORS

       NULL		   Indicates an error condition such as not previously calling scds_initialize(3HA)

       See  scha_calls(3HA) for a description of other error codes.

FILES

       /usr/cluster/include/rgm/libdsdev.h

	   Include file

       /usr/cluster/lib/libdsdev.so

	   Library

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWscdev 		   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |Evolving			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       scds_close(3HA), scds_initialize(3HA), scha_calls(3HA), attributes(5)

Sun Cluster 3.2 						    7 Sep 2007					       scds_get_resource_name(3HA)
All times are GMT -4. The time now is 01:43 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy