Sponsored Content
Special Forums Hardware Filesystems, Disks and Memory Optimizing the system reliability Post 32976 by Deepa on Wednesday 11th of December 2002 10:09:19 PM
Old 12-11-2002
Thanks Perderabo!

As you said, "Reliability will require duplicate servers, preferably in different cities", we do have a duplicate sun box geographically located in different cities, which has the same configuration and with the same number of processes running on it.

But the secondary machine is used only when the primary machine goes for a toss.

I am trying to find out the number of parallel instances of each process to be running in each machine, to attain a better reliability.

As u rightly said, we have to benchmark for gaining performance. I happened to hear about the genetic algorithm which can be applied for similar type of scenario. But still, we have to define the performance calculation of each process (considering the CPU load, memory usage, database accessing, IPC access etc) and provide it as one of the input to genetic algorithm.

I am not sure if any of our forum members are aware of this genetic algorithm(GA) concept. If anyone knows a good GA site/forum from where we can grab some information, pls let me know.

Thanks
 

7 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Optimizing for a Speed-up

How would one go about optimizing this current .sh program so it works at a more minimal time. Such as is there a better way to count what I need than what I have done or better way to match patterns in the file? Thanks, #declare variables to be used. help=-1 count=0 JanCount=0 FebCount=0... (3 Replies)
Discussion started by: switch
3 Replies

2. UNIX and Linux Applications

Optimizing query

Hi All, My first thread to this sub-forum and first thread of this sub-forum :) Here it is, Am trying to delete duplicates from a table retaining just 1 duplicate value out of the duplicate records for example : from n records of a table out of which x are duplicates, I want to remove x... (15 Replies)
Discussion started by: matrixmadhan
15 Replies

3. High Performance Computing

High reliability web server - cluster, redundancy, etc

Hi. I am IT manager/developer for a small organization. I have been doing as-needed linux server administration for several years and am by no means an expert. I've built several of my own servers, and our org is currently using hosting services for our servers and I am relatively happy. We... (3 Replies)
Discussion started by: bsaadmin
3 Replies

4. AIX

MPIO reliability

Hi, we have a vew boxes using MPIO and they are connected to some virtualization software managing some disk subsystems, offering volumes to the AIX boxes. Sometimes when a cable has been plugged out for a test or when a real problem occurs, using lspath to show the state of the paths shows... (8 Replies)
Discussion started by: zaxxon
8 Replies

5. Shell Programming and Scripting

Optimizing the code

Hi, I have two files in the format listed below. I need to find out all values from field 12 to field 20 present in file 2 and list them in file3(format as file2) File1 : FEIN,CHRISTA... (2 Replies)
Discussion started by: nua7
2 Replies

6. Solaris

Reasons for NOT using LDOMs? reliability?

Dear Solaris Experts, We are upgrading from sun4u to T4 systems and one proposal is to use LDOMs and also zones within LDOMs. Someone advised using only zones and not LDOMs because the new machines have fewer chips and if a chip or a core fails then it doesn't impact the zones, but impacts... (3 Replies)
Discussion started by: User121
3 Replies

7. Web Development

Optimizing JS and CSS

Yes. Got few suggestions. - How about minifying resources - mod_expires - Service workers setup https://www.unix.com/attachments/web-programming/7709d1550557731-sneak-preview-new-unix-com-usercp-vuejs-demo-screenshot-png (8 Replies)
Discussion started by: Akshay Hegde
8 Replies
TABLIX(1)						       Tablix User's Manual							 TABLIX(1)

NAME
tablix2 - general timetable solver SYNOPSIS
tablix2 [ options ] file DESCRIPTION
Tablix is a powerful free software kernel for solving general timetabling problems. It uses a coarse-grained parallel genetic algorithm in combi- nation with other techniques to construct sensible timetables from XML formatted problem descriptions. Tablix can run on a single host as well as on a heterogeneous parallel virtual machine using PVM3. It operates by trying to assign variable resources to a number of events (sometimes called tuples) in a most efficient way. Various fitness mod- ules can be specified in the problem description file to control the behaviour of the genetic algorithm. Output is given in the form of a XML file. This file can be further processed by tablix2_output utility to export timetable data to a number of human or machine readable formats. Output XML file can also be used again as a problem description (input) file. In that case the previous solu- tion will be used as a hint for Tablix when searching for a new solution. OPTIONS
-n N Start N slave processes (kernels). This is the number of spawned PVM3 tasks on the virtual machine. A larger number means larger total popula- tion, steeper convergence graph, more exhaustive search for solutions and a smaller chance of premature convergence. However, optimal number depends on the number and speed of computing nodes. For a virtual machine composed of reasonably fast machines start with N = 4 * i where i is the number of computing nodes. Tablix will try to arrange tasks so that all computing nodes will have equal load. (Be sure to set speed field correctly in your PVM3 hostfile). Default is 4. -l N When a population in a slave process (computing node) reaches a local minimum that process will try to execute an algorithm called local search. This is a way to nudge the main genetic algorithm out of a local minimum trap if it gets caught in it. However it is usually not efficient for this algorithm to run simultaneously on many nodes. This option sets the number of computing nodes that are allowed to simultaneously perform local search. Setting N to 0 disables local search and -1 means no limit. Default is 1. -r Restore saved populations instead of starting with random ones. Populations are loaded from a number of PREFIXsave?.txt files, where PREFIX is the prefix, specified with the -o option. See below. -o PREFIX Specify a prefix for output files. All output files (result, saved populations and convergence graph info) will have PREFIX prepended. -d LEVEL Set the verbosity level, where LEVEL is one of the following: 0 (only fatal error messages are shown), 1 (fatal and non-fatal errors), 2 (errors and a progress indicator), 3 (all of the above plus some informational messages) or 4 (all of the above plus debug messages). -h Shows a brief help message. -v Shows compile time options, path to modules and copyright information. -t MINUTES Sets a time limit for the genetic algorithm. Tablix will stop if no solution is found after set number of minutes. The effect is same as when Ctrl-C is pressed. Setting MINUTES to 0 disables this feature. Default is disabled. Use this option to prevent Tablix to run indefinitely if there is no possible solution. -p PARAMETERS Set algorithm parameters. This is rarely used. The defaults should work fine in most cases. PARAMETERS is a comma separated string of parame- ter=value pairs. Following parameters are available: popsize Population size of one node in cluster. Bigger populations mean less generations per minute but also in some cases more optimized results. Default 500. toursize Tournament size. Bigger tournament sizes result in faster convergence, which can result in finding a local instead of a global min- imum. Default 3. mutatepart What part of the population will mutate each generation. 2 means one half, 3 means one third, etc. More mutations usually result in slower convergence but can help to avoid local minimums. Default 4. randpart What part of the population will be randomized each generation. Randomizations have the same effect as mutations. Default 6. maxequal How many equally graded timetables can exist at the same time in a population. Smaller values result in slower convergence but can help to avoid local minimums. Default 20. finish Tablix will finish when the number of all mandatory errors in the best solution reaches zero and this best solution had the same fitness value for N sequential populations. This option enables you to set the value of N. It has no effect if there are no non- mandatory errors defined (in that case Tablix finishes as soon as the number of all mandatory errors reaches zero). Default 300. migrtime How often do parts of populations migrate between nodes. Smaller value means more migrations, which results in faster convergence. Default 40. migrpart What part of population will migrate between nodes. Default 10. localtresh How many equally graded populations to wait before starting local search (if enabled). Default 100. localstep Initial step for the local search algorithm. Larger values mean more exhaustive and slower search. Default 4. pophint If the user has loaded an XML file that already contains a partial or a full solution, then a part of the population can be ini- tialized with this solution. This parameter defines the percentage of the timetables in the population that will be initialized (other timetables will be initialized with random values). Values must be between 0 and 100. Larger values mean that the solution given in the XML file will have a greater possibility of being included in the final solution. If there is no solution in the XML file then this parameter has no effect. Default 25. cachesize This is the maximum number of timetable fitness values that will be held in the fitness cache. Larger values mean more cache search overhead but may improve cache hit/miss ratio. It is probably unwise to use caches larger than 32. In general fitness caching will reduce performance at the start of the genetic algorithm and improve it at the end. Set to 0 to turn off caching. Default 16. -i PATH Sets the path to fitness modules. By default the module path is set to the location where fitness modules were installed by make install command. USAGE
When you run tablix2 , you actually start the master process that will spawn the requested number of slave processes (kernels) on the vir- tual machine. It will then multicast the configuration file to all the nodes and start listening for their reports. You can press Ctrl-C (or send SIGINT) to stop the process. Tablix will save its state in a number of files called save?.txt (it will prepend your prefix, if given). You can later resume the process by running Tablix with the -r parameter. This feature will only work if you don't change the input XML file between saving and restoring the process. Changes to the number of comput- ing nodes (-n parameter) or to the physical configuration of the cluster are allowed however. Tablix will save population convergence information for each node during the computation into files with names conv?.txt. These files allow the user to track the progress and sometimes predict the required time to find the solution to the given problem. Data in these files can be graphi- cally represented with the tablix2_plot utility. When all the criteria defined by the fitness modules are satisfied, Tablix will output one XML file for each node (file names will be result?.xml, prefix will be prepended if given). NOTES
tablix2_kernel is executable for the slave process. It should not be started by hand, unless you know what your are doing (e.g. during debugging) DIAGNOSTICS
Exit status is 0 if solutions were found, and 1 if the time limit was reached or the user has pressed Ctrl-C. Exit status is more or less unde- fined in case of errors during the execution (ideally it should be 2 in this case). BUGS
Tablix will not notify the user if he or she is trying to create an impossible time table. AUTHOR
Tomaz Solc (tomaz.solc@tablix.org) SEE ALSO
pvm(1PVM), pvmd(1PVM), tablix2_output(1), tablix2_plot(1), tablix2_benchmark(1), tablix2_test(1), Tablix User's Manual, Tablix modules HOWTO Tomaz Solc 2005-09-03 TABLIX(1)
All times are GMT -4. The time now is 02:41 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy