11-13-2007
Ideas Please (File Sequencing)
Hello All
Hope someone can help me with an idea or two on how to approach the following situation;
I currently have a process that generates sequenced files. The sequencing is very important and skipping sequences are not allowed. The applicaton has a single thread that consume data produced buy other threads in the application and this thread is dedicated to file generation and sequecing. When the application encounter a problem it does a rollback and exit. when it restarts it picks up where it left off and everything works fine.
We are starting to experience performance problems though, it simply can't keep up. We need to make the application scalable and I would like to do this by running multiple instances of the application.
My problem is sequencing the files. Everything will work fine so long as no exceptions are encountered, the multiple processes will share a memory area where the sequence will be maintained. But what if one process encounter a problem and exists? When it restart the shared sequence would be have been incremented multiple times.
Can someone suggest an elegant method of approaching this problem?
The application is written in C and is currenty running on TRU64 but will be moved to HPUX early next year.
Thank you,
B
9 More Discussions You Might Find Interesting
1. Programming
Hey everyone,
I'm writing a threaded database server application and need to communicate the results of several worker threads to a single multiplexed communication output thread. Basically, the communication output thread sits in a select statement waiting for its client sockets to dole out... (2 Replies)
Discussion started by: DreamWarrior
2 Replies
2. Cybersecurity
Hi,
I installed sybase server on a LINUX server. I assigen port 2025 whilst installation for sybase , later i uninstalled sybase and when i try to reinstall sybase and use port 2025 it throw up error saying that it is already in use, use other port number. How can I re-use the same port number... (2 Replies)
Discussion started by: suda
2 Replies
3. Shell Programming and Scripting
i need to compare to dates/times given in the format MMDDhhmmYY. That is month, day, hour, minute, year. It is a 24 hour clock. I need to compare two dates to check that they are, say, less than 900 seconds apart. I have got to a point where it checks the time, turns the values into seconds and... (5 Replies)
Discussion started by: fwabbly
5 Replies
4. Shell Programming and Scripting
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx (4 Replies)
Discussion started by: mmiller99
4 Replies
5. Shell Programming and Scripting
Hi!
I have some sequencing data that I have aligned using maq software
Now, I have data that looks like this each line is a 'tag'
chr1 10001
chr1 10002
chr1 10005
chr1 10007
chr1 10008
chr1 10008
chr1 10008
chr1 10019
chr1 10019
chr1 10020
What I really want to find out is how... (1 Reply)
Discussion started by: biobio
1 Replies
6. Shell Programming and Scripting
I am not sure if this is entirely possible, but I want to compare data in a particular column in several .txt files and have a new file generated. I am a biologist with limited unix knowledge. There are currently no programs written for this type of analysis.
First I would like to define the... (1 Reply)
Discussion started by: kellywilliams
1 Replies
7. IP Networking
I was analyzing a TCP snoop. And found following scenario
From Server to Client ---> SEQ 2993 ACK 1744 WIN 8192 LEN 13
From Server to Client ---> SEQ 3006 ACK 1744 WIN 8192 LEN 13
From Client to server --> SEQ 1744 ACK 3019 WIN 3304
I just want to know Why Packet 1 and 2... (3 Replies)
Discussion started by: mr_deb
3 Replies
8. UNIX and Linux Applications
Dear all,
i am in last year of electronics department in engineering faculty
i need suggestions for a graduation project based on unix or free bsd or linux and electronics "embedded linux "
i think about embedded unix for example or device drivers
please i need helps (1 Reply)
Discussion started by: MOHA-1
1 Replies
9. Shell Programming and Scripting
Hello,
I have been given a scripting project, but have not learned any scripting. I need to get some ideas on how to start. Attached is part of the project:
I have no idea how to parse the arguments. What I had in mind was to get the arguments ($1, $2, ... ) and have if statements for different... (1 Reply)
Discussion started by: facepalm
1 Replies
LEARN ABOUT MOJAVE
file::spec::functions
File::Spec::Functions(3pm) Perl Programmers Reference Guide File::Spec::Functions(3pm)
NAME
File::Spec::Functions - portably perform operations on file names
SYNOPSIS
use File::Spec::Functions;
$x = catfile('a','b');
DESCRIPTION
This module exports convenience functions for all of the class methods provided by File::Spec.
For a reference of available functions, please consult File::Spec::Unix, which contains the entire set, and which is inherited by the
modules for other platforms. For further information, please see File::Spec::Mac, File::Spec::OS2, File::Spec::Win32, or File::Spec::VMS.
Exports
The following functions are exported by default.
canonpath
catdir
catfile
curdir
rootdir
updir
no_upwards
file_name_is_absolute
path
The following functions are exported only by request.
devnull
tmpdir
splitpath
splitdir
catpath
abs2rel
rel2abs
case_tolerant
All the functions may be imported using the ":ALL" tag.
COPYRIGHT
Copyright (c) 2004 by the Perl 5 Porters. All rights reserved.
This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
SEE ALSO
File::Spec, File::Spec::Unix, File::Spec::Mac, File::Spec::OS2, File::Spec::Win32, File::Spec::VMS, ExtUtils::MakeMaker
perl v5.18.2 2014-01-06 File::Spec::Functions(3pm)