Sponsored Content
Special Forums UNIX and Linux Applications Choosing DBMS for sensor network like system Post 302637491 by majid.merkava on Wednesday 9th of May 2012 01:23:56 AM
Old 05-09-2012
Choosing DBMS for sensor network like system

This is just a problem with our current system. We have a distributed number of stations all around the country gathering information and sending to our database. number stations are about 300 and our database server is Postgresql 8.4 running on Debian 6.(two quad core xeon with a single 1TB hard disk). because it doesn't scale very good we decided to change our architecture. because of lots of relational and non relational systems out there, I have problem choosing for our needs. here is our challenges:
  1. current system is generating 4 million records per day. we are planning to go beyond 1000 stations. we need a product that could handle 2000+ connections per second on our current server in next 5 years.
  2. we do not need much tests on data validity.(I think we need NoSQL here). stations don't even check that data is delivered or not. they just send and pass.
  3. currently we are using triggers to update our report tables based on input data. the problem is after a month we got bloat indexes which need many maintenance tasks. Is there any trigger like mechanisms that doesn't cause bloat indexes or we should forget real time report generations and use OLAP products?
  4. the DBMS should handle at maximum 5TB of data on a single table. on our current system because it gets high load, we delete past data (past two or three month). thus we can not take reports from data that belongs to last year.
  5. we doesn't need much ACID features. we need simple insert and select. We don not have two phase commit in our systems. we need extreme fast inserts.
  6. Is table partitioning good for our problem? (we categorize our data based on date)
  7. As I said we need real time reports.(when I say real time I mean if reports is for yesterday, it doesn't have problem). Are there any open source OLAP product for direct feed?
  8. we do not need much high availability that force us use cluster.
 

5 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Network and System files

I was given this question and cannot seem to answer it. "Identify 4 network and 4 sytem files that control how the system and network function (other than rc files)." The problem is I only know of rc files. Can anyone help? (2 Replies)
Discussion started by: trip
2 Replies

2. Shell Programming and Scripting

Taking a system off a network on a system

say i have a system on thats on a network with access to the internet. now, i have sensitive information on this system and i do not want the system to be connected to the outside world anymore. how do i get it off the network without actually having to disconnect the cables? i'm asking this... (4 Replies)
Discussion started by: Terrible
4 Replies

3. Linux

network audio system

The Network Audio System (NAS) Anybody have any luck with nasd or xmms-nas with any 2.6 distribution? Works fine under FreeBSD (6.0/7.0). (0 Replies)
Discussion started by: ramen_noodle
0 Replies

4. SCO

Ingres dbms on sco unix

Hi everybody. I'm going to install ingres on sco unix 5.0.7. A client version may be usefull. I want to know how can I get appropriate version and how to install ingres on sco unix. thanks. (1 Reply)
Discussion started by: javad1_maroofi
1 Replies

5. AIX

Network File System using HACMP

Hi, I have an HACMP cluster with two nodes. The Resource Group contains a VG which in turn has a FS created in it say /test.. Now I want that FS to be mounted through NFS on some other AIX servers as well. What would be the best way to do this? Regards, (2 Replies)
Discussion started by: aixromeo
2 Replies
radio(1)						      General Commands Manual							  radio(1)

NAME
radio - console radio application SYNOPSIS
radio [ options ] DESCRIPTION
radio is a interactive, ncurses-bases console radio application. OPTIONS
-h print a short help text. -d enable debug output. -q quit after processing the cmd line options, don't enter interactive ncurses mode. Only useful together with other options for obvi- ous reasons ... -m mute radio. -f freq tune the specified radio frequency (and unmute the radio). -c dev specify radio device (default is /dev/radio0). -s Do a scan for radio stations. -S Same as above + write a radio.fmmap with the signal for every frequency. You can get a graph for it with gnuplot (plot "radio.fmmap" w lin). -i Scan, write a initial ~/.radio file to stdout and quit. So you can create a config file where you only have to fill in the correct station names later this way: "radio -i > ~/.radio". See below for the config file syntax. CONFIGURATION
radio picks up station names and present stations from a config file. It can parse kradio (KDE radio app) config files, therefore it first tries the usual KDE config file location: ~/.kde/share/config/kradiorc. Failing that, radio tries ~/.radio (which makes things a bit easier for people who don't use kradio). The format looks like this: # KDE Config File [Buttons] 1=95800000 2=91400000 [Stations] 100600000=Hundert,6 95800000=Radio eins 102600000=Fritz 94300000=r.s.2 91400000=Berliner Rundfunk The [Buttons] section can have up to eight entries. That are the present stations, they get mapped to F1-F8. The [Stations] section maps frequencies to station names. The frequencies in both sections are specified in Hz. KEYS
X exit ESC,Q,E mute and exit. up/down inc/dec frequency pgup/pgdown next/previous station. This one uses the stations from the config file by default. When started with the -s option these keys will cycle througth the stations found during the scan. F1-F8, 1-8 preset buttons. Ctrl+L redraw screen. AUTHOR
Gerd Knorr <kraxel@bytesex.org> COPYRIGHT
Copyright (C) 1997-2001 Gerd Knorr This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MER- CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. (c) 1998-2001 Gerd Knorr radio(1)
All times are GMT -4. The time now is 02:40 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy