Sponsored Content
Special Forums UNIX and Linux Applications Choosing DBMS for sensor network like system Post 302637491 by majid.merkava on Wednesday 9th of May 2012 01:23:56 AM
Old 05-09-2012
Choosing DBMS for sensor network like system

This is just a problem with our current system. We have a distributed number of stations all around the country gathering information and sending to our database. number stations are about 300 and our database server is Postgresql 8.4 running on Debian 6.(two quad core xeon with a single 1TB hard disk). because it doesn't scale very good we decided to change our architecture. because of lots of relational and non relational systems out there, I have problem choosing for our needs. here is our challenges:
  1. current system is generating 4 million records per day. we are planning to go beyond 1000 stations. we need a product that could handle 2000+ connections per second on our current server in next 5 years.
  2. we do not need much tests on data validity.(I think we need NoSQL here). stations don't even check that data is delivered or not. they just send and pass.
  3. currently we are using triggers to update our report tables based on input data. the problem is after a month we got bloat indexes which need many maintenance tasks. Is there any trigger like mechanisms that doesn't cause bloat indexes or we should forget real time report generations and use OLAP products?
  4. the DBMS should handle at maximum 5TB of data on a single table. on our current system because it gets high load, we delete past data (past two or three month). thus we can not take reports from data that belongs to last year.
  5. we doesn't need much ACID features. we need simple insert and select. We don not have two phase commit in our systems. we need extreme fast inserts.
  6. Is table partitioning good for our problem? (we categorize our data based on date)
  7. As I said we need real time reports.(when I say real time I mean if reports is for yesterday, it doesn't have problem). Are there any open source OLAP product for direct feed?
  8. we do not need much high availability that force us use cluster.
 

5 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Network and System files

I was given this question and cannot seem to answer it. "Identify 4 network and 4 sytem files that control how the system and network function (other than rc files)." The problem is I only know of rc files. Can anyone help? (2 Replies)
Discussion started by: trip
2 Replies

2. Shell Programming and Scripting

Taking a system off a network on a system

say i have a system on thats on a network with access to the internet. now, i have sensitive information on this system and i do not want the system to be connected to the outside world anymore. how do i get it off the network without actually having to disconnect the cables? i'm asking this... (4 Replies)
Discussion started by: Terrible
4 Replies

3. Linux

network audio system

The Network Audio System (NAS) Anybody have any luck with nasd or xmms-nas with any 2.6 distribution? Works fine under FreeBSD (6.0/7.0). (0 Replies)
Discussion started by: ramen_noodle
0 Replies

4. SCO

Ingres dbms on sco unix

Hi everybody. I'm going to install ingres on sco unix 5.0.7. A client version may be usefull. I want to know how can I get appropriate version and how to install ingres on sco unix. thanks. (1 Reply)
Discussion started by: javad1_maroofi
1 Replies

5. AIX

Network File System using HACMP

Hi, I have an HACMP cluster with two nodes. The Resource Group contains a VG which in turn has a FS created in it say /test.. Now I want that FS to be mounted through NFS on some other AIX servers as well. What would be the best way to do this? Regards, (2 Replies)
Discussion started by: aixromeo
2 Replies
ADDSLASHES(3)								 1							     ADDSLASHES(3)

addslashes - Quote string with slashes

SYNOPSIS
string addslashes (string $str) DESCRIPTION
Returns a string with backslashes before characters that need to be escaped. These characters are single quote ( '), double quote ( "), backslash ( ) and NUL (the NULL byte). An example use of addslashes(3) is when you're entering data into string that is evaluated by PHP. For example, O'Reilly is stored in $str, you need to escape $str. (e.g. eval("echo '".addslashes($str)."';"); ) To escape database parameters, DBMS specific escape function (e.g. mysqli_real_escape_string(3) for MySQL or pg_escape_literal(3), pg_escape_string(3) for PostgreSQL) should be used for security reasons. DBMSes have differect escape specification for identifiers (e.g. Table name, field name) than parameters. Some DBMS such as PostgreSQL provides identifier escape function, pg_escape_identifier(3), but not all DBMS provides identifier escape API. If this is the case, refer to your database system manual for proper escaping method. If your DBMS doesn't have an escape function and the DBMS uses to escape special chars, you might be able to use this function only when this escape method is adequate for your database. Please note that use of addslashes(3) for database parameter escaping can be cause of security issues on most databases. The PHP directive magic_quotes_gpc was on by default before PHP 5.4, and it essentially ran addslashes(3) on all GET, POST, and COOKIE data. Do not use addslashes(3) on strings that have already been escaped with magic_quotes_gpc as you'll then do double escaping. The func- tion get_magic_quotes_gpc(3) may come in handy for checking this. PARAMETERS
o $str - The string to be escaped. RETURN VALUES
Returns the escaped string. EXAMPLES
Example #1 An addslashes(3) example <?php $str = "Is your name O'Reilly?"; // Outputs: Is your name O'Reilly? echo addslashes($str); ?> SEE ALSO
stripcslashes(3), stripslashes(3), addcslashes(3), htmlspecialchars(3), quotemeta(3), get_magic_quotes_gpc(3). PHP Documentation Group ADDSLASHES(3)
All times are GMT -4. The time now is 04:29 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy