Index server

Special Forums UNIX and Linux Applications Index server

05-12-2012

Registered User

110, 6

Join Date: Sep 2010

Last Activity: 3 November 2013, 7:32 AM EST

Location: Tabriz, Iran

Posts: 110

Thanks Given: 53

Thanked 6 Times in 6 Posts

Index server

Hi guys,

I have postgresql server with huge amount of data, nearly 2 billion records. each record is at most 50 bytes(4 integer fields). I need to build index on all column to do fast reporting. but indexes becomes bloat after some time. almost 80% of database size is because of its huge indexes. I need some comprehensive external indexing solution so I remove indexes on DB. I found Lucene but it is for full text searching. my fields are all integer. Is there any good solution?

majid.merkava

View Public Profile for majid.merkava

Find all posts by majid.merkava

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need Help in Index

I am having data in XML format and trying to extract codes form two fields called <String>, below is the data. <Node>tollfree<Condition>BooleanOperator<Operation>AND</Operation><Condition>BooleanOperator<Operation>NOT</Operation><Condition>FieldSelection<Field Context="ALL fields"...

2. Shell Programming and Scripting

Duplicate value with different index

Hello Gents, Please give a help with this case Input 10001010G1 10001010G1 10001010G1 10001010G2 10001010G3 10001012G1 10001012G1 10001012G1 10001012G1 10001014G1 10001014G1 10001014G2

3. Shell Programming and Scripting

Get index value by awk

HI All, I would like to pass a integer and get all values under this index the by using awk. Could anyone help? Thanks :> input: 1,2,3,4,5,6,7 1,2,3,48,5,6,7 1,2,3,4,5,6,7 e.g. i pass 4 to awk command output: 4 48 4 Video tutorial on how to use code tags in The UNIX and Linux...

4. Shell Programming and Scripting

awk index

1 2 000060000 How do i return the point in the string where the 6 is? i.e what I want on output is 1 2 5 something like awk '{print $1 $2 index($3,6) }' but I can't get it to work Thanks in advance

5. UNIX for Dummies Questions & Answers

string index

I have a line "My name is Deepak" How can i search a string Deepak in the line and find out its index position. Here in this case the result should be 12.

6. Shell Programming and Scripting

Sort from start index and end index in line

Hi All, I have a file (FileNames.txt) which contains the following data in it. $ cat FileNames.txt MYFILE17XXX208Sep191307.csv MYFILE19XXX208Sep192124.csv MYFILE20XXX208Sep192418.csv MYFILE22XXX208Sep193234.csv MYFILE21XXX208Sep193018.csv MYFILE24XXX208Sep194053.csv...

7. UNIX for Dummies Questions & Answers

wh inode index starts from 1 unlike array index (0)

brothers why inode index starts from 1 unlike array inex which starts from 0 its a question from the design of unix operating system of maurice j.bach i need to know the answer urgently...someone help please

8. Filesystems, Disks and Memory

why the inode index of file system starts from 1 unlike array index(0)

why do inode indices starts from 1 unlike array indexes which starts from 0 its a question from "the design of unix operating system" of maurice j bach id be glad if i get to know the answer quickly :)

9. Shell Programming and Scripting

What is index?

hi, :) In a shell script i came accross the following lines 1.for i in ` find /home/oracle -name ch' 2.do 3.echo $i 4.idx=`expr index $i .` 5.done Here iam not able to understand the porpose of the word "index" in line 4. any help ? cheers RRK

10. Shell Programming and Scripting

Index Command

Hi, can anyone explain me how this works (how the flow goes)? Example: CLIENT="UNIXHELP" The second argument passed $2="UNIX" RESULT=`awk -F"=" '/CLIENTS=/ {len = index($2,"'${CLIENT}'");print len }' $2` Thanks in advance.

LEARN ABOUT DEBIAN

pg_buildext

PG_BUILDEXT(1)						 Debian PostgreSQL infrastructure					    PG_BUILDEXT(1)

NAME

       pg_buildext - Build and install a PostgreSQL extension

SYNOPSIS

       pg_buildext action srcdir target opts

DESCRIPTION

       pg_buildext is a script that will build a PostgreSQL extension in a VPATH way. It supports the configure, build, install, and clean
       actions, and will choose to build for the intersection of versions known in debian/pgversions (versions supported by the package) and in
       /usr/share/postgresql-common/supported-versions (versions supported in this release).

OPTIONS

       action
	   One of configure, build, install, or clean.

       srcdir
	   Where to find the extension sources, including the debian subdirectory.  (Usually $(CURDIR).) If not specified, defaults to the current
	   directory.

       target
	   The target directory where to build the sources, it will get created for you if it does not exist. If the target contains a %v sign, it
	   will get replaced by the specific version of PostgreSQL being built against.  (Usually build-%v.)

       opts
	   %v signs in opts will get replaced as in target.

	   configure
	       Options to pass to the configure script. (Most PostgreSQL extensions do not have a configure script.)

	   build
	       Custom CFLAGS options to use for the build.

	   install
	       Package name to install for. Make will be called with DESTDIR="srcdir/debian/package".

	   clean
	       clean does not take extra options.

USAGE

       As pg_buildext invokes make for the build, install, and clean actions, invocations from debian/rules (which is a makefile) should be
       prefixed with + so the sub-makes can talk with the make jobserver.

EXAMPLE

	 build-stamp:
		 +pg_buildext configure $(CURDIR) build-%v "--libdir=/usr/lib/postgresql/%v/lib --datadir=/usr/share/postgresql-%v-plsh"
		 +pg_buildext build $(CURDIR) build-%v

	 install: build
		 +pg_buildext install $(CURDIR) build-%v postgresql-%v-plsh

	 clean:
		 +pg_buildext clean $(CURDIR) build-%v

AUTHOR

       Dimitri Fontaine <dim@tapoueh.org>, with extensions by Christoph Berg <myon@debian.org>.

Debian								    2012-10-08							    PG_BUILDEXT(1)

UNIX and Linux Applications