Index server

Special Forums UNIX and Linux Applications Index server

05-12-2012

Registered User

110, 6

Join Date: Sep 2010

Last Activity: 3 November 2013, 7:32 AM EST

Location: Tabriz, Iran

Posts: 110

Thanks Given: 53

Thanked 6 Times in 6 Posts

Index server

Hi guys,

I have postgresql server with huge amount of data, nearly 2 billion records. each record is at most 50 bytes(4 integer fields). I need to build index on all column to do fast reporting. but indexes becomes bloat after some time. almost 80% of database size is because of its huge indexes. I need some comprehensive external indexing solution so I remove indexes on DB. I found Lucene but it is for full text searching. my fields are all integer. Is there any good solution?

majid.merkava

View Public Profile for majid.merkava

Find all posts by majid.merkava

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need Help in Index

I am having data in XML format and trying to extract codes form two fields called <String>, below is the data. <Node>tollfree<Condition>BooleanOperator<Operation>AND</Operation><Condition>BooleanOperator<Operation>NOT</Operation><Condition>FieldSelection<Field Context="ALL fields"...

2. Shell Programming and Scripting

Duplicate value with different index

Hello Gents, Please give a help with this case Input 10001010G1 10001010G1 10001010G1 10001010G2 10001010G3 10001012G1 10001012G1 10001012G1 10001012G1 10001014G1 10001014G1 10001014G2

3. Shell Programming and Scripting

Get index value by awk

HI All, I would like to pass a integer and get all values under this index the by using awk. Could anyone help? Thanks :> input: 1,2,3,4,5,6,7 1,2,3,48,5,6,7 1,2,3,4,5,6,7 e.g. i pass 4 to awk command output: 4 48 4 Video tutorial on how to use code tags in The UNIX and Linux...

4. Shell Programming and Scripting

awk index

1 2 000060000 How do i return the point in the string where the 6 is? i.e what I want on output is 1 2 5 something like awk '{print $1 $2 index($3,6) }' but I can't get it to work Thanks in advance

5. UNIX for Dummies Questions & Answers

string index

I have a line "My name is Deepak" How can i search a string Deepak in the line and find out its index position. Here in this case the result should be 12.

6. Shell Programming and Scripting

Sort from start index and end index in line

Hi All, I have a file (FileNames.txt) which contains the following data in it. $ cat FileNames.txt MYFILE17XXX208Sep191307.csv MYFILE19XXX208Sep192124.csv MYFILE20XXX208Sep192418.csv MYFILE22XXX208Sep193234.csv MYFILE21XXX208Sep193018.csv MYFILE24XXX208Sep194053.csv...

7. UNIX for Dummies Questions & Answers

wh inode index starts from 1 unlike array index (0)

brothers why inode index starts from 1 unlike array inex which starts from 0 its a question from the design of unix operating system of maurice j.bach i need to know the answer urgently...someone help please

8. Filesystems, Disks and Memory

why the inode index of file system starts from 1 unlike array index(0)

why do inode indices starts from 1 unlike array indexes which starts from 0 its a question from "the design of unix operating system" of maurice j bach id be glad if i get to know the answer quickly :)

9. Shell Programming and Scripting

What is index?

hi, :) In a shell script i came accross the following lines 1.for i in ` find /home/oracle -name ch' 2.do 3.echo $i 4.idx=`expr index $i .` 5.done Here iam not able to understand the porpose of the word "index" in line 4. any help ? cheers RRK

10. Shell Programming and Scripting

Index Command

Hi, can anyone explain me how this works (how the flow goes)? Example: CLIENT="UNIXHELP" The second argument passed $2="UNIX" RESULT=`awk -F"=" '/CLIENTS=/ {len = index($2,"'${CLIENT}'");print len }' $2` Thanks in advance.

LEARN ABOUT DEBIAN

dbfdump

SHAPELIB(1)							   User Commands						       SHAPELIB(1)

NAME

       dbfdump - dump xBase DBF files as text

SYNOPSIS

       dbfdump [-h] [-m] [-r] file

DESCRIPTION

       Dumps  the contents of file to standard output.	The first line contains the field names appearing in file, and each of the following lines
       contains the field values of a record.  Field names and values are padded by spaces to their field widths.  Empty fields are printed as the
       string "(NULL)".

OPTIONS

       -h     Prints the column field definitions before other output.	Each field definition consists of a line of the form

	      Field: index, Type=type, Title=`name', Width=width, Decimals=precision

	      where  index  is the zero offset column number of the field; the type indicates the datatype of the field value and is either "Inte-
	      ger", "Real" or "String"; name is the field's name; width is the number of bytes reserved for the field's value;	and  precision	is
	      the number of decimal places of precision for "Real" type fields, and is zero for "Integer" and "String" type fields.

       -m     Prints  each  record in multiline format separated by empty lines.  The first line of a record gives the number of the record in the
	      form

	      Records: record_index

	      where record_index is the zero offset number of the record in the file, and then each field of the record appears on its own line in
	      the format

	      name: value

       -r     Prints the exact bytes occurring in file for field values and suppresses printing "(NULL)" for empty values.

EXIT STATUS

       0      Successful program execution.

       1      Missing file argument.

       2      Failed to open file.

       3      There are no fields in file.

DIAGNOSTICS

       The following diagnostics may be issued on stdout:

       DBFOpen(file,"r") failed.

       There are no fields in this table!

AUTHORS

       Frank  Warmerdam (warmerdam@pobox.com) is the maintainer of the shapelib shapefile library.  Joonas Pihlaja (jpihlaja@cc.helsinki.fi) wrote
       this man page.

BUGS

       Unless the -r option is given, values in numeric fields that overflow the int or double types of the C language	are  printed  as  plus	or
       minus a huge number.  For integer fields the huge value is HUGE_VALL from <stdlib.h> and for real fields it is HUGE_VALF.

SEE ALSO

       dbf_dump(1), dbfcreate(1), dbfadd(1), shpadd(1), shpcreate(1), shpdump(1), shprewind(1)

shapelib							   OCTOBER 2004 						       SHAPELIB(1)

UNIX and Linux Applications