Index server

Special Forums UNIX and Linux Applications Index server

05-12-2012

Registered User

110, 6

Join Date: Sep 2010

Last Activity: 3 November 2013, 7:32 AM EST

Location: Tabriz, Iran

Posts: 110

Thanks Given: 53

Thanked 6 Times in 6 Posts

Index server

Hi guys,

I have postgresql server with huge amount of data, nearly 2 billion records. each record is at most 50 bytes(4 integer fields). I need to build index on all column to do fast reporting. but indexes becomes bloat after some time. almost 80% of database size is because of its huge indexes. I need some comprehensive external indexing solution so I remove indexes on DB. I found Lucene but it is for full text searching. my fields are all integer. Is there any good solution?

majid.merkava

View Public Profile for majid.merkava

Find all posts by majid.merkava

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need Help in Index

I am having data in XML format and trying to extract codes form two fields called <String>, below is the data. <Node>tollfree<Condition>BooleanOperator<Operation>AND</Operation><Condition>BooleanOperator<Operation>NOT</Operation><Condition>FieldSelection<Field Context="ALL fields"...

2. Shell Programming and Scripting

Duplicate value with different index

Hello Gents, Please give a help with this case Input 10001010G1 10001010G1 10001010G1 10001010G2 10001010G3 10001012G1 10001012G1 10001012G1 10001012G1 10001014G1 10001014G1 10001014G2

3. Shell Programming and Scripting

Get index value by awk

HI All, I would like to pass a integer and get all values under this index the by using awk. Could anyone help? Thanks :> input: 1,2,3,4,5,6,7 1,2,3,48,5,6,7 1,2,3,4,5,6,7 e.g. i pass 4 to awk command output: 4 48 4 Video tutorial on how to use code tags in The UNIX and Linux...

4. Shell Programming and Scripting

awk index

1 2 000060000 How do i return the point in the string where the 6 is? i.e what I want on output is 1 2 5 something like awk '{print $1 $2 index($3,6) }' but I can't get it to work Thanks in advance

5. UNIX for Dummies Questions & Answers

string index

I have a line "My name is Deepak" How can i search a string Deepak in the line and find out its index position. Here in this case the result should be 12.

6. Shell Programming and Scripting

Sort from start index and end index in line

Hi All, I have a file (FileNames.txt) which contains the following data in it. $ cat FileNames.txt MYFILE17XXX208Sep191307.csv MYFILE19XXX208Sep192124.csv MYFILE20XXX208Sep192418.csv MYFILE22XXX208Sep193234.csv MYFILE21XXX208Sep193018.csv MYFILE24XXX208Sep194053.csv...

7. UNIX for Dummies Questions & Answers

wh inode index starts from 1 unlike array index (0)

brothers why inode index starts from 1 unlike array inex which starts from 0 its a question from the design of unix operating system of maurice j.bach i need to know the answer urgently...someone help please

8. Filesystems, Disks and Memory

why the inode index of file system starts from 1 unlike array index(0)

why do inode indices starts from 1 unlike array indexes which starts from 0 its a question from "the design of unix operating system" of maurice j bach id be glad if i get to know the answer quickly :)

9. Shell Programming and Scripting

What is index?

hi, :) In a shell script i came accross the following lines 1.for i in ` find /home/oracle -name ch' 2.do 3.echo $i 4.idx=`expr index $i .` 5.done Here iam not able to understand the porpose of the word "index" in line 4. any help ? cheers RRK

10. Shell Programming and Scripting

Index Command

Hi, can anyone explain me how this works (how the flow goes)? Example: CLIENT="UNIXHELP" The second argument passed $2="UNIX" RESULT=`awk -F"=" '/CLIENTS=/ {len = index($2,"'${CLIENT}'");print len }' $2` Thanks in advance.

LEARN ABOUT REDHAT

gindxbib

INDXBIB(1)						      General Commands Manual							INDXBIB(1)

NAME

       indxbib - make inverted index for bibliographic databases

SYNOPSIS

       indxbib [ -vw ] [ -cfile ] [ -ddir ] [ -ffile ] [ -hn ] [ -istring ] [ -kn ] [ -ln ] [ -nn ] [ -ofile ] [ -tn ] [ filename... ]

       It is possible to have whitespace between a command line option and its parameter.

DESCRIPTION

       indxbib makes an inverted index for the bibliographic databases in filename...  for use with refer(1), lookbib(1), and lkbib(1).  The index
       will be named filename.i; the index is written to a temporary file which is then renamed to this.  If no filenames are given on the command
       line because the -f option has been used, and no -o option is given, the index will be named Ind.i.

       Bibliographic  databases  are divided into records by blank lines.  Within a record, each fields starts with a % character at the beginning
       of a line.  Fields have a one letter name which follows the % character.

       The values set by the -c, -n, -l and -t options are stored in the index; when the index is searched, keys will be discarded  and  truncated
       in  a manner appropriate to these options; the original keys will be used for verifying that any record found using the index actually con-
       tains the keys.	This means that a user of an index need not know whether these options were used in the creation of  the  index,  provided
       that not all the keys to be searched for would have been discarded during indexing and that the user supplies at least the part of each key
       that would have remained after being truncated during indexing.	The value set by the -i option is also stored in the  index  and  will	be
       used in verifying records found using the index.

OPTIONS

       -v     Print the version number.

       -w     Index whole files.  Each file is a separate record.

       -cfile Read the list of common words from file instead of /usr/share/groff/1.18.1/eign.

       -ddir  Use  dir as the pathname of the current working directory to store in the index, instead of the path printed by pwd(1).  Usually dir
	      will be a symbolic link that points to the directory printed by pwd(1).

       -ffile Read the files to be indexed from file.  If file is -, files will be read from the standard input.  The -f option can  be  given	at
	      most once.

       -istring
	      Don't index the contents of fields whose names are in string.  Initially string is XYZ.

       -hn    Use  the	first  prime  greater  than  or equal to n for the size of the hash table.  Larger values of n will usually make searching
	      faster, but will make the index larger and indxbib use more memory.  Initially n is 997.

       -kn    Use at most n keys per input record.  Initially n is 100.

       -ln    Discard keys that are shorter than n.  Initially n is 3.

       -nn    Discard the n most common words.	Initially n is 100.

       -obasename
	      The index should be named basename.i.

       -tn    Truncate keys to n.  Initially n is 6.

FILES

       filename.i     Index.

       Ind.i	      Default index name.

       /usr/share/groff/1.18.1/eign
		      List of common words.

       indxbibXXXXXX  Temporary file.

SEE ALSO

       refer(1), lkbib(1), lookbib(1)

Groff Version 1.18.1						   27 June 2001 							INDXBIB(1)

UNIX and Linux Applications