On Wavelet Compression and Cardinality Estimation of Enterprise Data

 
Thread Tools Search this Thread
Special Forums News, Links, Events and Announcements UNIX and Linux RSS News On Wavelet Compression and Cardinality Estimation of Enterprise Data
# 1  
Old 10-08-2010
On Wavelet Compression and Cardinality Estimation of Enterprise Data

HPL-2010-132 On Wavelet Compression and Cardinality Estimation of Enterprise Data - Choudur, Lakshminarayan; Dayal, Umeshwar; Gupta, Chetan; Swaminathan, Ram
Keyword(s): compression, wavelets, thresholding, energy
Abstract: Storing and analyzing large volume of structured or unstructured data at the scale of petabytes in applications such as business intelligence of an enterprise, is a daunting task. It is therefore desirable to store data in a compressed form. Compression often is performed using transform methods tha ...
Full Report

More...
Login or Register to Ask a Question

Previous Thread | Next Thread

4 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Find all possible intersecting sets of cardinality 3 or more

Hi Gurus. Please consider the following problem where col1 is the set name and col2 is comma delimited elements in the corresponding set. I have about 2600 such rows. In:A v1,v2,v3,v4 B v6,v7,v1,v2 C v7,v1,v2,v5,v6 D v3,v2,v5,v4 E v8,v4,v6,v10,v11 F v3,v2,v1,v4,v6,v8 G v2,v5,v8,v4 H... (5 Replies)
Discussion started by: abh.kumar
5 Replies

2. UNIX for Dummies Questions & Answers

How to check hardware data compression

Hi, I'm looking to check the compression ratio applied by hardware to work out how much free space we have on tapes. mt -f /dev/rmt0 status shows: If I add up the output of the du command and what we backup from the script, it gives me the total space we tape up. So the plan was to find the... (4 Replies)
Discussion started by: rab
4 Replies

3. AIX

Tape compression

Hello everyone I want to use compression in my tape when I backup some file. For example I have several files that use 50gb. If I backup this I need to use two cartridge because without compression I can backup 36gb. My question is with flag I need to use to compress and I can use 72gb in... (2 Replies)
Discussion started by: lo-lp-kl
2 Replies

4. SCO

System hangs on data compression

Hi, We are having an automated system installed on SCO unixware, which runs a End Of Day routine during midnight. Since few days system is hanging at data backup, I have checked the log, system hangs exactly on data compression, any idea or help that why system is hanging only on compression....... (10 Replies)
Discussion started by: tayyabq8
10 Replies
Login or Register to Ask a Question
lrzip.conf(5)                                                                                                                        lrzip.conf(5)

NAME
lrzip.conf - Configuration File for lrzip DESCRIPTION
This file if used, will be read by the lrzip program, parsed, and options passed to the program. Some options may be overridden on the com- mand line. Others are fixed. The configuration file must be called lrzip.conf. The lrzip program will search for the file automatically in one of three places: $PWD - Current Directory /etc/lrzip $HOME/./lrzip Parameters are set in PARAMETER=VALUE fashion where any line beginning with a # or that is blank will be ignored. Parameter values are not case sensitive. CONFIG FILE EXAMPLE
# This is a comment. # Compression Window size in 100MB. Normally selected by program. # WINDOW = 5 # Compression Level 1-9 (7 Default). # COMPRESSIONLEVEL = 7 # Unlimited Ram Compression # UNLIMITED = YES # Compression Method, rzip, gzip, bzip2, lzo, or lzma (default), zpaq. # COMPRESSIONMETHOD = LZMA # Perform LZO Test. Default = YES (-T option, NO) # LZOTEST = NO # Hash Check on decompression, YES # HASHCHECK = YES # Show HASH value on Compression even if Verbose is off, YES # SHOWHASH = YES # Default output directory # OUTPUTDIRECTORY = location # Verbosity, Yes or Max # VERBOSITY = MAX # Show Progress as file is parsed, YES, NO (yes is default) # SHOWPROGRESS = NO # Set Niceness. 19 is default. -20 to 19 is the allowable range # NICE = 19 # Keep broken or damaged output files, YES # KEEPBROKEN = YES # Delete source file after compression # this parameter and value are case sensitive # value must be YES to activate # DELETEFILES = NO # Replace existing lrzip file when compressing # this parameter and value are case sensitive # value must be YES to activate # REPLACEFILE = NO # Select Temporary Directory when stdin/stdout or Test file is used # TMPDIR = /tmp NOTES
Be careful when using DELETEFILES or REPLACEFILE as no warning will be given and lrzip will simply delete the source or replace the output file! SEE ALSO
lrzip(1) January 2009 lrzip.conf(5)