Sparse Indexing: Large Scale, Inline Deduplication Using Sampling and Locality

 
Thread Tools Search this Thread
Special Forums News, Links, Events and Announcements UNIX and Linux RSS News Sparse Indexing: Large Scale, Inline Deduplication Using Sampling and Locality
# 1  
Old 06-09-2009
Sparse Indexing: Large Scale, Inline Deduplication Using Sampling and Locality

HPL-2009-122 Sparse Indexing: Large Scale, Inline Deduplication Using Sampling and Locality - Lillibridge, Mark; Eshghi, Kave; Bhagwat, Deepavali; Deolalikar, Vinay; Trezise, Greg; Camble, Peter
Keyword(s): deduplication, storage, scaling, locality, inline deduplication, sparse index, chunking
Abstract: We present sparse indexing, a technique that uses sampling and exploits the inherent locality within backup streams to solve for large-scale backup (e.g., hundreds of terabytes) the chunk-lookup disk bottleneck problem that inline, chunk-based deduplication schemes face. The problem is that these sc ...
Full Report

More...
Login or Register to Ask a Question

Previous Thread | Next Thread

5 More Discussions You Might Find Interesting

1. Ubuntu

Ubuntu snap deduplication

Hi, I think the ubuntu snap is great idea. However the fact that it may contain duplications has two disadvantages. 1) eating more space in the storage. 2) eating more space in the internal memory (RAM), it will load the same library more than once to the memory. Now the solution for this is... (0 Replies)
Discussion started by: programAngel
0 Replies

2. UNIX for Dummies Questions & Answers

Any company running large scale grid platform still

Hi buddy, I would like to know are there any company still running large scale grid platform like Parabon? Parabon is the only company running such kind of platform and purchasing CPU power. Is that right? Thanks, Colapig (0 Replies)
Discussion started by: colapig
0 Replies

3. Shell Programming and Scripting

Sampling pcap file

Hi, I have a standard pcap file created using tcpdump. The file looks like 06:49:36.487629 IP 202.1.175.252 > 71.126.222.64: ICMP echo request, id 52765, seq 1280, length 40 06:49:36.489552 IP 192.120.148.227 > 71.126.222.64: ICMP echo request, id 512, seq 1280, length 40 06:49:36.491812 IP... (8 Replies)
Discussion started by: sajal.bhatia
8 Replies

4. Shell Programming and Scripting

data sampling

I have a requirement where I have multiple flat file sources. I need to create sample data from each source. Example: Source 1 has 10 flat files-- member, transaction,item,email,....etc Now if I get any 10 records (say first 10 records) from the member flat file, I need to find those matching... (2 Replies)
Discussion started by: arrivederci
2 Replies

5. UNIX for Advanced & Expert Users

sparse files

what are sparse files? (2 Replies)
Discussion started by: areef4u
2 Replies
Login or Register to Ask a Question
Test::Inline::Content(3pm)				User Contributed Perl Documentation				Test::Inline::Content(3pm)

NAME
Test::Inline::Content - Test::Inline 2 Content Handlers DESCRIPTION
One problem with the initial versions of Test::Inline 2 was the method by which it generated the script contents. "Test::Inline::Content" provides a basic API by which more sophisticated extensions can be written to control the content of the generated scripts. METHODS
new A default implementation of the "new" method is provided that takes no parameters and creates a default (empty) object. Returns a new "Test::Inline::Content" object. process $Inline $Script The "process" method does the work of generating the script content. It takes as argument the parent Test::Inline object, and the completed Test::Inline::Script object for which the file is to be generated. The default implementation returns only an empty script that dies with an appropriate error message. Returns the content of the script as a string, or "undef" on error. SUPPORT
See the main SUPPORT section. AUTHOR
Adam Kennedy <adamk@cpan.org>, <http://ali.as/> COPYRIGHT
Copyright 2004 - 2010 Adam Kennedy. This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself. The full text of the license can be found in the LICENSE file included with this module. perl v5.12.4 2010-11-22 Test::Inline::Content(3pm)