De-Duplication Problem


 
Thread Tools Search this Thread
Operating Systems Linux De-Duplication Problem
# 1  
Old 12-25-2014
Linux De-Duplication Problem

Hi all,
I download and install lessfs for deduplication,
I copy files in /SharedFiles directory and lessfs work right and not store again copy files,
but, when i delete all files in /SharedFiles , not return free space to total space,
files not show in /SharedFiles , but not copy new files in it and show is not enough space,

version Lessfs:1.7Thanks ,

Last edited by jim mcnamara; 12-25-2014 at 08:13 PM..
# 2  
Old 12-25-2014
Is it possible that you have an application running which has that directory open or mounted?
Try...
find /proc/*/fd -ls | grep '(deleted)'
or
lsof /SharedFiles

Try restarting nfs maybe?
If all else fails, you could try rebooting.
# 3  
Old 12-26-2014
thanks dear,
but with rebooting service for users down,

in deduplication, lessfs hold pointer for multi copy to original blocks , and in delete copies don't delete blocks just delete pointers , so when do "df" in terminal not add free space after delete copies ,
my friends , questions is clear?
# 4  
Old 12-26-2014
Quote:
Originally Posted by saeedha
thanks dear,
but with rebooting service for users down,

in deduplication, lessfs hold pointer for multi copy to original blocks , and in delete copies don't delete blocks just delete pointers , so when do "df" in terminal not add free space after delete copies ,
my friends , questions is clear?
lessfs is a strange program to me. It's main purpose in life appears to be a backup system. It keeps it own records about freespace.
Quote:
The freelist database is used for keeping track of deleted data blocks. When a file is deleted the blocks in blockdata.dta that are no longer used will end up in the freelist database. When lessfs needs datablocks to store data it will first search in the freelist if there is space available. The 'deleted' space will therefore be reused. The data file will never shrink though!
See here for better explanation...
https://sites.google.com/a/projectme.org/lessfs/

If you truly wish to delete files and folders in /SharedFiles/ directory and reclaim that disk space, it looks like you will have to use the linux remove command rm <filename> instead of lessfs

Last edited by ongoto; 12-26-2014 at 02:43 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

UNIX Log File Content - Duplication Issue

I have a shell script with 2 run time arguments. During the execution if i got any error, then it needs to redirected to a error file and in console. Also both error and output to be redirected to a log file. Error output is getting copied to err file and getting displayed in console too. But... (2 Replies)
Discussion started by: sarathy_a35
2 Replies

2. UNIX for Beginners Questions & Answers

Duplication | awk | result

Dear forum members, I want the script to count ALA as one (an example in quotes) and return an integer as 1 and not return 5 as an integer as it does now (look bash script). So how can I upgrade my script that it first checks or after finding all instances of ALA checks whether it is the same... (25 Replies)
Discussion started by: Aurimas
25 Replies

3. UNIX for Beginners Questions & Answers

Line duplication with awk?!

So while this seemed totally trivial it turned out to be much more difficult than I had thought. I have a file with 3 rows, and I "just" want to add each field n number of times. E.g. > cat file.txt 0.5 -0.1 0.6 for n=3 into: cat newfile.txt 0.5 0.5 0.5 -0.1 -0.1 -0.1 0.6 0.6 0.6 I... (4 Replies)
Discussion started by: Glorp
4 Replies

4. Programming

Table Duplication in PHP

Hey, I am making a Facebook like Page system as my first project, So far it's been bate in mind I did it from my 3DS at the same time as my PC gets replaced, So far it's turned out great. Now I am on to creation the blocking system I need to get the code to say If the user already likes the... (0 Replies)
Discussion started by: AimyThomas
0 Replies

5. UNIX for Advanced & Expert Users

File Descriptor redirection and duplication

i have many questions concerning the FD. it was stated that "to redirect Error to output std, you have to write the following code" # ls -alt FileNotThere File > logfile 2>&1 # cat logfile ls: cannot access FileNotThere: No such file or directory -rw-r--r-- 1 root root 0 2010-02-26... (9 Replies)
Discussion started by: ahmad.zuhd
9 Replies

6. AIX

user login problem & Files listing problem.

1) when user login to the server the session got colosed. How will resolve? 2) While firing the command ls -l we are not able to see the any files in the director. but over all view the file system using the command df -g it is showing 91% used. what will be the problem? Thanks in advance. (1 Reply)
Discussion started by: pernasivam
1 Replies

7. Shell Programming and Scripting

How to avoid duplication within 2 files?

Hi all, Actually 2 files are there - file1, file2. file1 contains ---> london mosco america russia mosco file2 contains --> europe india japan mosco england london Question is I want to print all the city names without duplication cities in those... (10 Replies)
Discussion started by: balan_mca
10 Replies

8. Shell Programming and Scripting

File Duplication Script?

I have a file, let's say 1.jpg, and I have a text file that contains a list of filenames I would like to duplicate 1.jpg as (i.e., 2.jpg, 3.jpg, 4.jpg, etc.). The filenames that I want to create are all on separate lines, one per line. I'm sure there's a simple solution, but I'm not claiming to... (7 Replies)
Discussion started by: futurestar
7 Replies

9. UNIX for Advanced & Expert Users

mount LVM duplication drives

Hi, I'm stuck in an awkward situation please help :) I have two identical Seagate 80GB harddrives. My objective is a bit strange. 1.I want to have a cloned disk as bootable backup 2.When booting using the master drive, I also want to mount the cloned backup disk so I can do incremental... (6 Replies)
Discussion started by: onthetopo
6 Replies

10. Windows & DOS: Issues & Discussions

File Duplication

hi all how to find the file duplication in a windows 2000 server as usual replies are sincerely appreciated. thanks raguram R (3 Replies)
Discussion started by: raguramtgr
3 Replies
Login or Register to Ask a Question