Compressed Filesystem for Linux


 
Thread Tools Search this Thread
Special Forums Hardware Filesystems, Disks and Memory Compressed Filesystem for Linux
# 1  
Old 06-13-2013
Reference Compressed Filesystem for Linux

Hi Everybody:

I'm searching a compressed Filesystem for a external disk, what I use for a full, diary and differential Backup.

The performance is not important, I search the best option for compress data, but I want have access to structure disk, with directories and files in the Backup disk.

I'm thinking in SquashFS.
What do you recommend me?

Best Regards,
# 2  
Old 06-13-2013
I wonder if zip and its imitators, with it's smart choice of compression, might outperform a compressed FS. I am wondering if somtone has set it up so a zip can be mounted as a file system. Yup: http://www.google.com/search?q=zip+file+system+mount

A FS with versioning might make backups simpler -- just lay it down and if it is different, the old one is versioned into the background. I could have swore wiki had a real nice chart of many FS, but this is all I found: https://en.wikipedia.org/wiki/List_of_file_systems But then I looked in see also and found it: https://en.wikipedia.org/wiki/Compar...f_file_systems

I always wanted to see a FS where directories are enhanced to allow them to contain small files like an archive, and by extension small directories, so a big empty file tree might physically be one directory node. Files that grow past a threshold get rousted out. I guess zip gets pretty close to that. It recovers space from lightly used pages, like a 4.1 page file using 5 pages, and allows compression transparently. A tree or hash container for directory entries might be nice, too.

Last edited by DGPickett; 06-13-2013 at 02:55 PM..
This User Gave Thanks to DGPickett For This Post:
# 3  
Old 06-13-2013
ext3/4 have hashes for big enough directories I believe. Lots of these features can be found in different things, but seldom all together.
# 4  
Old 06-13-2013
Reference Filesystems with transparent compression

Mmmm, I can see some FS with transparent compression (I suppose that's what you mean):

- Btrfs:
it could be

- HFS Plus
Apple, oh no, its the Devil Smilie!

- Reiser4
it could be

- NSS & NWFS
Novell, I don't know it's free, but it's not in my Debian repository

- Fossil
I have not heard in my life!

- ZFS
I had wanted to try it, but it's on Fuse in Debian Repository, I don't know...

I think the options are:
Btrfs, Reiser4 and ZFS (I doubt about it).

What's your opinion??
# 5  
Old 06-13-2013
I wonder if you can achieve compressed backup with some sort of hybrid mirror, where files on one side are compressed once quiescent, and on the other side, are left uncompressed. Compression would occur in the background, not at write time.
# 6  
Old 06-13-2013
That's the idea

I want a mirror, the backup is differential, diary, and very little (only differences).

But the external disk with a FS compressed, must consume less space than the original data, I think.
# 7  
Old 06-13-2013
Sending it over compressed can save time, too. Variations on zip allow the compression locally and the storage remote.
This User Gave Thanks to DGPickett For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Is there any way to find the compressed size of a file without compressing it in linux

i need to backup a directory from one partition to another and and compress that directory after backing up, so i need to predict the compressed size of the directory with out actually compressing it, to check whether the space is available in the destination partition to accommodate the zipped... (2 Replies)
Discussion started by: Kesavan
2 Replies

2. Linux

Partition of linux filesystem wit meaning

Cud some one pls help me wit some partitions of linux filesystem wit their meaning....urgent cos is an assignment (5 Replies)
Discussion started by: GODBLESSME
5 Replies

3. Linux

filesystem locking issue on linux

hi, we are getting filesystem locking issue very frequently. we are using linux rhel 5.5. our filesystem type is gfs2 where we are facing locking issue and unix admin team reboots server to over come with this issue. suddenly we used to face slowness on server and server gets hung. after that... (1 Reply)
Discussion started by: anshu ranjan
1 Replies

4. SuSE

filesystem from unix 32 to linux 64

Hi all. Im migrating from a Unix 32 bit to a linux suse 10 64 bit and would like to know whats the best way to migrate the filesystems? cpio? tar? ftp? Could I make a backup in tape in the unix 32 and restore it in the linux 64? thanx (1 Reply)
Discussion started by: mrodrig
1 Replies

5. UNIX for Dummies Questions & Answers

How can I check if I have raw filesystem on unix/linux

Hello again. Please can someone tell me how can i check if my filesystem is raw on unix/linux ? Is there some file to check or something like that to be sure ? also , when i do : $ ls -l /dev/rdisk i get among other things , this also(there resides are oracle related files) : ... (2 Replies)
Discussion started by: tonijel
2 Replies

6. UNIX for Advanced & Expert Users

Linux FileSystem Internal Buffer size:

I know that Univ FileSystem stores all file data in the form of first few direct nodes followed by indirect nodes. But internally some systems implement where , a single block of 4096 isnt allocated alone a single block basis on physical drive, rather a large chunk of data is allocated and no. of... (1 Reply)
Discussion started by: GloriousDaisy
1 Replies

7. Programming

Uncompress on linux a UDP Payload compressed on win$ using closed source library

I am trying to uncompress a UDP packets payload. The data was compressed using "Xceed Version 4.3" which is a closed source windows program. I need to uncompress the data on a linux box. The technical support people at Xceed tell me that the data was compressed using "the Deflate compression method... (0 Replies)
Discussion started by: sysadmin9
0 Replies

8. Tips and Tutorials

Linux Filesystem Hierarchy

Hi, Please have a look this: http://tldp.org/LDP/Linux-Filesystem-Hierarchy/Linux-Filesystem-Hierarchy.pdf I think this can be very useful for a beginner/intermediate level user to understand the filesystem hierarchy and as well as it can be used as a reference to various linux commands and... (0 Replies)
Discussion started by: tayyabq8
0 Replies

9. Linux

Linux filesystem

Hi all, Suppose i have a disk having three partitions (hda1,hda2,hda3) ,and are mounted all under /dev/ .. My question is where the / will be existing.which file system it wil be in? I am windows user new to linux/unix.Any help in learning internals would be appreciated . Thanks ,... (1 Reply)
Discussion started by: gkrishn
1 Replies

10. Filesystems, Disks and Memory

Filesystem for Linux - Solaris

Do you know how I can find detailed information on filesystems on Linux and Solaris. And I mean not only for the OS but and how it(the OS) uses the hard drives! Thank you in advance!! Solid Snake;) ;) (3 Replies)
Discussion started by: SolidSnake
3 Replies
Login or Register to Ask a Question