01-01-2015
Consider: sparse files.
A sparse file that shows 10MB used space when copied or tar-ed may occupy exponentially more file space in the new file or tar file.... Those things are the bane of backups.
I am not saying this applies here but it should be considered when the backup of nnGB will not fit in a backup file of nnGB + a tiny amount.
Sparse file have "holes", this has nice diagrams:
Sparse file - Wikipedia, the free encyclopedia
Also note that you can mount file systems in such a way as to "obscure" an underlying group of files. Ex:
a directory tree with 2GB total in the whole thing :/path/to/confusion
If you mount a file system on /path/to/confusion on the confusion directory, all of the files are there but they no longer are visible to some tools. Results of du versus df is one of them.
This may produce the same weird results being discussed. Again, you may want to consider it. Look in fstab for confirmation.
10 More Discussions You Might Find Interesting
1. UNIX Desktop Questions & Answers
Hi all,
I want to set a size limitation for some user in the system, for an example, each user only have 5MB free space in the system. The user cannot user more than 5 MB space.
Is it possible to do this? Thanks! (1 Reply)
Discussion started by: felix_koo
1 Replies
2. HP-UX
Hi All,
Can anyone please clarify me the following questions:
1. Is there any file size limitation in HP-UX 11i, that I can able to create upto certain size of file (say 2 GB) and not more then that????
2. At max. how many files we can able to keep inside a folder????
3. How many... (2 Replies)
Discussion started by: sundeep_mohanty
2 Replies
3. Shell Programming and Scripting
hi ,
iam trying to sort millions of records which is delimited and i cant able to
use sort command more than 60 million..if i try to do so i got an message stating that "File size limit exceeded",Is there any file size limit for using sort command..
How can i solve this problem.
thanks
... (7 Replies)
Discussion started by: cskumar
7 Replies
4. Linux
Hi
I am trying to rcp a file from Solaris box to Linux.
When the file size is 2,205,255,047, the rcp fails with the message
Jan 10 01:11:53 hqsas167 rsh: pam_authenticate: error Authentication failed
However when I rcp a file with smaller size - 9,434,477 - the rcp completes with... (2 Replies)
Discussion started by: schoubal
2 Replies
5. Shell Programming and Scripting
Hi to every body there,
I am new this forum and this is my first post.
I am a new user of Unix,
is there any size limitation of files while creating tar file.
Thanks in advance (4 Replies)
Discussion started by: Manvar Khan
4 Replies
6. Shell Programming and Scripting
Hi,
I am using fetchmail in my application so as to download mails to the localhost where the application is hosted from the mailserver.Fetchmail is configured as as to run as a daemon polling mails during an interval of 1sec.
So my concern here is, during each 2sec it is writing two... (10 Replies)
Discussion started by: DILEEP410
10 Replies
7. UNIX for Advanced & Expert Users
Hi All,
I ran code in test environment to find the files more than 1TB given below is a snippet from code:
FILE_SYSTEM=/home/arun
MAX_FILE_LIMIT=1099511627776
find $FILE_SYSTEM -type f -size +"$MAX_FILE_LIMIT"c -ls -xdev 2>/dev/null |
while read fname
do
echo "File larger than... (3 Replies)
Discussion started by: Arunprasad
3 Replies
8. Solaris
Hello All,
I am using a SunOS machine. My application creates output files for the downstream systems. However output files are restricted to 2GB of file size in SunOS due to which I am forced to create multiple files which is not supported by the downstream due to some limitations.
Is... (5 Replies)
Discussion started by: pasupuleti81
5 Replies
9. UNIX for Advanced & Expert Users
Hello
first, truth been told, I'm not even close to be advanced user. I'm posting here because maybe my question is complicated enough to need your expert help
I need to use awk (or nawk - I don't have gawk) to validate some files by computing the total sum for a large numeric variable.
It... (1 Reply)
Discussion started by: cwitarsa
1 Replies
10. Linux
Hello Friends,
I tried to take tar backup in my server, but it ended with an error.
It said that:
/home/back/pallava_backup/fbackup_backup/stape_config
/home/back/romam_new.tar.gz
tar: /home/backup/back.tar.gz: Cannot write: No space left on device
tar: Error is not recoverable: exiting... (10 Replies)
Discussion started by: siva3492
10 Replies
LEARN ABOUT SUSE
virt-tar-out
virt-tar-out(1) Virtualization Support virt-tar-out(1)
NAME
virt-tar-out - Pack a virtual machine disk image directory into a tarball.
SYNOPSIS
virt-tar-out -a disk.img /dir files.tar
virt-tar-out -d domain /dir files.tar
virt-tar-out -d domain /dir - | gzip --best > files.tar.gz
DESCRIPTION
"virt-tar-out" packs a virtual machine disk image directory into a tarball.
The first parameter is the absolute path of the virtual machine directory. The second parameter is the tar file to write. Use "-" to
write to standard output.
EXAMPLES
Download the home directories from a guest:
virt-tar-out -d MyGuest /home - | gzip --best > homes.tar.gz
JUST A SHELL SCRIPT WRAPPER AROUND GUESTFISH
This command is just a simple shell script wrapper around the guestfish(1) "tar-out" command. For anything more complex than a trivial
copy, you are probably better off using guestfish directly.
OPTIONS
Since the shell script just passes options straight to guestfish, read guestfish(1) to see the full list of options.
SEE ALSO
guestfish(1), virt-cat(1), virt-copy-in(1), virt-copy-out(1), virt-edit(1), virt-tar-in(1), <http://libguestfs.org/>.
AUTHORS
Richard W.M. Jones ("rjones at redhat dot com")
COPYRIGHT
Copyright (C) 2011 Red Hat Inc. <http://libguestfs.org/>
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation,
Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA.
libguestfs-1.18.1 2013-12-07 virt-tar-out(1)