Sponsored Content
Full Discussion: maximum tar file size?
Top Forums UNIX for Dummies Questions & Answers maximum tar file size? Post 302152657 by Bobby on Thursday 20th of December 2007 06:46:47 PM
Old 12-20-2007
Question maximum tar file size?

Is there a reasonable maximum limit for tar file sizes? I want to transfer a pile of files from one server to another but have restricted means, so tarring them first will probably be best... but how big can I go - both for the file format itself and for the operating system (linux) to handle? We're talking thousands upon thousands of files, and many many gigabytes. Should I keep things under 4 gigs per file, or can they safely exceed ten or twenty or thrity gigs each?

Thanks.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Maximum size of sed file...

The sed -f option (reading sed commands from a file) seems to have a limit of 200 transactions per file. I can't see anything in the man pages about this restriction. I have a file with several thousand sed commands I need to perform (substitutions) - and while I can split the file into... (14 Replies)
Discussion started by: peter.herlihy
14 Replies

2. UNIX for Dummies Questions & Answers

tar file size (volume) limiting

Hi I am trying to create tar files of a whole bunch of files and want to limit them to 50Mb each. I have tried using the -k option but cannot get it to work. Has anyone out there had success creating these? Cheers Ian (1 Reply)
Discussion started by: bigjeff
1 Replies

3. Programming

Maximum File Size

Hi, When i checked for the maximum file size on solaris 5.9 the max file size obtained was only 2147483647 and all the further writes to the file which had reached that max size is not added to that file. even i had registered the signal SIGXFSZ, but the signal was not delivered to the... (5 Replies)
Discussion started by: matrixmadhan
5 Replies

4. UNIX for Dummies Questions & Answers

Maximum input file size in "Diff" Command

Hello, Can anyone let me know what is the maximum file size that can be given as input for the "Diff" Command in Unix? I have a file size as large as 28MB and which can also increase. Will I face any issues with such a file size. If yes, What is the other alternative. Thanks in advance for... (1 Reply)
Discussion started by: Neeraja
1 Replies

5. UNIX for Dummies Questions & Answers

Maximum size of a file in unix

What's the maximum file size supported by unix. (3 Replies)
Discussion started by: nagalenoj
3 Replies

6. UNIX for Dummies Questions & Answers

Maximum file size ????

Hi All, - block size of 512KB & every address requires 4 bits - The inode structure contains 10 direct pointers, 1 single indirect, 1 double indirect & 1 triple indirect pointer What could be the possible maximum file size for this system Any guess? I am unable to understand the question... (0 Replies)
Discussion started by: preethgideon
0 Replies

7. Shell Programming and Scripting

How to get the size of tar,Z,gz type file.

Hi, How to get the size of the .tar file .Z file .gz file. Please help me what command i need to use in shell scripting :( Regards, Kalai (3 Replies)
Discussion started by: kalpeer
3 Replies

8. UNIX for Advanced & Expert Users

How to identify maximum stack size?

Hi All, I have set max stack size as 4KB for my thread, but it always using very less. So I like to know what is the maximum stack size is used by my thread. I tried with gcc -fstack-usage command line option, but its not supported by mips. Kindly suggest me the way to find the max stack... (6 Replies)
Discussion started by: rajamohan
6 Replies

9. Programming

Maximum buffer size for read()

Hi friends, Hope everybody is fine. First have a look at my code, then we will talk about it. $ cat copy.c #include <stdio.h> #define PERMS 0644 /* RW for owner, R for group, others */ #define BUFSIZE 1 char *progname; int main(int argc,char * argv) { int f1, f2, n; ... (4 Replies)
Discussion started by: gabam
4 Replies

10. Shell Programming and Scripting

Compress a tar file to smaller size

I have a tar file with name DTT012_GP_20140207.tar and many more with different names of different sizes ranging from 1GB to 4GB. Now my requirement is to extract/not extract these files and then divide it into various parts of size 500MB and save it with different names and then compress... (5 Replies)
Discussion started by: Shaibal_bp
5 Replies
RPC.YPXFRD(8)						    BSD System Manager's Manual 					     RPC.YPXFRD(8)

NAME
rpc.ypxfrd -- NIS map transfer server SYNOPSIS
rpc.ypxfrd [-p path] DESCRIPTION
The rpc.ypxfrd utility is used to speed up the distribution of very large NIS maps from NIS master to NIS slave servers. The normal method for transferring maps involves several steps: o The master server calls yppush(8) to inform the slave servers to start a transfer. o The slave servers invoke ypxfr(8), which reads the entire contents of a map from the master server using the yp_all() function. o The ypxfr(8) program then creates a new map database file by using the db(3) library hash method to store the data that it receives from the server. o When all the data has been retrieved, ypxfr(8) moves the new file into place and sends ypserv(8) on the local machine a YPPROC_CLEAR to tell it to refresh its database handles. This process can take several minutes when there are very large maps involved. For example: a passwd database with several tens of thousands of entries can consume several megabytes of disk space, and it can take the db(3) library package a long time to sort and store all the records in a hash database. Consider also that there are two sets of map files: master.passwd.by{name,uid} and passwd.by{name,uid}. The rpc.ypxfrd utility speeds up the transfer process by allowing NIS slave servers to simply copy the master server's map files rather than building their own from scratch. Simply put, rpc.ypxfrd implements an RPC-based file transfer protocol. Transferring even a multi-megabyte file in this fashion takes only a few seconds compared to the several minutes it would take even a reasonably fast slave server to build a new map from scratch. The rpc.ypxfrd utility uses the same access restriction mechanism as ypserv(8). This means that slave servers will only be permitted to transfer files if the rules in the securenets database permit it (see ypserv(8) for more information on securenets). Furthermore, only slave servers using reserved ports will be allowed to transfer the master.passwd maps. OPTIONS
The following option is available: -p path This option can be used to override the default path to the location of the NIS map databases. The compiled-in default path is /var/yp. FILES
/var/yp/[domainname]/[maps] The NIS maps for a particular NIS domain. SEE ALSO
yp(8), yppush(8), ypserv(8), ypxfr(8) AUTHORS
Bill Paul <wpaul@ctr.columbia.edu> BUGS
The FreeBSD ypxfrd protocol is not compatible with that used by SunOS. This is unfortunate but unavoidable: Sun's protocol is not freely available, and even if it were it would probably not be useful since the SunOS NIS v2 implementation uses the original ndbm package for its map databases whereas the FreeBSD implementation uses Berkeley DB. These two packages use vastly different file formats. Furthermore, ndbm is byte-order sensitive and not very smart about it, meaning that am ndbm database created on a big endian system cannot be read on a little endian system. BSD
June 2, 1996 BSD
All times are GMT -4. The time now is 04:54 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy