05-24-2017
First, a sanity check: 4 terabytes, divided by a good spinning-disk transfer rate of 100 megabytes per second, is ten hours at minimum. Easily 20 for more average disks. You'd need a fancy striped RAID array, or an implausibly large SSD, to beat that.
A great deal depends on your data of course, but knowing why trillions of teeny files are slower than fewer, larger files is not helpful in making the system access trillions of teeny files faster.
Generally speaking? cp does not have a "go faster" button, or else we'd be pushing it all the time anyway. cp is not slow, naive, or wasteful.
10 More Discussions You Might Find Interesting
1. Solaris
Hi, Fairly new to the Unix worldand was wonderig without using tar and cp is there another way to copy files from one filesystem to a mount point but preserving all data, time stamp etc..
Cheers,
:D (2 Replies)
Discussion started by: Monkey007
2 Replies
2. UNIX for Dummies Questions & Answers
I have an Ingres database logfile that grows constantly, iircp.log. It is always "attached" to the Ingres process that uses it, and I do not want to screw up the data. I have been copying it to another directory and then using vi on the original to reduce the size 34000 lines at a time. What I want... (1 Reply)
Discussion started by: sarge
1 Replies
3. UNIX for Dummies Questions & Answers
Hi all
Is there a way to copy a unix filesystem (folders, subfolder and files) to windows (AD) and at the same time maintaine the unix permission (user/group) when copied to windows (AD) filesystem?
I want the same permission in windows as I had in unix in one copy job.
Is this... (8 Replies)
Discussion started by: tomjen
8 Replies
4. Shell Programming and Scripting
Here we have concern. We have a IBM software installed in a server S1 in the location : /opt/IBM.
In this server S1, we have /opt file system in local disk. We don't have any option to increase the file system there.
We have created a separate /opt/IBM_NEW file system with 10GB in S1 server.... (1 Reply)
Discussion started by: mehimadri
1 Replies
5. Solaris
Hi gurus
I configured raid 5 volume n ive created a filesystem and mounted it to a directory also...everythin is ready..the purpose of doing it is to move my data from an old filesystem pin02 to the newly created filesystem pin02_new...plz tel me the steps to move data without any... (10 Replies)
Discussion started by: madanmeer
10 Replies
6. Hardware
I am having trouble connecting my 4TB G-Raid Hard drive to my Compaq Hp laptop can anyone tell me how or what I need in order to connect the 4T and getting it working. (10 Replies)
Discussion started by: Jake Wolf
10 Replies
7. Solaris
Hi All,
We are not able to grow a UFS filesystem since its size will be going over a TB and it wasn't created using -T with newfs.
Hence we have decided to take the backup of all the files on another filesystem and recreate it using -T with newfs.
Please recommend the most reliable... (2 Replies)
Discussion started by: vishalaswani
2 Replies
8. Shell Programming and Scripting
I need to copy from specified lines and paste the data into several other lines.
XX123450008 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x
XX123451895 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x
......
XX123452012 xx.x xx.x xx.x xx.x xx.x xx.x xx.x... (13 Replies)
Discussion started by: ncwxpanther
13 Replies
9. Solaris
I have a query someone may be able to shed some light on...
We have a Solaris 10 OS Sun V490 server Sparc.
I have a SAN attached EMC Clarrion LUN which we have app data stored on.
Pseudo name=emcpower0a
CLARiiON ID=CK200070300470
Due to storage requirements - I need to migrate this... (4 Replies)
Discussion started by: ru4n1
4 Replies
10. UNIX for Advanced & Expert Users
Hi All,
I have dual boot on my laptop - Win8 And linuxMint.
From linuxmint i had copied all my data found on the NTFS partitions (on my laptop) to an
external hard drive (formatted with ext3). i used rsync for this.
Now after my hard disk crashed, am restoring the data back from ext3... (2 Replies)
Discussion started by: coolatt
2 Replies
stripe(8) System Manager's Manual stripe(8)
NAME
stripe - Stripes a file across several volumes in a file domain
SYNOPSIS
/usr/sbin/stripe -n volume_count filename
OPTIONS
Specifies the number of volumes the striped file crosses. The number of volumes must be greater than one.
OPERANDS
Specifies the name of the file to stripe.
DESCRIPTION
The stripe utility enables you to improve the read/write performance of a file. The stripe utility directs a zero-length file (a file with
no data written to it yet) to be spread evenly across several volumes within a file domain. As data is appended to the file, the data is
spread across the volumes. AdvFS determines the number of pages per stripe segment and alternates the segments among the disks in a sequen-
tial pattern.
Existing, nonzero-length files cannot be striped using the stripe utility. To stripe an existing file, create a new file, use the stripe
utility to stripe the new file, and copy the contents of the file you want to stripe into the new striped file. After copying the file,
delete the nonstriped file.
Once a file is striped, you cannot use the stripe utility to modify the number of disks that a striped file crosses. To change the volume
count of a striped file, you can create a second file with a new volume count, and then copy the contents of the first file into the second
file. After copying the file, delete the first file.
RESTRICTIONS
You cannot stripe a nonzero-length file or a file that is already striped.
EXAMPLES
The following example stripes the file abc across three volumes in the same file domain: # stripe -n 3 abc The following example stripes an
existing, nonzero-length file, foo, across three volumes in the same domain. First a new file, newfoo, is created and striped. Then, the
contents of file foo are copied to the new, striped file: # touch newfoo # stripe -n 3 newfoo # cp foo newfoo
SEE ALSO
advfs(4), showfile(8)
stripe(8)