Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Best way to copy 4Tb of data from one filesystem to another
Operating Systems Solaris Best way to copy 4Tb of data from one filesystem to another Post 302998037 by Corona688 on Wednesday 24th of May 2017 11:58:59 AM
Old 05-24-2017
First, a sanity check: 4 terabytes, divided by a good spinning-disk transfer rate of 100 megabytes per second, is ten hours at minimum. Easily 20 for more average disks. You'd need a fancy striped RAID array, or an implausibly large SSD, to beat that.

A great deal depends on your data of course, but knowing why trillions of teeny files are slower than fewer, larger files is not helpful in making the system access trillions of teeny files faster.

Generally speaking? cp does not have a "go faster" button, or else we'd be pushing it all the time anyway. cp is not slow, naive, or wasteful.
 

10 More Discussions You Might Find Interesting

1. Solaris

Filesystem Copy

Hi, Fairly new to the Unix worldand was wonderig without using tar and cp is there another way to copy files from one filesystem to a mount point but preserving all data, time stamp etc.. Cheers, :D (2 Replies)
Discussion started by: Monkey007
2 Replies

2. UNIX for Dummies Questions & Answers

copy, clear and keep to new data only

I have an Ingres database logfile that grows constantly, iircp.log. It is always "attached" to the Ingres process that uses it, and I do not want to screw up the data. I have been copying it to another directory and then using vi on the original to reduce the size 34000 lines at a time. What I want... (1 Reply)
Discussion started by: sarge
1 Replies

3. UNIX for Dummies Questions & Answers

Copy unix filesystem to windows

Hi all Is there a way to copy a unix filesystem (folders, subfolder and files) to windows (AD) and at the same time maintaine the unix permission (user/group) when copied to windows (AD) filesystem? I want the same permission in windows as I had in unix in one copy job. Is this... (8 Replies)
Discussion started by: tomjen
8 Replies

4. Shell Programming and Scripting

Will moving data from one filesystem to another affect current software installation

Here we have concern. We have a IBM software installed in a server S1 in the location : /opt/IBM. In this server S1, we have /opt file system in local disk. We don't have any option to increase the file system there. We have created a separate /opt/IBM_NEW file system with 10GB in S1 server.... (1 Reply)
Discussion started by: mehimadri
1 Replies

5. Solaris

copy data from one old filesystem to newfilesystem

Hi gurus I configured raid 5 volume n ive created a filesystem and mounted it to a directory also...everythin is ready..the purpose of doing it is to move my data from an old filesystem pin02 to the newly created filesystem pin02_new...plz tel me the steps to move data without any... (10 Replies)
Discussion started by: madanmeer
10 Replies

6. Hardware

How to connect a 4TB G-Raid hard drive to a laptop?

I am having trouble connecting my 4TB G-Raid Hard drive to my Compaq Hp laptop can anyone tell me how or what I need in order to connect the 4T and getting it working. (10 Replies)
Discussion started by: Jake Wolf
10 Replies

7. Solaris

Copy data over a TB

Hi All, We are not able to grow a UFS filesystem since its size will be going over a TB and it wasn't created using -T with newfs. Hence we have decided to take the backup of all the files on another filesystem and recreate it using -T with newfs. Please recommend the most reliable... (2 Replies)
Discussion started by: vishalaswani
2 Replies

8. Shell Programming and Scripting

Copy and paste data

I need to copy from specified lines and paste the data into several other lines. XX123450008 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x XX123451895 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x ...... XX123452012 xx.x xx.x xx.x xx.x xx.x xx.x xx.x... (13 Replies)
Discussion started by: ncwxpanther
13 Replies

9. Solaris

Solaris Filesystem usage discrepancy after "copy"

I have a query someone may be able to shed some light on... We have a Solaris 10 OS Sun V490 server Sparc. I have a SAN attached EMC Clarrion LUN which we have app data stored on. Pseudo name=emcpower0a CLARiiON ID=CK200070300470 Due to storage requirements - I need to migrate this... (4 Replies)
Discussion started by: ru4n1
4 Replies

10. UNIX for Advanced & Expert Users

Errors received while restoring my data from ext3 filesystem

Hi All, I have dual boot on my laptop - Win8 And linuxMint. From linuxmint i had copied all my data found on the NTFS partitions (on my laptop) to an external hard drive (formatted with ext3). i used rsync for this. Now after my hard disk crashed, am restoring the data back from ext3... (2 Replies)
Discussion started by: coolatt
2 Replies

LEARN ABOUT DEBIAN

ocf_heartbeat_rsyncd

OCF_HEARTBEAT_RSYNCD(7) 					OCF resource agents					   OCF_HEARTBEAT_RSYNCD(7)

NAME

       ocf_heartbeat_rsyncd - Manages an rsync daemon

SYNOPSIS

       rsyncd [start | stop | monitor | meta-data | validate-all]

DESCRIPTION

       This script manages rsync daemon

SUPPORTED PARAMETERS

       binpath
	   The rsync binary path. For example, "/usr/bin/rsync" (optional, string, default rsync)

       conffile
	   The rsync daemon configuration file name with full path. For example, "/etc/rsyncd.conf" (optional, string, default /etc/rsyncd.conf)

       bwlimit
	   This option allows you to specify a maximum transfer rate in kilobytes per second. This option is most effective when using rsync with
	   large files (several megabytes and up). Due to the nature of rsync transfers, blocks of data are sent, then if rsync determines the
	   transfer was too fast, it will wait before sending the next data block. The result is an average transfer rate equaling the specified
	   limit. A value of zero specifies no limit.  (optional, string, no default)

SUPPORTED ACTIONS

       This resource agent supports the following actions (operations):

       start
	   Starts the resource. Suggested minimum timeout: 20s.

       stop
	   Stops the resource. Suggested minimum timeout: 20s.

       monitor
	   Performs a detailed status check. Suggested minimum timeout: 20s. Suggested interval: 60s.

       validate-all
	   Performs a validation of the resource configuration. Suggested minimum timeout: 20s.

       meta-data
	   Retrieves resource agent metadata (internal use only). Suggested minimum timeout: 5s.

EXAMPLE

       The following is an example configuration for a rsyncd resource using the crm(8) shell:

	   primitive p_rsyncd ocf:heartbeat:rsyncd 
	     op monitor depth="0" timeout="20s" interval="60s"

SEE ALSO

       http://www.linux-ha.org/wiki/rsyncd_(resource_agent)

AUTHOR

       Linux-HA contributors (see the resource agent source for information about individual authors)

resource-agents UNKNOWN 					    03/09/2014						   OCF_HEARTBEAT_RSYNCD(7)
All times are GMT -4. The time now is 08:50 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy