05-25-2017
Quote:
Originally Posted by
achenle
This might be better, as it won't run into globbing issues
True, but my point was rather to suggest the general idea than to provide a watertight solution. I could have written
by creating an I/O-stream (via tar) from the various files and using the restore-part of tar instead of single-threaded file-I/O as with cp it might be - probably depending on the exact implementation of tar - a bit faster than using cp as well.
Quote:
Originally Posted by
achenle
But it probably won't be any faster than cp anyway.
Yes, i could be mistaken and i don't have any prior experience with copying this much data (the only times i had to move so much data i did it with SAN-methods, foregoing the OS completely). It is just - IMHO - worth a try.
At any rate: you surely are correct that in using different storage technologies - faster disks, tiered storage, etc., in other words changing the underlying physics - will have more effect than anything even the most clever OS trick can hope to achieve.
bakunin
10 More Discussions You Might Find Interesting
1. Solaris
Hi, Fairly new to the Unix worldand was wonderig without using tar and cp is there another way to copy files from one filesystem to a mount point but preserving all data, time stamp etc..
Cheers,
:D (2 Replies)
Discussion started by: Monkey007
2 Replies
2. UNIX for Dummies Questions & Answers
I have an Ingres database logfile that grows constantly, iircp.log. It is always "attached" to the Ingres process that uses it, and I do not want to screw up the data. I have been copying it to another directory and then using vi on the original to reduce the size 34000 lines at a time. What I want... (1 Reply)
Discussion started by: sarge
1 Replies
3. UNIX for Dummies Questions & Answers
Hi all
Is there a way to copy a unix filesystem (folders, subfolder and files) to windows (AD) and at the same time maintaine the unix permission (user/group) when copied to windows (AD) filesystem?
I want the same permission in windows as I had in unix in one copy job.
Is this... (8 Replies)
Discussion started by: tomjen
8 Replies
4. Shell Programming and Scripting
Here we have concern. We have a IBM software installed in a server S1 in the location : /opt/IBM.
In this server S1, we have /opt file system in local disk. We don't have any option to increase the file system there.
We have created a separate /opt/IBM_NEW file system with 10GB in S1 server.... (1 Reply)
Discussion started by: mehimadri
1 Replies
5. Solaris
Hi gurus
I configured raid 5 volume n ive created a filesystem and mounted it to a directory also...everythin is ready..the purpose of doing it is to move my data from an old filesystem pin02 to the newly created filesystem pin02_new...plz tel me the steps to move data without any... (10 Replies)
Discussion started by: madanmeer
10 Replies
6. Hardware
I am having trouble connecting my 4TB G-Raid Hard drive to my Compaq Hp laptop can anyone tell me how or what I need in order to connect the 4T and getting it working. (10 Replies)
Discussion started by: Jake Wolf
10 Replies
7. Solaris
Hi All,
We are not able to grow a UFS filesystem since its size will be going over a TB and it wasn't created using -T with newfs.
Hence we have decided to take the backup of all the files on another filesystem and recreate it using -T with newfs.
Please recommend the most reliable... (2 Replies)
Discussion started by: vishalaswani
2 Replies
8. Shell Programming and Scripting
I need to copy from specified lines and paste the data into several other lines.
XX123450008 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x
XX123451895 xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x xx.x
......
XX123452012 xx.x xx.x xx.x xx.x xx.x xx.x xx.x... (13 Replies)
Discussion started by: ncwxpanther
13 Replies
9. Solaris
I have a query someone may be able to shed some light on...
We have a Solaris 10 OS Sun V490 server Sparc.
I have a SAN attached EMC Clarrion LUN which we have app data stored on.
Pseudo name=emcpower0a
CLARiiON ID=CK200070300470
Due to storage requirements - I need to migrate this... (4 Replies)
Discussion started by: ru4n1
4 Replies
10. UNIX for Advanced & Expert Users
Hi All,
I have dual boot on my laptop - Win8 And linuxMint.
From linuxmint i had copied all my data found on the NTFS partitions (on my laptop) to an
external hard drive (formatted with ext3). i used rsync for this.
Now after my hard disk crashed, am restoring the data back from ext3... (2 Replies)
Discussion started by: coolatt
2 Replies
LEARN ABOUT LINUX
git-tar-tree
GIT-TAR-TREE(1) Git Manual GIT-TAR-TREE(1)
NAME
git-tar-tree - Create a tar archive of the files in the named tree object
SYNOPSIS
git tar-tree [--remote=<repo>] <tree-ish> [ <base> ]
DESCRIPTION
THIS COMMAND IS DEPRECATED. Use git archive with --format=tar option instead (and move the <base> argument to --prefix=base/).
Creates a tar archive containing the tree structure for the named tree. When <base> is specified it is added as a leading path to the files
in the generated tar archive.
git tar-tree behaves differently when given a tree ID versus when given a commit ID or tag ID. In the first case the current time is used
as modification time of each file in the archive. In the latter case the commit time as recorded in the referenced commit object is used
instead. Additionally the commit ID is stored in a global extended pax header. It can be extracted using git get-tar-commit-id.
OPTIONS
<tree-ish>
The tree or commit to produce tar archive for. If it is the object name of a commit object.
<base>
Leading path to the files in the resulting tar archive.
--remote=<repo>
Instead of making a tar archive from local repository, retrieve a tar archive from a remote repository.
CONFIGURATION
tar.umask
This variable can be used to restrict the permission bits of tar archive entries. The default is 0002, which turns off the world write
bit. The special value "user" indicates that the archiving user's umask will be used instead. See umask(2) for details.
EXAMPLES
git tar-tree HEAD junk | (cd /var/tmp/ && tar xf -)
Create a tar archive that contains the contents of the latest commit on the current branch, and extracts it in /var/tmp/junk directory.
git tar-tree v1.4.0 git-1.4.0 | gzip >git-1.4.0.tar.gz
Create a tarball for v1.4.0 release.
git tar-tree v1.4.0^{tree} git-1.4.0 | gzip >git-1.4.0.tar.gz
Create a tarball for v1.4.0 release, but without a global extended pax header.
git tar-tree --remote=example.com:git.git v1.4.0 >git-1.4.0.tar
Get a tarball v1.4.0 from example.com.
git tar-tree HEAD:Documentation/ git-docs > git-1.4.0-docs.tar
Put everything in the current head's Documentation/ directory into git-1.4.0-docs.tar, with the prefix git-docs/.
GIT
Part of the git(1) suite
Git 1.8.5.3 01/14/2014 GIT-TAR-TREE(1)