Sponsored Content
Top Forums UNIX for Dummies Questions & Answers move files between file systems with privileges, time stamp Post 302439081 by citaylor on Wednesday 21st of July 2010 05:12:04 PM
Old 07-21-2010
mv is ok, but if you get some sort of error halfway through it can be difficult to recover.

one of the fastest Ive found is (from source dir):
Code:
tar -cBpf - . | ( cd /dest ; tar -xBpf - )

It uses two processes, so they can be prioritized by the O/S (one for reading, one for writing) but it still moves the data through a pipe which just replicates data in memory and thus is not the most efficient.

scp will encrypt/decrypt and so put unnecessary load on the cpu.

cp -pr on machines like Solaris is pretty fast because it mmaps the files which means there is no duplication of the file data in memory - it is simply tagged by the o/s to be written directly to disk, so should be the most efficient. However if it isnt multithreaded it will waste time waiting for I/O.

I would personally do some tests of all of the above on your O/S using the unix "time" and see which one wins (dont just measure the real time but the system/cpu time as well)
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Need to delete the files based on the time stamp of the file

Hi Everyone, I want to delete some files in a path based on the time stamp of the file that is i want to delete the file once in a month. Can any one help me on this? Thanks in advance (2 Replies)
Discussion started by: samudha
2 Replies

2. UNIX for Dummies Questions & Answers

Copy all the files with time stamp and remove header,trailer from file

All, I am new to unix and i have the following requirement. I have file(s) landing into input directory with timestamp, first i want to copy all these files into seperate directory then i want to rename these files without timestamp and also remove header,trailer from that file.. Could... (35 Replies)
Discussion started by: ksrams
35 Replies

3. Solaris

doubt reg time stamp in files.

I copied a file from one host to another using sftp. But after copying the time stamp is not updating . Even though I checked the permission, it looks good. I copied the same file to some temporary location, there it updating the time stamp. Anyone have any idea on this (6 Replies)
Discussion started by: rogerben
6 Replies

4. Shell Programming and Scripting

Move files one at the time and wait until the previous file is handled

I'm a novice at unix and need it more and more to do my work. I seem running into problems getting this script "attempt" to work: I need to copy all files in a directory, which is containing 22000 files, into a directory one level up. There a tool monitors the content of the dir and processes... (2 Replies)
Discussion started by: compasscard
2 Replies

5. Fedora

Move file based time stamp

Hi all, I've already tired to try to solved this problem. Also search in Internet didn't find anything solution I have a directory like this : # pwd /opt/projects/juventini # ls -al | more total 3627460 drwxr-xr-x 2 app apps 12472320 Sep 24 14:59 . drwxr-xr-x 11 app apps 4096 Jun... (8 Replies)
Discussion started by: sunardo
8 Replies

6. Shell Programming and Scripting

Old time stamp being updated for new files

Hello Friends I am facing a weird problem :confused:, we receive thousands of files in my system on a daily basis, access time stamp on some of the files are being updated as old time stamp like 1968-01-19, Could some one help me what could be causing this? so that i can narrow down the problem... (4 Replies)
Discussion started by: Prateek007
4 Replies

7. Shell Programming and Scripting

Select files by time stamp

Hi, I need help to read file in a directory on basis of time stamp. e.g. If file access in last 2 minutes it should not be copy to remote directory. Below is my script. +++++++++++++++++++++++++ #!/bin/ksh DATE=`date +"%Y-%m-%d_%H%M"` SEPARATER=" " exec < out_interfaces.cfg... (1 Reply)
Discussion started by: qamar.alam
1 Replies

8. Shell Programming and Scripting

Files with date and time stamp

Hi Folks, Need a clarification on files with date and time stamp. Here is my requirement. There is a file created everyday with the following format "file.txt.YYYYMMDDHHMMSS". Now i need to check for this file and if it is available then i need to do some task to the file. I tried... (6 Replies)
Discussion started by: jayadanabalan
6 Replies

9. Shell Programming and Scripting

Need Time Stamp Range On Log Files

I have created this script #!/bin/sh FILES=/data/log/access_*.log for f in $FILES do echo "Processing $f file" cat $f | awk '{print $1}' | sort | uniq -c | sort -n | tail done It produces this output Processing /data/log/access_abc.log file 114 1.1.1.1 167 2.2.2.2 ... (38 Replies)
Discussion started by: sharingsunshine
38 Replies

10. Shell Programming and Scripting

Copying multiple files and appending time stamp before file extension

Hi, I have multiple files that read: Asa.txt Bad.txt Gnu.txt And I want to rename them using awk to Asa_ddmmyytt.txt and so on ... If there is a single command or more efficient executable please share! Thanks! (4 Replies)
Discussion started by: Jesshelle David
4 Replies
SA(8)							      System Manager's Manual							     SA(8)

NAME
sa, accton - system accounting SYNOPSIS
sa [ -abcdDfijkKlnrstu ] [ -v threshold ] [ -S savacctfile ] [ -U usracctfile ] [ file ] accton [ file ] DESCRIPTION
With an argument naming an existing file, accton causes system accounting information for every process executed to be placed at the end of the file. If no argument is given, accounting is turned off. Sa reports on, cleans up, and generally maintains accounting files. Sa is able to condense the information in /usr/adm/acct into a summary file /usr/adm/savacct which contains a count of the number of times each command was called and the time resources consumed. This condensation is desirable because on a large system /usr/adm/acct can grow by 100 blocks per day. The summary file is normally read before the accounting file, so the reports include all available information. If a file name is given as the last argument, that file will be treated as the accounting file; /usr/adm/acct is the default. Output fields are labeled: "cpu" for the sum of user+system time (in minutes), "re" for real time (also in minutes), "k" for cpu-time aver- aged core usage (in 1k units), "avio" for average number of i/o operations per execution. With options fields labeled "tio" for total i/o operations, "k*sec" for cpu storage integral (kilo-core seconds), "u" and "s" for user and system cpu time alone (both in minutes) will sometimes appear. There are near a googol of options: a Print all command names, even those containing unprintable characters and those used only once. By default, those are placed under the name `***other.' b Sort output by sum of user and system time divided by number of calls. Default sort is by sum of user and system times. c Besides total user, system, and real time for each command print percentage of total time over all commands. d Sort by average number of disk i/o operations. D Print and sort by total number of disk i/o operations. f Force no interactive threshold compression with -v flag. i Don't read in summary file. j Instead of total minutes time for each category, give seconds per call. k Sort by cpu-time average memory usage. K Print and sort by cpu-storage integral. l Separate system and user time; normally they are combined. m Print number of processes and number of CPU minutes for each user. n Sort by number of calls. r Reverse order of sort. s Merge accounting file into summary file /usr/adm/savacct when done. t For each command report ratio of real time to the sum of user and system times. u Superseding all other flags, print for each command in the accounting file the user ID and command name. v Followed by a number n, types the name of each command used n times or fewer. Await a reply from the terminal; if it begins with `y', add the command to the category `**junk**.' This is used to strip out garbage. S The following filename is used as the command summary file instead of /usr/adm/savacct. U The following filename is used instead of /usr/adm/usracct to accumulate the per-user statistics printed by the -m option. FILES
/usr/adm/acct raw accounting /usr/adm/savacct summary /usr/adm/usracct per-user summary SEE ALSO
ac(8), acct(2) BUGS
The number of options to this program is absurd. 4th Berkeley Distribution November 16, 1996 SA(8)
All times are GMT -4. The time now is 10:09 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy