Sponsored Content
Top Forums Shell Programming and Scripting Massive Copy With Base Directory Post 302676475 by alister on Tuesday 24th of July 2012 04:07:43 PM
Old 07-24-2012
Quote:
Originally Posted by nitrobass24
Is there a way around that barrier of CP/PAX 70k time?

Im open to ideas.

I need it to be simple/work on all systems/be automated.
Once i have it finished we will be running on approx 1000 servers.
You don't need to call pax 70k times, i.e. once per file. You invoke pax once and it reads the list of files to copy from stdin. Using your variable names:
Code:
pax -rw "$DESTDIR" < "$TEMPFILE"

That said, Corona's rsync suggestion may be the best alternative if you will be updating the target after (possibly minor) changes in the source.

Regards,
Alister
This User Gave Thanks to alister For This Post:
 

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Find command to run only in the base directory

Hi. I'm trying to get my find command to only search in the directory i tell it to, but i don't want it to search in the sub directories as well... For example, i have a /data/files/ and /data/files/old I want to search for all .sav files within /data/files but i don't want it to drill... (4 Replies)
Discussion started by: Stephan
4 Replies

2. Solaris

Missing Base Directory

Hey all, I'm attempting to migrate a zone from one system to another, but I noticed that on the new system ssl BASEDIR was missing. I was wondering if creating the directory path for this would fix the issue when I migrate files over. SSL is installed on the new system but does not show a... (1 Reply)
Discussion started by: em23
1 Replies

3. Shell Programming and Scripting

Copy Last modified directory to another directory

Hi, I have to copy last modified Directory to another directory.How can i Do using pipe or redirect cp -R 'ls -lrt|tail -1' test is not working. please help. (3 Replies)
Discussion started by: shaveta
3 Replies

4. Shell Programming and Scripting

Base directory of the package

Hello, I have an RPM package for which I need to know the base directory /opt/appdir. But if the package is relocated, then it will be different. I need to get the value dynamically. I tried to query the RPM with INSTPREFIXES but couldn't get the value. The only way I see is to do 'rpm -ql RPM... (2 Replies)
Discussion started by: chiru_h
2 Replies

5. Shell Programming and Scripting

how to copy the directory but not copy certain file

Hi experts cp bin root src /mnt but not copy bin/bigfile any help? ( I post this thread in the "redhat" forum wrongly, I don't know how to withdraw that question in that wrong forum) Thanks (6 Replies)
Discussion started by: yanglei_fage
6 Replies

6. Shell Programming and Scripting

Copy the files in directory and sub folders as it is to another directory.

How to copy files from one directory to another directory with the subfolders copied. If i have folder1/sub1/sub2/* it needs to copy files to folder2/sub1/sub2/*. I do not want to create sub folders in folder2. Can copy command create them automatically? I tried cp -a and cp -R but did... (4 Replies)
Discussion started by: santosh2626
4 Replies

7. Shell Programming and Scripting

Copy same name data from other file base on column

HI I have input file A.txt X Y Z File B.txt 1 X 10 AAA 11123 2 Y 22 PlD 4563 3 Z 55 PlD 54645 4 Z 66 PlD 15698 5 F 44 PlD 154798 6 C 55 PlD 12554 7 Z 88 PlD 23265 8 C 99 PlD 151654 9 C 11 PlD 21546546 I need New File C.txt (1 Reply)
Discussion started by: pareshkp
1 Replies

8. Shell Programming and Scripting

Delete directory on date base

Hi, I have below directories Direct 2013-08-12 23123 Direct 2013-08-13 24121 Direct 2013-08-14 34513 Direct 2013-08-31 15435 ........... Direct 2013-09-12 53145 Direct 2013-09-30 65234 Direct 2013-09-30 89642 (11 Replies)
Discussion started by: learnbash
11 Replies

9. Shell Programming and Scripting

Massive ftp

friends good morning FTP works perfect but I have a doubt if I want to transport 10 files, I imagine that I should not open 10 connections as I can transfer more than 1 file? ftp -n <<!EOF open caburga user ephfact ephfact cd /users/efactura/docONE/entrada bin mput EPH`date... (16 Replies)
Discussion started by: tricampeon81
16 Replies
pathchk(1)							   User Commands							pathchk(1)

NAME
pathchk - check path names SYNOPSIS
pathchk [-p] path... DESCRIPTION
The pathchk command will check that one or more path names are valid (that is, they could be used to access or create a file without caus- ing syntax errors) and portable (that is, no filename truncation will result). More extensive portability checks are provided by the -p option. By default, pathchk will check each component of each path operand based on the underlying file system. A diagnostic will be written for each path operand that: o is longer than PATH_MAX bytes. o contains any component longer than NAME_MAX bytes in its containing directory o contains any component in a directory that is not searchable o contains any character in any component that is not valid in its containing directory. The format of the diagnostic message is not specified, but will indicate the error detected and the corresponding path operand. It will not be considered an error if one or more components of a path operand do not exist as long as a file matching the path name speci- fied by the missing components could be created that does not violate any of the checks specified above. OPTIONS
The following option is supported: -p Instead of performing checks based on the underlying file system, write a diagnostic for each path operand that: o is longer than _POSIX_PATH_MAX bytes o contains any component longer than _POSIX_NAME_MAX bytes o contains any character in any component that is not in the portable filename character set. OPERANDS
The following operand is supported: path A path to be checked. USAGE
See largefile(5) for the description of the behavior of pathchk when encountering files greater than or equal to 2 Gbyte ( 2**31 bytes). EXAMPLES
Example 1: Using the pathchk command To verify that all paths in an imported data interchange archive are legitimate and unambiguous on the current system: example% pax -f archive | sed -e '/ == .*/s///' | xargs pathchk if [ $? -eq 0 ] then pax -r -f archive else echo Investigate problems before importing files. exit 1 fi To verify that all files in the current directory hierarchy could be moved to any system conforming to the X/Open specification that also supports the pax(1) command: example% find . -print | xargs pathchk -p if [ $? -eq 0 ] then pax -w -f archive . else echo Portable archive cannot be created. exit 1 fi To verify that a user-supplied path names a readable file and that the application can create a file extending the given path without trun- cation and without overwriting any existing file: example% case $- in *C*) reset="";; *) reset="set +C" set -C;; esac test -r "$path" && pathchk "$path.out" && rm "$path.out" > "$path.out" if [ $? -ne 0 ]; then printf "%s: %s not found or %s.out fails creation checks. " $0 "$path" "$path" $reset # reset the noclobber option in case a trap # on EXIT depends on it exit 1 fi $reset PROCESSING < "$path" > "$path.out" The following assumptions are made in this example: 1. PROCESSING represents the code that will be used by the application to use $path once it is verified that $path.out will work as intended. 2. The state of the noclobber option is unknown when this code is invoked and should be set on exit to the state it was in when this code was invoked. (The reset variable is used in this example to restore the initial state.) 3. Note the usage of: rm "$path.out" > "$path.out" a. The pathchk command has already verified, at this point, that $path.out will not be truncated. b. With the noclobber option set, the shell will verify that $path.out does not already exist before invoking rm. c. If the shell succeeded in creating $path.out, rm will remove it so that the application can create the file again in the PRO- CESSING step. d. If the PROCESSING step wants the file to exist already when it is invoked, the: rm "$path.out" > "$path.out" should be replaced with: > "$path.out" which will verify that the file did not already exist, but leave $path.out in place for use by PROCESSING. ENVIRONMENT VARIABLES
See environ(5) for descriptions of the following environment variables that affect the execution of pathchk: LANG, LC_ALL, LC_CTYPE, LC_MESSAGES, and NLSPATH. EXIT STATUS
The following exit values are returned: 0 All path operands passed all of the checks. >0 An error occurred. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWcsu | +-----------------------------+-----------------------------+ |Interface Stability |Standard | +-----------------------------+-----------------------------+ SEE ALSO
pax(1), test(1), attributes(5), environ(5), largefile(5), standards(5) SunOS 5.10 1 Feb 1995 pathchk(1)
All times are GMT -4. The time now is 01:31 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy