Sponsored Content
Top Forums UNIX for Dummies Questions & Answers looping through subdirectories Post 302208378 by er_ashu on Monday 23rd of June 2008 05:36:34 PM
Old 06-23-2008
Quote:
Originally Posted by NYankz
ls -1R|grep :$|sed 's/:$//g'| awk '{print $1"/*"}'|xargs cat > bigfile


ls -1R #recursively searches all files in all subdirectories

grep :$ #will show all lines which end in :, this is a list of all the sub directories.

sed 's/:$//g' #removes the : from the end so you only get the full path of the directories, at this point if you want to limit which sub directories you can put in a grep statement.

awk '{print $1"/*"}' #formats the directory path to include all files in the sub directory you can change that to: awk '{print $1/"*.log"}' if you want log files only.

xargs cat #will run all of the arguments through cat which are piped into it, at this point you'd be running cat on all the files in all your sub directories

then obviously > will pipe it to a file


*edit* and yes i'm very bored at work.
Many thanks........
 

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to search all subdirectories?

Dear All, I want to write the Unix command that searches through all subdirectories, finds the files named ''core'' and deletes them. I will very much appreciate your help. David (4 Replies)
Discussion started by: david_wang
4 Replies

2. Solaris

/home Subdirectories

Hello: Could someone please explain to me how to create a subdirectory in the /home directory. I have tried creating a new user but the default path for a new user is /export/home. I am running Unix 5.8 on a Sun Blade 100. Thanks. (8 Replies)
Discussion started by: mawalton
8 Replies

3. UNIX for Dummies Questions & Answers

how to see all the subdirectories easily?

Suppose I have two directories a and b. Each directory has a few subdirectories, a1 a2 a3 and b1, b2, b3 respectively. Using ls, I can see a and b. Then I need cd a, ls, cd ../b, ls to see all the subdirectories. How to see all the directories and subdirectories easily, say using just one... (2 Replies)
Discussion started by: fld2007
2 Replies

4. UNIX for Dummies Questions & Answers

Please help me on how to loop subdirectories

Here is my question in bash for f in f1 f2 do cd $f cd ??? # i need to enter the two layers of sub folders then find the folder named "abcde" ? cd .. # how to get out two layers subdirectories? cd .. done (2 Replies)
Discussion started by: ksgreen
2 Replies

5. Shell Programming and Scripting

Please help me on how to loop subdirectories

Here is my question in bash for f in f1 f2 do cd $f cd ??? # i need to enter the two layers of sub folders then find the folder named "abcde" ? cd .. # how to get out two layers subdirectories? cd .. done (3 Replies)
Discussion started by: ksgreen
3 Replies

6. UNIX for Dummies Questions & Answers

Testing for subdirectories

Hello, Can anyone help me figure out how to test if the item in the directory is a subdirectory? I'm writing a code to copy all the contents of directory1 to directory2, but I want to skip all the subdirectories. Thanks! (4 Replies)
Discussion started by: l flipboi l
4 Replies

7. Shell Programming and Scripting

diff different subdirectories

I have 2 directories a/ and b/, they have different subdirectories, how to diff with missing file, or missing subdirectory and if i have in a/ directory "a/ACD/DEF" DEF is a file, but in b/ directory "b/ACD/DEF is a SUBDIRECTORY, how to diff it, thanks my solution for directories, ... (7 Replies)
Discussion started by: knajta
7 Replies

8. Linux

Stats on subdirectories

Please help me with a shell script to get the stats on many subdirectories (sub1), (sub2) etc under a mother directory (big) /big | |_______sub1 |_______sub2 |_______sub3 --------- I want to know 1. What is the last file accessed in each subdirectory with date and by whom 2.... (2 Replies)
Discussion started by: digipak
2 Replies

9. Shell Programming and Scripting

sed through all subdirectories?

I found this awesome sed script here: https://www.unix.com/shell-programming-scripting/48228-perl-search-string-line-then-search-replace-text.html sed -i '/MatchText/ s/ReplaceMe/REPLACED/' filename Question though to save me manually doing this. How do I do this from a root directory... (6 Replies)
Discussion started by: Astrocloud
6 Replies
AFS-UP(1)						       AFS Command Reference							 AFS-UP(1)

NAME
up - Recursively copy directories, preserving AFS metadata SYNOPSIS
up [-v] [-1] [-f] [-r] [-x] [-m] <source directory> <destination directory> DESCRIPTION
The up command recursively copies the files and subdirectories in a specified source directory to a specified destination directory. The command interpreter changes the destination directory and the files and subdirectories in it in the following ways: o It copies the source directory's access control list (ACL) to the destination directory and its subdirectories, overwriting any existing ACLs. o If the issuer is logged on as the local superuser root and has AFS tokens as a member of the group system:administrators, then the source directory's owner (as reported by the "ls -ld" command) becomes the owner of the destination directory and all files and subdirectories in it. Otherwise, the issuer's user name is recorded as the owner. o If a file or directory exists in both the source and destination directories, the source version overwrites the destination version. The overwrite operation fails if the first (user) "w" (write) mode bit is turned off on the version in the destination directory, unless the -f flag is provided. o The modification timestamp on a file (as displayed by the "ls -l" command) in the source directory overwrites the timestamp on a file of the same name in the destination directory, but the timestamp on an existing subdirectory in the destination directory remains unchanged. If the command creates a new subdirectory in the destination directory, the new subdirectory's timestamp is set to the time of the copy operation, rather than to the timestamp that the subdirectory has in the source directory. The up command is idempotent, meaning that if its execution is interrupted by a network, server machine, or process outage, then a subsequent reissue of the same command continues from the interruption point, rather than starting over at the beginning. This saves time and reduces network traffic in comparison to the UNIX commands that provide similar functionality. The up command returns a status code of 0 (zero) only if it succeeds. Otherwise, it returns a status code of 1 (one). This command does not use the syntax conventions of the AFS command suites. Provide the command name and all option names in full. OPTIONS
-v Prints a detailed trace to the standard output stream as the command runs. -1 Copies only the files in the top level source directory to the destination directory, rather than copying recursively through subdirectories. The source directory's ACL still overwrites the destination directory's. (This is the number one, not the letter "l".) -f Overwrites existing directories, subdirectories, and files even if the first (user) "w" (write) mode bit is turned off on the version in the destination directory. -m Recognize and copy mount points rather than traversing the volumes they reference during the recursive copy operation. Without -m, up's default behavior is to copy the contents of all volumes and subvolumes mounted under the source directory into the volume containing the destination directory. -r Creates a backup copy of all files overwritten in the destination directory and its subdirectories, by adding a ".old" extension to each filename. -x Sets the modification timestamp on each file to the time of the copying operation. source directory Names the directory to copy recursively. destination directory Names the directory to which to copy. It does not have to exist already. EXAMPLES
The following command copies the contents of the directory dir1 to directory dir2: % up dir1 dir2 PRIVILEGE REQUIRED
The issuer must have the "a" (administer) permission on the ACL of both the source and destination directories. COPYRIGHT
IBM Corporation 2000. <http://www.ibm.com/> All Rights Reserved. This documentation is covered by the IBM Public License Version 1.0. It was converted from HTML to POD by software written by Chas Williams and Russ Allbery, based on work by Alf Wachsmann and Elizabeth Cassell. OpenAFS 2012-03-26 AFS-UP(1)
All times are GMT -4. The time now is 08:33 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy