Sponsored Content
Full Discussion: Two folder comparison
Top Forums Shell Programming and Scripting Two folder comparison Post 302188000 by era on Tuesday 22nd of April 2008 12:31:07 PM
Old 04-22-2008
This would be a lot simpler if you could make a temporary copy of both directories. Is this feasible, or are they too large?

Code:
mkdir /tmp/dir1 /tmp/dir2
for file in dir1/* dir2/*; do
  egrep -v '^(HDR|FTR)' "$file" | sort >/tmp/"$file"
done
diff -rad /tmp/dir1 /tmp/dir2 | egrep '^(diff|Only in )'

... assuming dir1 and dir2 are the original directories you want to compare. If they are in different places in the file system, perhaps it would be easiest to create symlinks for the duration of this script. And of course, once you are done, you can remove the copies in /tmp/dir1 and /tmp/dir2.

The output from diff is not particularly intuitive but it contains the information you request; you can post-process it with sed, or simply load it in your editor and massage it into something your manager can understand.

I'm not sure I captured the sorting requirement correctly. This creates sorted copies of each file, after removing the HDR and FTR lines; if you want all the content in a single file, of course, that can be done, too (but running diff on a single huge file is going to be painful).

diff is really overkill for this problem, but it produces exactly the information you wanted. It might be easier on the hardware to run cmp and then separately check for files which exist in one directory but not in the other.

Last edited by era; 04-22-2008 at 01:36 PM.. Reason: Oops, forgot the sort
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Parse the .txt file for folder name and FTP to the corrsponding folder.

Oracle procedure create files on UNIX folder on a regular basis. I need to FTP files onto windows server and place the files, based on their name, in the corresponding folders. File name is as follows: ccyymmddfoldernamefile.txt; Folder Name length could be of any size; however, the prefix and... (3 Replies)
Discussion started by: MeganP
3 Replies

2. UNIX for Advanced & Expert Users

Auto copy for files from folder to folder upon instant writing

Hello all, I'm trying to accomplish that if a file gets written to folder /path/to/a/ it gets automatically copied into /path/to/b/ the moment its get written. I thought of writing a shell script and cron it that every X amount of minutes it copies these files over but this will not help me... (2 Replies)
Discussion started by: Bashar
2 Replies

3. Windows & DOS: Issues & Discussions

How can I upload a zip folder on a unix path from my windows folder?

Hello, I am an amature at UNIX commands and functionality. Please could you all assist me by replying to my below mentioned querry : How can I upload a zip folder on a unix path from my windows folder? Thanks guys Cheers (2 Replies)
Discussion started by: ajit.yadav83
2 Replies

4. UNIX for Dummies Questions & Answers

Jar/Tar to a diffent folder/same folder w/ filename

Hi, I want to extract myfile.war to a folder which is in the same folder with war file.I did this as normal: jar -xvf myfile.war But it exploded all the content of file to the same level folder instead of that I was expecting to create a folder called myfile. This works with tar: ... (0 Replies)
Discussion started by: reis3k
0 Replies

5. Shell Programming and Scripting

File Management: How do I move all JPGS in a folder structure to a single folder?

This is the file structure: DESKTOP/Root of Photo Folders/Folder1qweqwasdfsd/*jpg DESKTOP/Root of Photo Folders/Folder2asdasdasd/*jpg DESKTOP/Root of Photo Folders/Folder3asdadfhgasdf/*jpg DESKTOP/Root of Photo Folders/Folder4qwetwdfsdfg/*jpg DESKTOP/Root of Photo... (4 Replies)
Discussion started by: guptaxpn
4 Replies

6. Shell Programming and Scripting

do a full comparison of folder contents in script

Hello everyone.... I have a small issue here at work and I am trying to script out a way to automate a fix for it. I have a small number of users (I work in a 1:1 with 6,000 macbooks) that aren't really managed in my deployment. They are managed with a few policies, but the policies are broken... (2 Replies)
Discussion started by: tlarkin
2 Replies

7. Shell Programming and Scripting

Shell scripting for moving folder specific files into target directory of that country folder.

I need help to write shell script to copy files from one server to another server. Source Directory UAE(inside i have another folder Misc with files inside UAE folder).I have to copy this to another server UAE folder( Files should be copied to UAE folder and Misc files should be copied in target... (3 Replies)
Discussion started by: naresh2389
3 Replies

8. Shell Programming and Scripting

Request for Shell script to move files from Subfolder to Parent folder and delete sub folder

Hi Team, I am new to shell script and there is a requirement where files should be moved from Subfolder to parent folder. Eg: parent folder --> /Interface/data/test/IN Sub folder -->/Interface/data/test/IN/Invoice20180607233338 Subfolder will be always with timestamp... (6 Replies)
Discussion started by: srivarun15
6 Replies

9. Shell Programming and Scripting

Delete oldest folder based on folder named as date

Hi, I have a script doing backup to synology server, the script create new folder each day with the date as being folder name i.e. 2018-07-30. Just before creating the new folder I want the script to find the oldest folder from the list and delete it including its content. for example... (3 Replies)
Discussion started by: humble_learner
3 Replies
mv(1)							      General Commands Manual							     mv(1)

NAME
mv - Moves files and directories SYNOPSIS
mv [-i | -f] [--] file1 file2 mv [-i | -f] [--] file1... directory mv [-i | -f] [--] directory1... destination_directory The mv command moves files from one directory to another or renames files and directories. STANDARDS
Interfaces documented on this reference page conform to industry standards as follows: mv: XCU5.0 Refer to the standards(5) reference page for more information about industry standards and associated tags. OPTIONS
Overrides the -i option and any mode restrictions. (If both -f and -i are specified--for example, because an alias includes one of them--whichever appears last overrides the other.) Prompts you with the name of the file followed by a question mark whenever a move is to supersede an existing file. If the answer begins with y, or the locale's equivalent of a y, the move continues. Any other reply prevents the move from occurring. (If both -f and -i are specified--for example, because an alias includes one of them--whichever appears last over- rides the other.) Interprets all following arguments to mv as file names. This allows file names to start with a - (dash). DESCRIPTION
If you move a file to a new directory, mv retains the original file name. When you move a file, all other links to the file remain intact. In the second form, one or more files are moved to directory with their original file names. In the third form, one or more directories are moved to the destination directory with their original names. The mv command does not move a file onto itself. When you use mv to rename a file, the target file can be either a new file name or a new directory path name. If moving the file would overwrite an existing file that does not have write permission set and if standard input is a terminal, mv displays the permission code of the file to be overwritten and reads one line from standard input. If the line begins with y, or the locale's equivalent of a y, the move takes place and the file is overwritten. If not, mv does nothing with the file. When you use mv to move a directory into an existing directory, the directory and its contents are added under the existing directory. The LC_MESSAGES variable determines the locale's equivalent of y or n (for yes/no queries). If a mv operation fails, mv generally writes a diagnostic message to standard error, does nothing more with the current source file, and goes on to process any remaining source files. If the copying or removal of a file is prematurely terminated by a signal or error, mv might leave a partial copy of the file at either the source or the target path name. The mv program does not modify the source and target path names simultaneously; therefore, program termina- tion at any point always leaves either the source file or the target file complete. NOTES
[Tru64 UNIX] If the source is on a different file system than the destination, mv must copy the source to the destination's file system and then delete the source. The effect is equivalent to the following: rm -f destination && cp -pr source destination && rm -rf source The mv command might overwrite existing files. Specify the -i option last on the command line to cause the mv command to prompt you before it moves a file. EXIT STATUS
The following exit values are returned: All files were moved successfully. An error occurred. EXAMPLES
To rename a file, enter: mv file1 file2 This renames file1 to file2. If a file named file2 already exists, its old contents are replaced with those of file1. To move a directory, enter: mv dir1 dir2 This moves dir1 to dir2. It moves dir1 and all files and directories under dir1 to the directory named dir2, if the second direc- tory exists. Otherwise, the directory dir1 gets renamed dir2. To move a file to another directory and give it a new name, enter: mv file1 dir1/file2 This moves file1 to dir1/file2. The name file1 is removed from the current directory, and the same file appears as file2 in the directory dir1. To move a file to another directory, keeping the same name, enter: mv file1 dir1 This moves file1 to dir1/file1. To move several files into another directory, enter: mv file1 dir1/file2 /u/dir2 This moves file1 to /u/dir2/file1 and dir1/file2 to /u/dir2/file2. To use mv with pattern-matching characters, enter: mv dir1/* . This moves all files in the directory dir1 into the current directory (.), giving them the same names they had in dir1. This also empties dir1. Note that you must type a space between the * (asterisk) and the (dot). ENVIRONMENT VARIABLES
The following environment variables affect the execution of mv: Provides a default value for the internationalization variables that are unset or null. If LANG is unset or null, the corresponding value from the default locale is used. If any of the internationalization vari- ables contain an invalid setting, the utility behaves as if none of the variables had been defined. If set to a non-empty string value, overrides the values of all the other internationalization variables. Determines the locale for the interpretation of sequences of bytes of text data as characters (for example, single-byte as opposed to multibyte characters in arguments). Determines the locale for the for- mat and contents of diagnostic messages written to standard error. Determines the location of message catalogues for the processing of LC_MESSAGES. SEE ALSO
Commands: cp(1), ln(1), rm(1) Functions: rename(2) Standards: standards(5) mv(1)
All times are GMT -4. The time now is 05:02 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy