Sponsored Content
Top Forums Shell Programming and Scripting Help with file compare and move script Post 303026437 by mattz40 on Tuesday 27th of November 2018 05:36:01 PM
Old 11-27-2018
Thanks for the advice above, it got me further along but I've run into another wall or two. Here's where I'm at so far
Code:
!/bin/bash
# Compare file names in source and target directories
# Move duplicates from source to duplicates directory
# Move remaining files in source to target directory
# Only care about files names, not upper lower case, checksum, date, time

cd /mnt/nas/source
dir1=$(ls *.*)
cd /mnt/nas/target
dir2=$(ls *.*)
cd / 
dir3="/mnt/nas/Duplicates"

for FN in $dir1;
do
    if [ -f "$dir2 -eq ${FN}" ];
        then echo "Duplicate "${FN};
        else echo "Unique "${FN};
    fi;
done

The first problem is I can't get the IF statement to work no matter where I put quotes, parens, brackets, or curly brackets. Also switching -eg for =, ==, or / makes no difference. I get either a 'too many parameters on line 16" error or it drops right through and declares every file unique when 10 out of 20 are duplicates.

Second problem is I have a file named 'space test dupe10.jpg' that I named to see how it would handle spaces in file names. I have a simplified version of the script (no IF statement) that just echoes the variables as it increments through them, and it appears to treat space, test, and dupe10.jpg as 3 different files.

This isn't a life or death situation so I greatly appreciate any and all advice. I'm just updating an electronic picture frame that hangs on the living room wall and runs for 4 hrs per night which makes adding pictures a pain since it has to be done while it's on. With this script I can put the pics on my NAS and they'll get copied over when the frame boots. I can do that now but duplicate file names are a concern. I made this thing before you could buy them, from instructions in a physical popular mechanics magazine. 15 or so years and several thousand pics later and you can imagine how many times my wife (a photography hobbyist no less) has tried to load "flowers.jpg" on it.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

File Compare & Move between 2 servers

Greetings - I am a newbie in shell scripts. I have been thru the whole forum but there has been no similar query posed. The objective of my system is to have a unified filebase system. I am using RSync to synchronise files between the location & central server with both of them having the... (4 Replies)
Discussion started by: evolve
4 Replies

2. UNIX for Dummies Questions & Answers

Compare directories then move similar ones

I would like to know how to compare a listing of directories that begin with the same four numbers ie. /1234cat /1234tree /1234fish and move all these directories into one directory Thanks in advance (2 Replies)
Discussion started by: tgibson2
2 Replies

3. Shell Programming and Scripting

script to move text in file?

ok i asked around to a few ppl and they said to use sed or awk to do what i want.. but i cant figure out how to use it like that.. anyway i have a text file that is 10k lines long.. i need to move text from the end of a line after the ? and move it to the front of the line then add a | after it.... (3 Replies)
Discussion started by: wckdkl0wn
3 Replies

4. Shell Programming and Scripting

Script to move the first line of a file to the end

I'm rather new to scripting, and despite my attempts at finding/writing a script to do what I need, I have not yet been successful. I have a file named "list.txt" of arbitrary length with contents in the following format: /home/user/Music/file1.mp3 /home/user/Music/file2.mp3... (21 Replies)
Discussion started by: Altay_H
21 Replies

5. Shell Programming and Scripting

script to move two lines to the end of a file

My input file is multiline file and I am writing a script to search for a pattern and move the line with the pattern and the next line to the end of the file. Since I am trying to learn awk, I thought I would try it. My input looks like the following: D #testpoint 1 510.0 D #testpoint2 ... (5 Replies)
Discussion started by: banjo25
5 Replies

6. Shell Programming and Scripting

A script that will move a file to a directory with the same name and then rename that file

Hello all. I am new to this forum (and somewhat new to UNIX / LINUX - I started using ubuntu 1 year ago).:b: I have the following problem that I have not been able to figure out how to take care of and I was wondering if anyone could help me out.:confused: I have all of my music stored in... (7 Replies)
Discussion started by: marcozd
7 Replies

7. Shell Programming and Scripting

Script to compare substrings of multiple filenames and move to different directory

Hi there, I am having trouble with a script I have written, which is designed to search through a directory for a header and payload file, retrieve a string from both filenames, compare this string and if it matches make a backup of the two files then move them to a different directory for... (1 Reply)
Discussion started by: alcurry
1 Replies

8. Shell Programming and Scripting

Shell script to get the latest file from the file list and move

Hi, Anybody help me to write a Shell Script Get the latest file from the file list based on created and then move to the target directory. Tried with the following script: got error. A=$(ls -1dt $(find "cveit/local_ftp/reflash-parts" -type f -daystart -mtime -$dateoffset) | head... (2 Replies)
Discussion started by: saravan_an
2 Replies

9. Shell Programming and Scripting

Move file in to directory- script

Hi In directory /mnt/upload I have about 100 000 files (*.png) that have been created during the last six months. Now I need to move them to right folders. eg: file created on 2014-10-10 move to directory /mnt/upload/20141010 file created on 2014-11-11 move to directory /mnt/upload/20141111... (6 Replies)
Discussion started by: primo102
6 Replies

10. Shell Programming and Scripting

Shell script (sh file) logic to compare contents of one file with another file and output to file

Shell script logic Hi I have 2 input files like with file 1 content as (file1) "BRGTEST-242" a.txt "BRGTEST-240" a.txt "BRGTEST-219" e.txt File 2 contents as fle(2) "BRGTEST-244" a.txt "BRGTEST-244" b.txt "BRGTEST-231" c.txt "BRGTEST-231" d.txt "BRGTEST-221" e.txt I want to get... (22 Replies)
Discussion started by: pottic
22 Replies
mv(1)							      General Commands Manual							     mv(1)

NAME
mv - Moves files and directories SYNOPSIS
mv [-i | -f] [--] file1 file2 mv [-i | -f] [--] file1... directory mv [-i | -f] [--] directory1... destination_directory The mv command moves files from one directory to another or renames files and directories. STANDARDS
Interfaces documented on this reference page conform to industry standards as follows: mv: XCU5.0 Refer to the standards(5) reference page for more information about industry standards and associated tags. OPTIONS
Overrides the -i option and any mode restrictions. (If both -f and -i are specified--for example, because an alias includes one of them--whichever appears last overrides the other.) Prompts you with the name of the file followed by a question mark whenever a move is to supersede an existing file. If the answer begins with y, or the locale's equivalent of a y, the move continues. Any other reply prevents the move from occurring. (If both -f and -i are specified--for example, because an alias includes one of them--whichever appears last over- rides the other.) Interprets all following arguments to mv as file names. This allows file names to start with a - (dash). DESCRIPTION
If you move a file to a new directory, mv retains the original file name. When you move a file, all other links to the file remain intact. In the second form, one or more files are moved to directory with their original file names. In the third form, one or more directories are moved to the destination directory with their original names. The mv command does not move a file onto itself. When you use mv to rename a file, the target file can be either a new file name or a new directory path name. If moving the file would overwrite an existing file that does not have write permission set and if standard input is a terminal, mv displays the permission code of the file to be overwritten and reads one line from standard input. If the line begins with y, or the locale's equivalent of a y, the move takes place and the file is overwritten. If not, mv does nothing with the file. When you use mv to move a directory into an existing directory, the directory and its contents are added under the existing directory. The LC_MESSAGES variable determines the locale's equivalent of y or n (for yes/no queries). If a mv operation fails, mv generally writes a diagnostic message to standard error, does nothing more with the current source file, and goes on to process any remaining source files. If the copying or removal of a file is prematurely terminated by a signal or error, mv might leave a partial copy of the file at either the source or the target path name. The mv program does not modify the source and target path names simultaneously; therefore, program termina- tion at any point always leaves either the source file or the target file complete. NOTES
[Tru64 UNIX] If the source is on a different file system than the destination, mv must copy the source to the destination's file system and then delete the source. The effect is equivalent to the following: rm -f destination && cp -pr source destination && rm -rf source The mv command might overwrite existing files. Specify the -i option last on the command line to cause the mv command to prompt you before it moves a file. EXIT STATUS
The following exit values are returned: All files were moved successfully. An error occurred. EXAMPLES
To rename a file, enter: mv file1 file2 This renames file1 to file2. If a file named file2 already exists, its old contents are replaced with those of file1. To move a directory, enter: mv dir1 dir2 This moves dir1 to dir2. It moves dir1 and all files and directories under dir1 to the directory named dir2, if the second direc- tory exists. Otherwise, the directory dir1 gets renamed dir2. To move a file to another directory and give it a new name, enter: mv file1 dir1/file2 This moves file1 to dir1/file2. The name file1 is removed from the current directory, and the same file appears as file2 in the directory dir1. To move a file to another directory, keeping the same name, enter: mv file1 dir1 This moves file1 to dir1/file1. To move several files into another directory, enter: mv file1 dir1/file2 /u/dir2 This moves file1 to /u/dir2/file1 and dir1/file2 to /u/dir2/file2. To use mv with pattern-matching characters, enter: mv dir1/* . This moves all files in the directory dir1 into the current directory (.), giving them the same names they had in dir1. This also empties dir1. Note that you must type a space between the * (asterisk) and the (dot). ENVIRONMENT VARIABLES
The following environment variables affect the execution of mv: Provides a default value for the internationalization variables that are unset or null. If LANG is unset or null, the corresponding value from the default locale is used. If any of the internationalization vari- ables contain an invalid setting, the utility behaves as if none of the variables had been defined. If set to a non-empty string value, overrides the values of all the other internationalization variables. Determines the locale for the interpretation of sequences of bytes of text data as characters (for example, single-byte as opposed to multibyte characters in arguments). Determines the locale for the for- mat and contents of diagnostic messages written to standard error. Determines the location of message catalogues for the processing of LC_MESSAGES. SEE ALSO
Commands: cp(1), ln(1), rm(1) Functions: rename(2) Standards: standards(5) mv(1)
All times are GMT -4. The time now is 04:53 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy