Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Help with file compare and move script
Top Forums Shell Programming and Scripting Help with file compare and move script Post 303026437 by mattz40 on Tuesday 27th of November 2018 05:36:01 PM
Old 11-27-2018
Thanks for the advice above, it got me further along but I've run into another wall or two. Here's where I'm at so far
Code:
!/bin/bash
# Compare file names in source and target directories
# Move duplicates from source to duplicates directory
# Move remaining files in source to target directory
# Only care about files names, not upper lower case, checksum, date, time

cd /mnt/nas/source
dir1=$(ls *.*)
cd /mnt/nas/target
dir2=$(ls *.*)
cd / 
dir3="/mnt/nas/Duplicates"

for FN in $dir1;
do
    if [ -f "$dir2 -eq ${FN}" ];
        then echo "Duplicate "${FN};
        else echo "Unique "${FN};
    fi;
done

The first problem is I can't get the IF statement to work no matter where I put quotes, parens, brackets, or curly brackets. Also switching -eg for =, ==, or / makes no difference. I get either a 'too many parameters on line 16" error or it drops right through and declares every file unique when 10 out of 20 are duplicates.

Second problem is I have a file named 'space test dupe10.jpg' that I named to see how it would handle spaces in file names. I have a simplified version of the script (no IF statement) that just echoes the variables as it increments through them, and it appears to treat space, test, and dupe10.jpg as 3 different files.

This isn't a life or death situation so I greatly appreciate any and all advice. I'm just updating an electronic picture frame that hangs on the living room wall and runs for 4 hrs per night which makes adding pictures a pain since it has to be done while it's on. With this script I can put the pics on my NAS and they'll get copied over when the frame boots. I can do that now but duplicate file names are a concern. I made this thing before you could buy them, from instructions in a physical popular mechanics magazine. 15 or so years and several thousand pics later and you can imagine how many times my wife (a photography hobbyist no less) has tried to load "flowers.jpg" on it.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

File Compare & Move between 2 servers

Greetings - I am a newbie in shell scripts. I have been thru the whole forum but there has been no similar query posed. The objective of my system is to have a unified filebase system. I am using RSync to synchronise files between the location & central server with both of them having the... (4 Replies)
Discussion started by: evolve
4 Replies

2. UNIX for Dummies Questions & Answers

Compare directories then move similar ones

I would like to know how to compare a listing of directories that begin with the same four numbers ie. /1234cat /1234tree /1234fish and move all these directories into one directory Thanks in advance (2 Replies)
Discussion started by: tgibson2
2 Replies

3. Shell Programming and Scripting

script to move text in file?

ok i asked around to a few ppl and they said to use sed or awk to do what i want.. but i cant figure out how to use it like that.. anyway i have a text file that is 10k lines long.. i need to move text from the end of a line after the ? and move it to the front of the line then add a | after it.... (3 Replies)
Discussion started by: wckdkl0wn
3 Replies

4. Shell Programming and Scripting

Script to move the first line of a file to the end

I'm rather new to scripting, and despite my attempts at finding/writing a script to do what I need, I have not yet been successful. I have a file named "list.txt" of arbitrary length with contents in the following format: /home/user/Music/file1.mp3 /home/user/Music/file2.mp3... (21 Replies)
Discussion started by: Altay_H
21 Replies

5. Shell Programming and Scripting

script to move two lines to the end of a file

My input file is multiline file and I am writing a script to search for a pattern and move the line with the pattern and the next line to the end of the file. Since I am trying to learn awk, I thought I would try it. My input looks like the following: D #testpoint 1 510.0 D #testpoint2 ... (5 Replies)
Discussion started by: banjo25
5 Replies

6. Shell Programming and Scripting

A script that will move a file to a directory with the same name and then rename that file

Hello all. I am new to this forum (and somewhat new to UNIX / LINUX - I started using ubuntu 1 year ago).:b: I have the following problem that I have not been able to figure out how to take care of and I was wondering if anyone could help me out.:confused: I have all of my music stored in... (7 Replies)
Discussion started by: marcozd
7 Replies

7. Shell Programming and Scripting

Script to compare substrings of multiple filenames and move to different directory

Hi there, I am having trouble with a script I have written, which is designed to search through a directory for a header and payload file, retrieve a string from both filenames, compare this string and if it matches make a backup of the two files then move them to a different directory for... (1 Reply)
Discussion started by: alcurry
1 Replies

8. Shell Programming and Scripting

Shell script to get the latest file from the file list and move

Hi, Anybody help me to write a Shell Script Get the latest file from the file list based on created and then move to the target directory. Tried with the following script: got error. A=$(ls -1dt $(find "cveit/local_ftp/reflash-parts" -type f -daystart -mtime -$dateoffset) | head... (2 Replies)
Discussion started by: saravan_an
2 Replies

9. Shell Programming and Scripting

Move file in to directory- script

Hi In directory /mnt/upload I have about 100 000 files (*.png) that have been created during the last six months. Now I need to move them to right folders. eg: file created on 2014-10-10 move to directory /mnt/upload/20141010 file created on 2014-11-11 move to directory /mnt/upload/20141111... (6 Replies)
Discussion started by: primo102
6 Replies

10. Shell Programming and Scripting

Shell script (sh file) logic to compare contents of one file with another file and output to file

Shell script logic Hi I have 2 input files like with file 1 content as (file1) "BRGTEST-242" a.txt "BRGTEST-240" a.txt "BRGTEST-219" e.txt File 2 contents as fle(2) "BRGTEST-244" a.txt "BRGTEST-244" b.txt "BRGTEST-231" c.txt "BRGTEST-231" d.txt "BRGTEST-221" e.txt I want to get... (22 Replies)
Discussion started by: pottic
22 Replies

LEARN ABOUT DEBIAN

raidfile-config

RAIDFILE-CONFIG(8)						    Box Backup							RAIDFILE-CONFIG(8)

NAME

       raidfile-config - Configure Box Backup's RAID files

SYNOPSIS

       raidfile-config config-dir blocksize dir1 [dir2 [dir3]]

DESCRIPTION

       raidfile-config creates a raidfile.conf file for Box Backup. This file holds information about the directories used to store backups in.
       Box Backup supports userland RAID, in a restricted RAID5 configuration, where 3 and only 3 'drives' are supported. You can read more about
       RAID5 (and other RAID-levels) here[1].

   Parameters
       The parameters are as follows:

       config-dir
	   The directory path where configuration files are located. Usually this is /etc/box.	raidfile.conf will be written in this directory.

       blocksize
	   The block size used for file storage in the system, in bytes. Using a multiple of the file system block size is a good strategy.
	   Depending on the size of the files you will be backing up, this multiple varies. Of course it also depends on the native block size of
	   your file system.

       dir1
	   The first directory in the built-in RAID array.

       dir2
	   The second directory in the built-in RAID array. If you are not using the built-in RAID functionality, this field should be ignored.
	   You should not use the built-in RAID if you have a hardware RAID solution or if you're using another type of software RAID (like md on
	   Linux).

       dir3
	   The third directory in the built-in RAID array. The same notes that apply to dir2 also apply to dir3.

       Note that there are currently no way to add multiple disk sets to the raidfile.conf file using command line tools, etc. See
       raidfile.conf(5) for details on adding more disks.

BUGS

       If you find a bug in Box Backup, and you want to let us know about it, join the mailing list[2], and send a description of the problem
       there.

       To report a bug, give us at least the following information:

       o   The version of Box Backup you are running

       o   The platform you are running on (hardware and OS), for both client and server.

       o   If possible attach your config files (bbstored.conf, bbackupd.conf) to the bug report.

       o   Also attach any log file output that helps shed light on the problem you are seeing.

       o   And last but certainly not least, a description of what you are seeing, in as much detail as possible.

FILES

       raidfile-config generates the raidfile.conf(5) file.

SEE ALSO

       bbstored-config(8), bbstored.conf(5), raidfile.conf(5)

AUTHORS

       Ben Summers

       Per Thomsen

       James O'Gorman

NOTES

	1. here
	   http://en.wikipedia.org/wiki/Redundant_array_of_independent_disks#RAID_5

	2. mailing list
	   http://lists.warhead.org.uk/mailman/listinfo/boxbackup

Box Backup 0.11 						    10/28/2011							RAIDFILE-CONFIG(8)
All times are GMT -4. The time now is 06:04 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy