Sponsored Content
Top Forums Shell Programming and Scripting Script to compare files in 2 folders and delete the large file Post 302999852 by Josh52180 on Wednesday 28th of June 2017 04:54:07 PM
Old 06-28-2017
Script to compare files in 2 folders and delete the large file

Hello, my first thread here.

I've been searching and fiddling around for about a week and I cannot find a solution.Smilie

I have been converting all of my home videos to HEVC and sometimes the files end up smaller and sometimes they don't. I am currently comparing all the video files manually and it takes up quite a bit of time.

I was wondering if there is a script that can check the 2 folders and delete the larger of the 2 files and keep the smaller one.

I have the original videos in one directory and the converted in another directory. The filenames are always the same but sometimes the extensions are different.

eg. the destination output file will always have the .mkv extension but the original may have .avi, .mpg, mp4 etc. But the filenames themselves will always be the same.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compare data in 2 files and delete if file exist

Hi there, I have written a script called "compare" (see below) to make comparison between 2 files namely test_put.log and Output_A0.log #!/bin/ksh while read file do found="no" while read line do echo $line | grep $file > /dev/null if then echo $file found found="yes" break fi... (3 Replies)
Discussion started by: lweegp
3 Replies

2. Shell Programming and Scripting

Looking for Large Files and Folders

Hello, On one of my UNIX boxes, there are many folders. I'm looking for a way / command that will search for and display folder names / location / size so I can do some cleanups. How can I do this? (8 Replies)
Discussion started by: bbbngowc
8 Replies

3. Shell Programming and Scripting

Script to Compare a large number of files.

I have a large Filesystem on an AIX server and another one on a Red Hat box. I have syncd the two filesystems using rsysnc. What Im looking for is a script that would compare to the two filesystems to make sure the bits match up and the number of files match up. its around 2.8 million... (5 Replies)
Discussion started by: zippdawg2001
5 Replies

4. Shell Programming and Scripting

Compare files in two folders and delete missing ones

I do not know much about shell scripting so I am at a loss here. If someone can help me, that would be great! I have two directories /dir1 /dir2 I need to delete all files from /dir1 and that does not have a correspondent file in /dir2. It should NOT check file suffixes in /dir2 . Why?... (20 Replies)
Discussion started by: kaah
20 Replies

5. Shell Programming and Scripting

Shell Script to delete files within a particular time frame under multiple sub folders

Greetings! I'm looking for starting information for a shell script. Here's my scenario: I have multiple folders(100) for example: /www/test/applications/app1/logs /www/test/applications/app2/logs Within these folders there are log files files that need to be deleted after a month. ... (3 Replies)
Discussion started by: whysolucky
3 Replies

6. Shell Programming and Scripting

Need to delete large set of files (i.e) close to 100K from a directory based on the input file

Hi all, I need a script to delete a large set of files from a directory under / based on an input file and want to redirect errors into separate file. I have already prepared a list of files in the input file. Kndly help me. Thanks, Prash (36 Replies)
Discussion started by: prash358
36 Replies

7. Shell Programming and Scripting

Linux Script to compare two folders and copy missing files

Hi, I need help in shell scripting. If someone can help me, that would be great! Problem. I want Linux Script to compare two folders and copy missing files. Description. I have two directories /dir1 /dir2 I need to copy all distinct/new/unique/missing files from /dir1 and that... (1 Reply)
Discussion started by: S.Praveen Kumar
1 Replies

8. Shell Programming and Scripting

Script to delete folders and files from a prompt

Hi Everyone, I work for GE Money IVR as a DB analyst and the environment on which I work is Solaris 5.0 server and Oracle 11g. I got a project in which I have to clean up the folders and files which are not used in DB. I copied an existing script and edited it, dont know this is the... (5 Replies)
Discussion started by: habeeb506
5 Replies

9. UNIX for Advanced & Expert Users

Help with creating script to delete log files/folders

Hi I am new to Linux / scripting language. I need to improve our Linux servers at work and looking to claim some space my deleting log files/ folders on a 5 day basis. Can someone help me with creating a script to do so. Any sample script will be helpful.:b: Regards (2 Replies)
Discussion started by: sachinksl
2 Replies

10. Shell Programming and Scripting

Script to compare partial filenames in two folders and delete duplicates

Background: I use a TV tuner card to capture OTA video files (.mpeg) and then my Plex Media Server automatically optimizes the files (transcodes for better playback) and places them in a new directory. I have another Plex Library pointing to the new location for the optimized .mp4 files. This... (2 Replies)
Discussion started by: shaky
2 Replies
iowatcher(1)						      General Commands Manual						      iowatcher(1)

NAME
iowatcher - Create visualizations from blktrace results SYNOPSIS
iowatcher OPTIONS... DESCRIPTION
iowatcher graphs the results of a blktrace run. It can graph the result of an existing blktrace, start a new blktrace, or start a new blk- trace and a benchmark run. It can then create an image or movie of the IO from a given trace. iowatcher can produce either SVG files or movies in mp4 format (with ffmpeg) or ogg format (with png2theora). OPTIONS
--help Print a brief usage summary. -d, --device <device> Controls which device you are tracing. You can only trace one device at a time for now. It is sent directly to blktrace, and only needed when you are making a new trace. -D, --blktrace-destination <destination> Destination for blktrace. -p, --prog <program> Program to run while blktrace is run. -K, --keep-movie-svgs Keep the SVG files generated for movie mode. -t, --trace <file|directory> Controls the name of the blktrace file. iowatcher uses a dump from blkparse, so -t tries to guess the name of the corresponding per CPU blktrace data files if the dump file doesn't already exist. If you want more than one trace in a given graph, you can specify -t more than once. If a directory is specified, iowatcher will use the name of the directory as the base name of the dump file and all trace files found inside the directory will be processed. -l, --label <label> Sets a label in the graph for a trace file. The labels are added in the same order the trace files are added. -m, --movie [spindle|rect] Create a movie. The file format depends on the extension used in the -o filename.* option. If you specify an .ogv or .ogg exten- sion, the result will be Ogg Theora video, if png2theora is available. If you use an .mp4 extension, the result will be an mp4 video if ffmpeg is available. You can use any other extension, but the end result will be an mp4. You can use --movie=spindle or --movie=rect, which changes the style of the IO mapping. -T, --title <title> Set a title to be placed at the top of the graph. -o, --output <file> Output filename (default: trace.svg). -r, --rolling <seconds> Control the duration for the rolling average. iowatcher tries to smooth out bumpy graphs by averaging the current second with sec- onds from the past. Larger numbers here give you flatter graphs. -h, --height <height> Set the height of each graph -w, --width <width> Set the width of each graph -c, --columns <columns> Numbers of columns in graph output -x, --xzoom <min:max> Limit processed time range to min:max -y, --yzoom <min:max> Limit processed sectors to min:max -a, --io-plot-action <action> Plot given action (one of Q,D,C) in IO graph -P, --per-process-io Distinguish between processes in IO graph -O, --only-graph <graph> Add a single graph to the output (see GRAPHS). By default all the graphs are included, but with -O you get only the graphs you ask for. -O may be used more than once. -N, --no-graph <type> Remove a single graph from the output (see GRAPHS). This may also be used more than once. GRAPHS
Choices for -O and -N are: io, tput, latency, queue_depth, iops, cpu-sys, cpu-io, cpu-irq, cpu-user, cpu-soft EXAMPLES
Generate graph from the existing trace.dump: iowatcher -t trace.dump -o trace.svg Skip the IO graph: iowatcher -t trace.dump -o trace.svg -N io Only graph tput and latency: iowatcher -t trace.dump -o trace.svg -O tput -O latency Generate a graph from two runs, and label them: iowatcher -t ext4.dump -t xfs.dump -l Ext4 -l XFS -o trace.svg Run a fio benchmark and store the trace in trace.dump, add a title to the top, use /dev/sda for blktrace: iowatcher -d /dev/sda -t trace.dump -T 'Fio Benchmark' -p 'fio some_job_file' Make a movie from an existing trace: iowatcher -t trace --movie -o trace.mp4 iowatcher(1)
All times are GMT -4. The time now is 01:28 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy