Sponsored Content
Top Forums Shell Programming and Scripting Shellscript to sort duplicate files listed in a text file Post 302365728 by daptal on Wednesday 28th of October 2009 01:20:12 AM
Old 10-28-2009
If you want to do it using a script
Code:
cat abc.txt
/home/santosh/z_literature/MIF_Oxime_ph4_JBC_May2007.pdf
/home/santosh/z_literature/J_immun_biochemOFmif.pdf
/home/santosh/z_literature/sak/san/06_JCTC_06_bome.pdf
/home/santosh/z_literature/sak/san/03_IEJMD_05_nkr1.pdf
/home/santosh/z_literature/sak/san/07_JCAMD_06_CoRIA.pdf
/home/santosh/z_literature/sak/san/DDP-IV-JMM2007.pdf
/home/santosh/z_literature/sak/san/06_JCTC_06_bome.pdf
/home/santosh/y_literature/sak/san/06_JCTC_06_bome.pdf

use inline perl
Code:
cat abc.txt |perl -e 'my %hash;while($full_filename = <>){ chomp ($full_filename);my @cols = split("/",$full_filename);push @{$hash{$cols[-1]}}, $full_filename;}print "-"x80,"\n";foreach my $fn (keys %hash){print "$fn\n";map {print "$_\n";} @{$hash{$fn}};print "-"x80,"\n";}'

Added output formatting for readability.

Replace abc.txt with what ever file you have.

HTH,
PL
 

10 More Discussions You Might Find Interesting

1. HP-UX

CVSWeb - Directories listed but files not listed

I am using CVSWeb on HPUnix. When i access it, all directories are listed but files are not listed. I am getting the error "NOTE: There are 51 files, but none matches the current tag. " in tomcat sevrer log i am getting the message "rlog warning: Missing revision or branch number after -r"... (0 Replies)
Discussion started by: ganesh
0 Replies

2. Shell Programming and Scripting

Copy files listed in a text file - whitespace problem.

Hi, Say I have this text file <copy.out> that contains a list of files/directories to be copied out to a different location. $ more copy.out dir1/file1 dir1/file2 dir1/file3 "dir1/white space" dir1/file4 If I do the following: $copy=`more copy.out` $echo $copy dir1/file1... (4 Replies)
Discussion started by: 60doses
4 Replies

3. Shell Programming and Scripting

Send a mail to IDs listed in a text file

I have a list of mail ids in text file and want a ksh script that reads this text file and sends a mail to all mail ids with same subject line and content. I am using UX-HP machine and KSH. Thanks for help in advance! (5 Replies)
Discussion started by: Sriranga
5 Replies

4. Shell Programming and Scripting

Sort and Remove Duplicate on file

How do we sort and remove duplicate on column 1,2 retaining the record with maximum date (in feild 3) for the file with following format. aaa|1234|2010-12-31 aaa|1234|2010-11-10 bbb|345|2011-01-01 ccc|346|2011-02-01 bbb|345|2011-03-10 aaa|1234|2010-01-01 Required Output ... (5 Replies)
Discussion started by: mabarif16
5 Replies

5. Shell Programming and Scripting

Copy files listed in text file to new directory

I am trying to write a script that will copy all file listed in a text file (100s of file names) to a new directory Assume script will run with main as current working directory and I know how many files/lines will be in List.txt Im trying to work up a test script using this model Contents of... (2 Replies)
Discussion started by: IAmTheGrass
2 Replies

6. Shell Programming and Scripting

How to grep a log file for words listed in separate text file?

Hello, I want to grep a log ("server.log") for words in a separate file ("white-list.txt") and generate a separate log file containing each line that uses a word from the "white-list.txt" file. Putting that in bullet points: Search through "server.log" for lines that contain any word... (15 Replies)
Discussion started by: nbsparks
15 Replies

7. Shell Programming and Scripting

Delete files listed in text file

Hi Team, Here's the scenario, I have a text file called "file_list.txt". Its content is as follows. 111.tmp 112.tmp 113.tmp 114.tmp These files will present in "workdir" directory. It has many files. But only the files present in file_list.txt has to be deleted from the workdir... (7 Replies)
Discussion started by: kmanivan82
7 Replies

8. Shell Programming and Scripting

Cat files listed in text file and redirect to new directory with same filename

I have a directory that is restricted and I cannot just copy the files need, but I can cat them and redirect them to a new directory. The files all have the date listed in them. If I perform a long listing and grep for the date (150620) I can redirect that output to a text file. Now I need to... (5 Replies)
Discussion started by: trigger467
5 Replies

9. Shell Programming and Scripting

Want to delete the junk files from a directory which are not listed in a TEXT file

Hello Everyone, I want to delete the image files from a directory, which are not listed in a TEXT file. The directory contains large number of image files (in millions) required / not required. I want to delete the image files which are "not required". I have generated a Text file having... (3 Replies)
Discussion started by: Praveen Pandit
3 Replies

10. UNIX for Beginners Questions & Answers

How do I custom sort the files in a directory using the filenames in a text file.?

Hi all, (5 Replies)
Discussion started by: KMusunuru
5 Replies
QPDFVIEW(1)						      General Commands Manual						       QPDFVIEW(1)

NAME
qpdfview - tabbed PDF viewer SYNOPSIS
qpdfview [options] [file(s)[#page[#top]]] DESCRIPTION
qpdfview is a simple document viewer for PDF documents. It uses the poppler library for rendering. OPTIONS
--unique If an instance of qpdfview is started with this option, any files that are opened using this option afterwards, are opened as tabs in this same window. If a file is already opened in a tab of the respective window, it is merely reloaded using this option. [file(s)[#page[#top]]] Specifies the files to open when qpdfview starts. If this is not specified, qpdfview will open a blank window. Multiple files can be loaded in separate tabs if the file names are separated by spaces. The optional parameter #page opens the file at the given page. The optional parameter #top can take values between 0 and 1 and opens the page with the given position aligned to the top of the tab. (See examples.) CONFIGURATION FILE
qpdfview uses a configuration file usually located at "~/.config/qpdfview/qpdfview.conf", which allows configuration of the toolbars and thumbnails. The keys "fileToolBar", "editToolBar" and "viewToolBar" are added to the section "mainWindow". Their values are comma-separated lists. The default (available) entries are: fileToolBar: openInNewTab, refresh (open, saveCopy, print) editToolBar: currentPage, numberOfPages, previousPage, nextPage (firstPage, lastPage, jumpToPage, search) viewToolBar: scaleFactor, zoomIn, zoomOut (onePage, twoPages, oneColumn, twoColumns, fitToPage, fitToPageWidth, doNotScale, rotateLeft, rotateRight, fullscreen, presentation) The order of the items in the list defines the order of the items in the toolbar. (See examples.) Setting the keys "thumbnailWidth" and "thumbnailHeight" in the section "documentView" specifies the size of the thumbnails. The icon theme used by Qt can be overridden by setting the key "iconTheme" in the section "mainWindow". EXAMPLES
The command qpdfview foo.pdf#3#0.5 bar.pdf opens foo.pdf in the first tab with the middle of page 3 aligned to the top of the tab and bar.pdf in the second tab at the begin- ning of the document. Subsequent execution of the following commands qpdfview --unique foo.pdf bar.pdf qpdfview --unique foo.pdf#5 opens foo.pdf and bar.pdf, then reloads foo.pdf and displays its page 5. Subsequent execution of the following commands qpdfview --unique foo.pdf qpdfview bar.pdf qpdfview --unique foo1.pdf bar1.pdf opens foo.pdf in the first window, bar.pdf in a second window and then foo1.pdf and bar1.pdf in additional tabs in the first window. Adding the lines fileToolBar=openInNewTab, refresh, saveCopy, print editToolBar=firstPage, previousPage, currentPage, numberOfPages, nextPage, lastPage, search viewToolBar=zoomOut, scaleFactor, zoomIn, oneColumn, twoColumns, rotateLeft, rotateRight in section "mainWindow" of the configuration file leads to the corresponding items being displayed in the given order in the tool- bars. BUGS
If you find a bug, please report it at https://launchpad.net/qpdfview. AUTHOR
Benjamin Eltzner <b.eltzner@gmx.de> March 2012 QPDFVIEW(1)
All times are GMT -4. The time now is 02:18 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy