Sponsored Content
Top Forums Shell Programming and Scripting how to find duplicate files with find ? Post 302087607 by Hitori on Monday 4th of September 2006 02:10:33 AM
Old 09-04-2006
Duplicated by name or by content?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Find duplicate value comparing 2 files and create an output

I need a perl script which will create an output file after comparing two diff file in a directory path: /export/home/abc/file1 /export/home/abc/file2 File Format: <IP>TAB<DeviceName><TAB>DESCRIPTIONS file1: 10.1.2.1.3<tab>abc123def<tab>xyz.mm1.ppp.... (2 Replies)
Discussion started by: ricky007
2 Replies

2. Shell Programming and Scripting

Find Duplicate files, not by name

I have a directory with images: -rw-r--r-- 1 root root 26216 Mar 19 21:00 020109.210001.jpg -rw-r--r-- 1 root root 21760 Mar 19 21:15 020109.211502.jpg -rw-r--r-- 1 root root 23144 Mar 19 21:30 020109.213002.jpg -rw-r--r-- 1 root root 31350 Mar 20 00:45 020109.004501.jpg -rw-r--r-- 1 root... (2 Replies)
Discussion started by: Ikon
2 Replies

3. Shell Programming and Scripting

Find duplicate files

What utility do you recommend for simply finding all duplicate files among all files? (4 Replies)
Discussion started by: kiasas
4 Replies

4. Shell Programming and Scripting

Find duplicate files by file size

Hi! I want to find duplicate files (criteria: file size) in my download folder. I try it like this: find /Users/frodo/Downloads \! -type d -exec du {} \; | sort > /Users/frodo/Desktop/duplicates_1.txt; cut -f 1 /Users/frodo/Desktop/duplicates_1.txt | uniq -d | grep -hif -... (9 Replies)
Discussion started by: Dirk Einecke
9 Replies

5. Shell Programming and Scripting

find duplicate string in many different files

I have more than 100 files like this: SVEAVLTGPYGYT 2 SVEGNFEETQY 10 SVELGQGYEQY 28 SVERTGTGYT 6 SVGLADYNEQF 21 SVGQGYEQY 32 SVKTVLGYEQF 2 SVNNEQF 12 SVRDGLTNSPLH 3 SVRRDREGLEQF 11 SVRTSGSYEQY 17 SVSVSGSPLQETQY 78 SVVHSTSPEAF 59 SVVPGNGYT 75 (4 Replies)
Discussion started by: xshang
4 Replies

6. Shell Programming and Scripting

Find duplicate files but with different extensions

Hi ! I wonder if anyone can help on this : I have a directory: /xyz that has the following files: chsLog.107.20130603.gz chsLog.115.20130603 chsLog.111.20130603.gz chsLog.107.20130603 chsLog.115.20130603.gz As you ca see there are two files that are the same but only with a minor... (10 Replies)
Discussion started by: fretagi
10 Replies

7. Shell Programming and Scripting

Find duplicate rows between files

Hi champs, I have one of the requirement, where I need to compare two files line by line and ignore duplicates. Note, I hav files in sorted order. I have tried using the comm command, but its not working for my scenario. Input file1 srv1..development..employee..empname,empid,empdesg... (1 Reply)
Discussion started by: Selva_2507
1 Replies

8. Shell Programming and Scripting

Find help in shell - that clears away duplicate files

I am so frustrated!!! I want a nice command that clears away duplicate files: find . -type f -regex '.*{1,3}\..*' | xargs -I## rm -v '##' should work in my opinion. But it finds nothing even though I have files that have the file name: Scooby-Doo-1.txt Himalaya-2.jpg Camping... (8 Replies)
Discussion started by: Mr.Glaurung
8 Replies

9. Shell Programming and Scripting

To Find Duplicate files using latest in Linux

I have tried the following code and with that i couldnt achieve what i want. #!/usr/bin/bash find ./ -type f \( -iname "*.xml" \) | sort -n > fileList sed -i '/\.\/fileList/d' fileList NAMEOFTHISFILE=$(echo $0|sed -e 's/\/()$*.^|/\\&/g') sed -i "/$NAMEOFTHISFILE/d"... (2 Replies)
Discussion started by: gold2k8
2 Replies

10. UNIX for Advanced & Expert Users

AIX find duplicate backup files

I would like find and delete old backup files in aix. How would I go about doing this? For example: server1_1-20-2020 server1_1-21-2020 server1_1-22-2020 server1_1-23-2020 server2_1-20-2020 server2_1-21-2020 server2_1-22-2020 server2_1-23-2020 How would I go about finding and... (3 Replies)
Discussion started by: cokedude
3 Replies
Mojo::Content(3pm)					User Contributed Perl Documentation					Mojo::Content(3pm)

NAME
Mojo::Content - HTTP 1.1 content base class SYNOPSIS
use Mojo::Base 'Mojo::Content'; DESCRIPTION
Mojo::Content is an abstract base class for HTTP 1.1 content as described in RFC 2616. EVENTS
Mojo::Content can emit the following events. "drain" $content->on(drain => sub { my ($content, $offset) = @_; ... }); Emitted once all data has been written. $content->on(drain => sub { my $content = shift; $content->write_chunk(time); }); "body" $content->on(body => sub { my $content = shift; ... }); Emitted once all headers have been parsed and the body starts. $content->on(body => sub { my $content = shift; $content->auto_upgrade(0) if $content->headers->header('X-No-MultiPart'); }); "read" $content->on(read => sub { my ($content, $chunk) = @_; ... }); Emitted when a new chunk of content arrives. $content->unsubscribe('read'); $content->on(read => sub { my ($content, $chunk) = @_; say "Streaming: $chunk"; }); ATTRIBUTES
Mojo::Content implements the following attributes. "auto_relax" my $relax = $content->auto_relax; $content = $content->auto_relax(1); Try to detect broken web servers and turn on relaxed parsing automatically. "headers" my $headers = $content->headers; $content = $content->headers(Mojo::Headers->new); Content headers, defaults to a Mojo::Headers object. "max_leftover_size" my $size = $content->max_leftover_size; $content = $content->max_leftover_size(1024); Maximum size in bytes of buffer for pipelined HTTP requests, defaults to the value of the "MOJO_MAX_LEFTOVER_SIZE" environment variable or 262144. "relaxed" my $relaxed = $content->relaxed; $content = $content->relaxed(1); Activate relaxed parsing for HTTP 0.9 and responses that are terminated with a connection close. METHODS
Mojo::Content inherits all methods from Mojo::EventEmitter and implements the following new ones. "body_contains" my $success = $content->body_contains('foo bar baz'); Check if content contains a specific string. Meant to be overloaded in a subclass. "body_size" my $size = $content->body_size; Content size in bytes. Meant to be overloaded in a subclass. "boundary" my $boundary = $content->boundary; Extract multipart boundary from "Content-Type" header. "build_body" my $string = $content->build_body; Render whole body. "build_headers" my $string = $content->build_headers; Render all headers. "charset" my $charset = $content->charset; Extract charset from "Content-Type" header. "clone" my $clone = $content->clone; Clone content if possible, otherwise return "undef". "generate_body_chunk" my $chunk = $content->generate_body_chunk(0); Generate dynamic content. "get_body_chunk" my $chunk = $content->get_body_chunk(0); Get a chunk of content starting from a specfic position. Meant to be overloaded in a subclass. "get_header_chunk" my $chunk = $content->get_header_chunk(13); Get a chunk of the headers starting from a specfic position. "has_leftovers" my $success = $content->has_leftovers; Check if there are leftovers. "header_size" my $size = $content->header_size; Size of headers in bytes. "is_chunked" my $success = $content->is_chunked; Check if content is chunked. "is_dynamic" my $success = $content->is_dynamic; Check if content will be dynamically generated, which prevents "clone" from working. "is_finished" my $success = $content->is_finished; Check if parser is finished. "is_multipart" my $false = $content->is_multipart; False. "is_parsing_body" my $success = $content->is_parsing_body; Check if body parsing started yet. "leftovers" my $bytes = $content->leftovers; Get leftover data from content parser. "parse" $content = $content->parse("Content-Length: 12 Hello World!"); Parse content chunk. "parse_body" $content = $content->parse_body("Hi!"); Parse body chunk. "parse_body_once" $content = $content->parse_body_once("Hi!"); Parse body chunk once. "parse_until_body" $content = $content->parse_until_body("Content-Length: 12 Hello World!"); Parse chunk and stop after headers. "progress" my $size = $content->progress; Size of content already received from message in bytes. "write" $content->write('Hello!'); $content->write('Hello!', sub {...}); Write dynamic content non-blocking, the optional drain callback will be invoked once all data has been written. "write_chunk" $content->write_chunk('Hello!'); $content->write_chunk('Hello!', sub {...}); Write dynamic content non-blocking with "chunked" transfer encoding, the optional drain callback will be invoked once all data has been written. SEE ALSO
Mojolicious, Mojolicious::Guides, <http://mojolicio.us>. perl v5.14.2 2012-09-05 Mojo::Content(3pm)
All times are GMT -4. The time now is 06:41 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy