Sponsored Content
Top Forums Shell Programming and Scripting Find duplicate value comparing 2 files and create an output Post 302170770 by jim mcnamara on Tuesday 26th of February 2008 03:02:23 PM
Old 02-26-2008
try awk:
Code:
awk ' FILENAME=="file1" { arr[$1 $2]=$1 " " $2; arrip[$1]=$1; arrdev[$2]=$2
      }
      FILENAME=="file2" {
         if($1 ~ /^#/) {$1=substr($1,2)}
      	 if(arr[$1 $2]> " ") { print "Duplicate ip and device found", arr[$1 $2]
      	                  continue}
      	 if(arrip[$1]>" ") {print "Duplicate ip found",arrip[$1]
      	                continue}
      	 if(arrdev[$2]>" ") {print "Duplicate device found", arrdev[$2]}
      }
      ' file1 file2

Output based on your files:
Quote:
csadev:/home/jmcnama> t.awk
Duplicate ip and device found 10.1.2.1.3 abc123def
Duplicate device found abc345def
Duplicate ip found 10.1.2.1.5
Duplicate ip found 10.1.2.1.6
Duplicate device found abc009def
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Dynamically redirect output to duplicate files ???

Hi There are many posts in this forum regarding reditecting output, but mine is a different problem, please have a look. My shell script is redirecting output to a log file dynamically. That is it is using - exec > log1.txt 2>&1 Hence all the traces are appearing in the log1.txt. I want... (3 Replies)
Discussion started by: nsinha
3 Replies

2. Shell Programming and Scripting

Find duplicate value and create an

I need a perl script, which will run every midnight via cronjob and e-mail few users once it finds any duplicated value in a file which is located /etc/hosts, the file name is called hosts and the format of the file has 3 colums and some time 2 columns. The script will look for duplicate IP or... (3 Replies)
Discussion started by: ricky007
3 Replies

3. Shell Programming and Scripting

Find Duplicate files, not by name

I have a directory with images: -rw-r--r-- 1 root root 26216 Mar 19 21:00 020109.210001.jpg -rw-r--r-- 1 root root 21760 Mar 19 21:15 020109.211502.jpg -rw-r--r-- 1 root root 23144 Mar 19 21:30 020109.213002.jpg -rw-r--r-- 1 root root 31350 Mar 20 00:45 020109.004501.jpg -rw-r--r-- 1 root... (2 Replies)
Discussion started by: Ikon
2 Replies

4. Shell Programming and Scripting

Find duplicate files

What utility do you recommend for simply finding all duplicate files among all files? (4 Replies)
Discussion started by: kiasas
4 Replies

5. Shell Programming and Scripting

comparing in files and output

i have a file a with contents tom lasole jon gille sam and a file b with contents tom|1234|abcf|newyork,ohio,oregon sam|2345|drft|texas,london hyle|4444|befr|wisconsin neyo|2333|tdtt|ohio,jersey i want to compare records in file a to file b such that when the name tom is... (5 Replies)
Discussion started by: dealerso
5 Replies

6. Shell Programming and Scripting

removing duplicate records comparing 2 csv files

Hi All, I want to remove the rows from File1.csv by comparing a column/field in the File2.csv. If both columns matches then I want that row to be deleted from File1 using shell script(awk). Here is an example on what I need. File1.csv: RAJAK,ACTIVE,1 VIJAY,ACTIVE,2 TAHA,ACTIVE,3... (6 Replies)
Discussion started by: rajak.net
6 Replies

7. UNIX for Advanced & Expert Users

How to find duplicates contents in a files by comparing other files?

Hi Guys , we have one directory ...in that directory all files will be set on each day.. files must have header ,contents ,footer.. i wants to compare the header,contents,footer ..if its same means display an error message as 'files contents same' (7 Replies)
Discussion started by: Venkatesh1
7 Replies

8. Shell Programming and Scripting

Duplicate files and output list

Gents, I have a file like this. 1 1 1 2 2 3 2 4 2 5 3 6 3 7 4 8 5 9 I would like to get something like it 1 1 2 2 3 4 5 3 6 7 Thanks in advance for your support :b: (8 Replies)
Discussion started by: jiam912
8 Replies

9. Shell Programming and Scripting

Comparing Select Columns from two CSV files in UNIX and create a third file based on comparision

Hi , I want to compare first 3 columns of File A and File B and create a new file File C which will have all rows from File B and will include rows that are present in File A and not in File B based on First 3 column comparison. Thanks in advance for your help. File A A,B,C,45,46... (2 Replies)
Discussion started by: ady_koolz
2 Replies

10. Shell Programming and Scripting

Comparing two files in UNIX and create a new file similar to equi join

I have 2 files namely branch.txt file & RXD.txt file as below Ex:Branch.txt ========================= B1,Branchname1,city,country B2,Branchname2,city,country B3,Branchname3,city,country B4,Branchname4,city,country B5,Branchname5,city,country RXD file : will... (11 Replies)
Discussion started by: satece
11 Replies
MEMCACHED_SERVER_PUSH(3)					   libmemcached 					  MEMCACHED_SERVER_PUSH(3)

NAME
memcached_server_push - libmemcached Documentation SYNOPSIS
#include <libmemcached/memcached.h> memcached_server_fn uint32_t memcached_server_count(memcached_st *ptr) memcached_return_t memcached_server_add(memcached_st *ptr, const char *hostname, in_port_t port) memcached_return_t memcached_server_add_udp(memcached_st *ptr, const char *hostname, in_port_t port) memcached_return_t memcached_server_add_unix_socket(memcached_st *ptr, const char *socket) memcached_return_t memcached_server_push(memcached_st *ptr, const memcached_server_st *list) memcached_server_instance_st memcached_server_by_key(memcached_st *ptr, const char *key, size_t key_length, memcached_return_t *error) memcached_server_instance_st memcached_server_get_last_disconnect(const memcached_st *ptr) memcached_return_t memcached_server_cursor(const memcached_st *ptr, const memcached_server_fn *callback, void *context, uint32_t num- ber_of_callbacks) compile and link with -lmemcached DESCRIPTION
libmemcached performs operations on a list of hosts. The order of these hosts determine routing to keys. Functions are provided to add keys to memcached_st structures. To manipulate lists of servers see memcached_server_st(3). memcached_server_count() provides you a count of the current number of servers being used by a memcached_st structure. memcached_server_add() pushes a single TCP server into the memcached_st structure. This server will be placed at the end. Duplicate servers are allowed, so duplication is not checked. Executing this function with the MEMCACHED_BEHAVIOR_USE_UDP behavior set will result in a MEMCACHED_INVALID_HOST_PROTOCOL. memcached_server_add_udp() pushes a single UDP server into the memcached_st structure. This server will be placed at the end. Duplicate servers are allowed, so duplication is not checked. Executing this function with out setting the MEMCACHED_BEHAVIOR_USE_UDP behavior will result in a MEMCACHED_INVALID_HOST_PROTOCOL. memcached_server_add_unix_socket() pushes a single UNIX socket into the memcached_st structure. This UNIX socket will be placed at the end. Duplicate servers are allowed, so duplication is not checked. The length of the filename must be one character less than MEM- CACHED_MAX_HOST_LENGTH. memcached_server_push() pushes an array of memcached_server_st into the memcached_st structure. These servers will be placed at the end. Duplicate servers are allowed, so duplication is not checked. A copy is made of structure so the list provided (and any operations on the list) are not saved. memcached_server_by_key() allows you to provide a key and retrieve the server which would be used for assignment. memcached_server_get_last_disconnect() returns a pointer to the last server for which there was a connection problem. It does not mean this particular server is currently dead but if the library is reporting a server is, the returned server is a very good candidate. memcached_server_cursor() takes a memcached_st and loops through the list of hosts currently in the cursor calling the list of callback functions provided. You can optionally pass in a value via context which will be provided to each callback function. An error return from any callback will terminate the loop. memcached_server_cursor() is passed the original caller memcached_st in its current state. RETURN
Varies, see particular functions. HOME
To find out more information please check: http://libmemcached.org/ SEE ALSO
memcached(1) libmemcached(3) memcached_strerror(3) AUTHOR
Brian Aker COPYRIGHT
2011, Brian Aker DataDifferential, http://datadifferential.com/ 1.0.8 May 22, 2012 MEMCACHED_SERVER_PUSH(3)
All times are GMT -4. The time now is 09:54 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy