Top Forums Shell Programming and Scripting Compare content between two files Post 302744831 by Scrutinizer on Saturday 15th of December 2012 03:35:56 AM
To get unique results you could just run everything throught sort -u:
Code:
grep -xFf file1 file2 | sort -u

or
Code:
awk 'NR==FNR{A[$1]; next}$1 in A' file1 file2 | sort -u



--
Alternatively, one could make sure results only get printed once, for example:
Code:
awk 'NR==FNR{A[$1]++; next}$1 in A{delete A[$1]; print $1}' file1 file2


===

To get a count, you could use the -H opion you can run everything through | sort | uniq -c
Code:
grep -HxFf file1 file2 | sort | uniq -c

or to also specify the file name:
Code:
echo | grep -xFf infile1904 infile1904b - | sort | uniq -c



--
To get exactly the result you specified, it would need to be something like this:
Code:
awk '
  NR==FNR{
    A[$1]++;
    next
  }
  $1 in A{
    T[$1]++
  } 
  END{
    for(i in T)printf "%s: %s , repeated %d times\n", FILENAME,i,T[i]
  }
' file1 file2


Last edited by Scrutinizer; 12-15-2012 at 05:58 AM..
This User Gave Thanks to Scrutinizer For This Post:
 
Test Your Knowledge in Computers #1004
Difficulty: Medium
Hopper College at Caltech University was named in honor of Grace Hopper in 2017.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compare the content of 2 files

Hi Guys, What is the most effecient way to compare the content of 2 seperate files and extract the result of there is a match? We have 2 separate log files and we are trying to find the common errors from the 2 files. Thanks, Odogbolu98 :( (3 Replies)
Discussion started by: odogbolu98
3 Replies

2. UNIX for Dummies Questions & Answers

Compare the content of a variable with a string

Hello all: I'm new in Unix and here and I'am spanish so my english isn't so good to explain my doubt. Here it is. Very urgent: I need to compare the value of a variable with a string. Example is this. Imagine that the variable x1 contains the path and a file text and I need to compare... (2 Replies)
Discussion started by: robdai
2 Replies

3. Shell Programming and Scripting

compare logfile content

Hi folks I have some logfiles like this: ./2009_08_22_14_08_entire_backup_no_1.log . . . ./2009_08_22_14_34_entire_backup_no_14.log each one contains a timestamp from "date +'%s'" now i need function which finds the logfile with the greatest number in it and returns (echos) the... (7 Replies)
Discussion started by: latenite
7 Replies

4. Shell Programming and Scripting

Help with Compare and search content in directory

Hello, How to search in directory by comparing some string with the content of directory. Ex: I want to compare abhi string with the content of backup directory. i.e want to check that is there any file in backup directory having name ... (3 Replies)
Discussion started by: AbhijitIT
3 Replies

5. Shell Programming and Scripting

Compare a content of variable to a database column

Hi have an array like this colarray="a" colarray="b" colarray="c" colarray="d" colarray="e" colarray="f" the arrayvariable is in unix sh file i want to check the content of the array to oracle database table. that is whether "a" is present in the table. (4 Replies)
Discussion started by: barani75
4 Replies

6. Shell Programming and Scripting

compare 2 files and show count same content.

$ cat File1 Non HTTP response code:java.net.ConnectException225073X 000000005143329Load time: 402335410224 Non HTTP response code: ava.net.ConnectException206423X 000000005143330Load time: 402305687161 Non HTTP response code: ava.net.ConnectException290212X 000000005143331Load time:... (1 Reply)
Discussion started by: ooilinlove
1 Replies

7. Shell Programming and Scripting

To compare the content of two text files

I have two files, sec.txt(1st File) 3172 disp.txt(2nd file) the file name is *********** 45676 Now i want to compare the value in sec.txt file with disp.txt file Excatly i want to compare the value 3172 in first file and 45676 in second file. i want to compare the first line of... (11 Replies)
Discussion started by: rammm
11 Replies

8. Shell Programming and Scripting

Ksh: how compare content of a file with an other array

Hi, I created a skript in ksh which generate a file with semicolon as separator, this is an example of the file a created: example content file: hello;AAAA;2014-08-17 hello;BBBB;2014-08-17 hello;CCCC;2014-08-17 I would need to compare the content in of the second column of this file... (3 Replies)
Discussion started by: jmartin
3 Replies

9. Shell Programming and Scripting

Compare two folders and file content

Hi, I am having two folders where i need to compare the content of files and also to know if any new files been added and redirect the difference output in respective filename logs. For e.g.: Directory D1: f1 f2 f3 Directory D2: f1 f2 f3 f4 i Need to compare the directories... (25 Replies)
Discussion started by: rohit_shinez
25 Replies

10. Shell Programming and Scripting

Help with compare 2 column content and corrected/replaced word

Input File CGGCGCCTCGCNNNCGAGCG CGGCGCGCCGAATCCGTGCG TCGCNGC GCGCCGC ACGGCNNNNN ACGGCCTCGCG CGGCNGCCCGCCC CGGCGCGCCGTCC Desired Output File CGGCGCCTCGCNNNCGAGCG CGGCGCGCCGAATCCGTGCG CGGCGCCTCGCATCCGAGCG TCGCNGC GCGCCGC TCGCCGC ACGGCNNNNN ACGGCCTCGCG ACGGCTCGCG... (6 Replies)
Discussion started by: perl_beginner
6 Replies

Featured Tech Videos

All times are GMT -4. The time now is 03:34 AM.
Unix & Linux Forums Content Copyright 1993-2020. All Rights Reserved.
Privacy Policy