Sponsored Content
Top Forums Shell Programming and Scripting Sed/awk to tell differences between two lists Post 303038045 by jeffs42885 on Thursday 22nd of August 2019 12:17:28 PM
Old 08-22-2019
Sed/awk to tell differences between two lists

Greetings all, I have two output lists from a log that I am working with. Below are the examples. except, the lists are in the thousands.

list1.out
Code:
FEA1234
FEA4343
FEA3453
FEA3413
FEA34A3
FEA3433
....


list2.out
Code:
FEA1235
FEA4343
FEA3323
FEA3413
FEA34A3
FEA3433
....

I need to be able to find the differences in the list, and output things that are in list one, and not in list two, and vice versa, and somewhat easily identify them. I tried doing this a few different ways in excel with no luck. Wondering if I can use sed/awk or some other type of bash utility to accomplish this. I may also be overthinking this.

Thanks in advance.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Differences in awk between UNIX flavours

Hi, I've been charged with the task of finding out whether the scripts which we use on our current DYNIX (Sequent) UNIX box will continue to run happily on our soon-to-be-installed Sun Solaris box. I'm fairly certain that they'll be OK, but I've heard mutterings about awk running differently... (2 Replies)
Discussion started by: pbritta
2 Replies

2. Shell Programming and Scripting

Shell Script to Create non-duplicate lists from two lists

File_A contains Strings: a b c d File_B contains Strings: a c z Need to have script written in either sh or ksh. Derive resultant files (File_New_A and File_New_B) from lists File_A and File_B where string elements in File_New_A and File_New_B are listed below. Resultant... (7 Replies)
Discussion started by: mlv_99
7 Replies

3. Shell Programming and Scripting

Differences between 2 Flat Files and process the differences

Hi Hope you are having a great weeknd !! I had a question and need your expertise for this : I have 2 files File1 & File2(of same structure) which I need to compare on some columns. I need to find the values which are there in File2 but not in File 1 and put the Differences in another file... (5 Replies)
Discussion started by: newbie_8398
5 Replies

4. Shell Programming and Scripting

Unexpected results with lists in GNU sed

I have been living with this problem with GNU sed v4.1.4 for a long time, but now I really need to figure it out. When using a list in either an address or a search, the expression is matching lower and upper-case letters. works as it should. For example, if I run sed -nr "// p"... (7 Replies)
Discussion started by: nctrader
7 Replies

5. Shell Programming and Scripting

awk to compare 2nd and 3rd field and print the differences

need a one liner to compare 2nd and 3rd field and print values that are not matched in 2nd field Input col 2 col 3 1.1.1.1 11.11.11.11 8.8.8.8 0.0.0.0 3.3.3.3 2.2.2.2 7.7.7.7 3.3.3.3 5.5.5.5 1.1.1.1 4.4.4.4 6.6.6.6 9.9.9.9 output 7.7.7.7 ... (12 Replies)
Discussion started by: chidori
12 Replies

6. Shell Programming and Scripting

sed and awk giving error ./sample.sh: line 13: sed: command not found

Hi, I am running a script sample.sh in bash environment .In the script i am using sed and awk commands which when executed individually from terminal they are getting executed normally but when i give these sed and awk commands in the script it is giving the below errors :- ./sample.sh: line... (12 Replies)
Discussion started by: satishmallidi
12 Replies

7. UNIX for Dummies Questions & Answers

Lists in awk

Hi togehter! I would like to write an awk script which prints the first column divided by the sum of the second column: So if this is my list 1 2 2 1 3 1 4 1 it should print a list like this: 1/5 2/5 3/5 4/5 My idea was to use END like this: (3 Replies)
Discussion started by: bjoern456
3 Replies

8. Shell Programming and Scripting

2 lists, show differences plus or minus

Not really sure how to accomplish this. If I have two lists with matching columns. Second column is different. I would like to show the differences plus/minus. list1 device1 5 decive2 10 decive3 10 device4 10 device5 10 device6 20 list2 device1 10 ... (1 Reply)
Discussion started by: mrlayance
1 Replies

9. Shell Programming and Scripting

awk to find differences between two file

I am trying to find the differences between the two sorted, tab separated, attached files. Thank you :). In update2 there are 52,058 lines and in current2 there are 52,197 so 139 differences should result. However, awk 'FNR==NR{a;next}!($0 in a)' update2 current2 > out2comm -1 -3... (2 Replies)
Discussion started by: cmccabe
2 Replies

10. Shell Programming and Scripting

ksh / AIX - Differences between lists to a text file

This seems pretty simple, but I cant figure it out. I get stumped on the simple things. I am running two commands 1) take a listing a directory of files, and filter out the doc_name (which is in a series of extracted files), and place it in a file. ls -l | awk '{print $9}' | grep... (5 Replies)
Discussion started by: jeffs42885
5 Replies
dircmp(1)						      General Commands Manual							 dircmp(1)

NAME
dircmp - Compares two directories SYNOPSIS
dircmp [-d] [-s] directory1 directory2 The dircmp command reads directory1 and directory2, compares their contents, and writes the results to standard output. STANDARDS
Interfaces documented on this reference page conform to industry standards as follows: dircmp: XCU5.0 Refer to the standards(5) reference page for more information about industry standards and associated tags. OPTIONS
Displays for each common file name the differing contents of the two files, if any. The display format is the same as that of the diff command. Does not list the names of identical files. OPERANDS
The path name of a directory to be compared. DESCRIPTION
First, dircmp compares the file names in each directory. When the same file name appears in both, dircmp compares the contents of the two files. In the output, dircmp lists the files unique to each directory. It then lists the files with identical names but different contents. If entered without a option, dircmp also lists files that have both identical names and identical contents. NOTES
[Tru64 UNIX] In many cases, diff -r, rather than dircmp, is preferred. The dircmp command is marked LEGACY. The diff -r command should be used instead. EXAMPLES
To summarize the differences between the files in two directories, enter: dircmp proj.ver1 proj.ver2 This displays a summary of the differences between the directories proj.ver1 and proj.ver2. The summary lists separately the files found only in one directory or the other, and those found in both. If the file is found in both directories, the file is listed. If the files are identical, dircmp displays identical; otherwise, dircmp displays different. To show the details of the differences between files, enter: dircmp -d -s proj.ver1 proj.ver2 The -s option suppresses information about identical files. The -d option displays a diff listing for each of the differing files found in both directories. SEE ALSO
Commands: cmp(1), diff(1) Standards: standards(5) dircmp(1)
All times are GMT -4. The time now is 06:20 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy