Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

finding missing items in file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting finding missing items in file
# 1  
Old 03-25-2010
finding missing items in file
I have a need to compare 2 files, then print results to file. Need to find items from file2 that are not found in file 1. thanks in advance!

example:

file 1:
Code:
abcde=12
fffff=6
bbbb=35

file2:
Code:
abcde=12
fffff=6
bbbb=35
ccccc=10
kkkkk=45

result:
Code:
file 1 is missing:
ccccc=10
kkkkk=45

forgot to add: I really don't care what the values are to right of '=', but I only care about the variable to the left of the =.
Last edited by zaxxon; 03-25-2010 at 11:33 AM.. Reason: use code tags please, ty
# 2  
Old 03-25-2010
Code:
diff file1 file2 > result.diff

# 3  
Old 03-25-2010
2 more...

with grep:
Code:
grep -vf file1 file2 > output

with awk:
Code:
awk 'NR==FNR {_[$1]=$1; next} !_[$1]' file1 file2 > output

# 4  
Old 03-25-2010
Or something like that :

Code:
cat file1 | while read a
do
	b=`echo ${a} | cut –d’=’ –f1`
	c=`echo ${a} | cut –d’=’ –f2`
	cat file2 | while read x
	do
		y=`echo {x} | cut –d’=’ –f1`
		z=`echo {x} | cut –d’=’ –f2`
		if [ “${b}” -eq “${y}” ]
		then
			if [ “${c}” -ne “${z}” ]
			then
				echo ${x} >> result.txt
			fi
		fi
	done
done

# 5  
Old 03-25-2010
thanks for quick reply. can I get awk to neglect the value portion of the string(everything after the =)? only focus on variable to the left of the "=" ?
# 6  
Old 03-30-2010
clarification on what I am trying to do:

File1:
abcde=12
fffff=6
bbbb=35

File 2:
xxxxx=99
abcde=55
fffff=6
bbbb=44
rrrrrr=10

Result:
file 1 missing variable(s):
rrrrrr
xxxxx
# 7  
Old 03-30-2010
Quote:
Originally Posted by discostu
clarification on what I am trying to do:

File1:
abcde=12
fffff=6
bbbb=35

File 2:
xxxxx=99
abcde=55
fffff=6
bbbb=44
rrrrrr=10

Result:
file 1 missing variable(s):
rrrrrr
xxxxx
borrowing from zaxxon:
Code:
awk -F= 'NR==FNR {_[$1]=$1; next} !_[$1]' file1 file2 > output
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Finding missing records and Dups

I have a fixed width file. The records looks something similar to below: Type ID SSN NAME .....AND SOME MORE FIELDS A1 1234 ..... A1 1234 ..... B1 1234 ..... M2 4567 ..... M2 4567 ..... N2 4567 ..... N2 4567 ..... A1 9999 N2 9999 Now if A1 is present then B1 has to be present.... (2 Replies)
Discussion started by: Saanvi1
2 Replies

2. AIX

Need help finding missing drivers

I'm in the process of migrating a system to some newer hardware (Power 5 to Power 7). I've done these migrations in the past, and have not had any problems. But this system does not see the new network controllers on the Power 7 system. The system was running AIX 5.3 before, I've upgraded it to... (5 Replies)
Discussion started by: acascianelli
5 Replies

3. Programming

Finding items that occur more than once in a vector

I have some vectors to evaluate and develop a list of values that occur in more than one element. This is the simplest case. I have a vector, std::vector<int> vec1; vec1=5; vec1=5; I need to know that that 5 occurs twice in the vector. If I do a double loop, std::vector<int>... (13 Replies)
Discussion started by: LMHmedchem
13 Replies

4. Shell Programming and Scripting

Finding missing tags

I have a list containing strings. All strings should have either "smp" or "drw" else it is considered an error. I have written this code below. Any better ideas to tackle this? set fdrw = 0 set fsmp = 0 foreach f ($Lst) set fdrwtag = `echo $f | awk '/drw/'` set fsmptag = `echo $f | awk... (1 Reply)
Discussion started by: kristinu
1 Replies

5. Shell Programming and Scripting

Finding missing files that are named sequentially with Perl?

Hello I am new to Perl, in fact I am on chapter one of the book. :) However I am in need of a Perl Script faster than I can finish the book. Perhaps someone can help me with my immediate need while I read my book. I have a directory with hundreds of files that are all named like... (4 Replies)
Discussion started by: newftronics
4 Replies

6. Shell Programming and Scripting

awk between items including items

OS=HP-UX ksh The following works, except I want to include the <start> and <end> in the output. awk -F '<start>' 'BEGIN{RS="<end>"; OFS="\n"; ORS=""} {print $2} somefile.log' The following work in bash but not in ksh sed -n '/^<start>/,/^<end>/{/LABEL$/!p}' somefile.log (4 Replies)
Discussion started by: Ikon
4 Replies

7. Shell Programming and Scripting

Finding missing sequential file names

So, I've got a ton of files that I want to go through (ie something like 300,000), and they're all labeled sequentially. However I'm not 100% positive that they are all there. Is there any way of running through a sequence of numbers, checking if the file is in the folder, if not appending it... (2 Replies)
Discussion started by: Julolidine
2 Replies

8. UNIX for Advanced & Expert Users

Finding which file is missing

I was hoping someone ould help me with the following. I have 2 files in a directory FILEA and FILEB. i am running a process on these 2 files but before the process can run both FILEA and FILEB need to be present. If one or both the files are missing i need to know what file(s) is(are)... (10 Replies)
Discussion started by: SAMZ
10 Replies
Login or Register to Ask a Question