02-21-2008
Try this :
############ Search.run ##############
FILE1=file1 ( Your lookup file )
FILE2=file2 ( Your data file with more than .1 MM recs )
awk ' NR==FNR { A[$0]=1; next; }
{ if (substr($0,1,8) in A) { A[$0]=0; } }
END { for (k in A) { if (A[k]!=1) { print k; } } } ' $FILE1 $FILE2
############ Search.run ##############
Courtesy : one post from this forum.
9 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
iam having the file as follows:
ABCDEFGH|0987654321234567
ABCDEFGH|0987654321234523
ABCDEFGH|0987654321234556
ABCDEFGH|0987654321234545
POIUYTRE|1234567890890678
POIUYTRE|1209867757352567
POIUYTRE|5463879088797131
POIUYTRE|5468980091344456
pls provide me the split command
... (14 Replies)
Discussion started by: nivas
14 Replies
2. Shell Programming and Scripting
I want to compare some files.
say iam having 2 sets of files ,each is having some 10 files.
ie,
file1
1a.txt
1b.txt
1c.txt
...
file2
2a.txt
2b.txt
2c.txt
...
i need to read line by line of this files parralley..
ie.. i want to read file1 first line that is 1a.txt and file2... (2 Replies)
Discussion started by: nivas
2 Replies
3. Shell Programming and Scripting
Hi,
Iam having the files as follows:
file1
aa
aa
aa
aa
ab
ac
ad
ae
file2
aa
aa
ab
Outputfile: (20 Replies)
Discussion started by: nivas
20 Replies
4. Infrastructure Monitoring
# set date to your spec: this is month/day/yr/hr/min/sec:
sysdate=`date '+%m/%d/%Y-%H:%M:%S'`
# get the last line before the history file is modified
tail -1 /tmp/hosthistory.txt |while read lastdate mydevices
do
echo $lastdate
echo $mydevices
done
LIST = 'ypcat hosts|| sort... (11 Replies)
Discussion started by: lemseffert
11 Replies
5. Shell Programming and Scripting
Hi All,
How do I code a password with multiple special characters in it.
Example: password is P#utar&@
None of the belwo options worked
1. passwd="P#utar&@"
2. passwd='P#utar&@'
Any help will be greatly appreciated. (3 Replies)
Discussion started by: afredri
3 Replies
6. Shell Programming and Scripting
RCS file: /home/rcap/.APCVS/regs/rc/power/analysis/pow_rtl/renes_setup.g,v
Working file: ./power/analysis/pow_rtl/renes_setup.g
head: 1.14
branch:
locks: strict
access list:
symbolic names:
br_2010_101_200: 1.13.0.12
br_2010_101_100: 1.13.0.10
br_2009_91_200:... (3 Replies)
Discussion started by: harjinder
3 Replies
7. Shell Programming and Scripting
I was trying out some new series to get it print
1
1 2
1 2 3
1 2 3 4
1 2 3 4 5
and the seond one is
1
2 2
3 3 3
4 4 4 4
5 5 5 5 5
but was unable to get the result. (5 Replies)
Discussion started by: harjinder
5 Replies
8. Shell Programming and Scripting
hi,
i am trying this while loop and i only want that it should only read food as pizza....no other entry should be taken here.
#!/usr/bin/perl -w
$food = " ";
while ( $food ne 'pizza' )
{
print 'enter what you had last night: ';
chomp ($food = <STDIN>);
#print $food ;
}
... (2 Replies)
Discussion started by: kullu
2 Replies
9. UNIX for Dummies Questions & Answers
sxsaaas (3 Replies)
Discussion started by: VikrantD
3 Replies
COMM(1) User Commands COMM(1)
NAME
comm - compare two sorted files line by line
SYNOPSIS
comm [OPTION]... FILE1 FILE2
DESCRIPTION
Compare sorted files FILE1 and FILE2 line by line.
With no options, produce three-column output. Column one contains lines unique to FILE1, column two contains lines unique to FILE2, and
column three contains lines common to both files.
-1 suppress column 1 (lines unique to FILE1)
-2 suppress column 2 (lines unique to FILE2)
-3 suppress column 3 (lines that appear in both files)
--check-order
check that the input is correctly sorted, even if all input lines are pairable
--nocheck-order
do not check that the input is correctly sorted
--output-delimiter=STR
separate columns with STR
--help display this help and exit
--version
output version information and exit
Note, comparisons honor the rules specified by `LC_COLLATE'.
EXAMPLES
comm -12 file1 file2
Print only lines present in both file1 and file2.
comm -3 file1 file2
Print lines in file1 not in file2, and vice versa.
AUTHOR
Written by Richard M. Stallman and David MacKenzie.
REPORTING BUGS
Report comm bugs to bug-coreutils@gnu.org
GNU coreutils home page: <http://www.gnu.org/software/coreutils/>
General help using GNU software: <http://www.gnu.org/gethelp/>
Report comm translation bugs to <http://translationproject.org/team/>
COPYRIGHT
Copyright (C) 2011 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law.
SEE ALSO
join(1), uniq(1)
The full documentation for comm is maintained as a Texinfo manual. If the info and comm programs are properly installed at your site, the
command
info coreutils 'comm invocation'
should give you access to the complete manual.
GNU coreutils 8.12.197-032bb September 2011 COMM(1)