Sponsored Content
Top Forums Shell Programming and Scripting Shell Programming and Scripting Post 302169398 by kanu_kanu on Thursday 21st of February 2008 06:52:17 AM
Old 02-21-2008
Try this :

############ Search.run ##############
FILE1=file1 ( Your lookup file )
FILE2=file2 ( Your data file with more than .1 MM recs )
awk ' NR==FNR { A[$0]=1; next; }
{ if (substr($0,1,8) in A) { A[$0]=0; } }
END { for (k in A) { if (A[k]!=1) { print k; } } } ' $FILE1 $FILE2
############ Search.run ##############

Courtesy : one post from this forum.
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell Programming and Scripting

Hi, iam having the file as follows: ABCDEFGH|0987654321234567 ABCDEFGH|0987654321234523 ABCDEFGH|0987654321234556 ABCDEFGH|0987654321234545 POIUYTRE|1234567890890678 POIUYTRE|1209867757352567 POIUYTRE|5463879088797131 POIUYTRE|5468980091344456 pls provide me the split command ... (14 Replies)
Discussion started by: nivas
14 Replies

2. Shell Programming and Scripting

Shell Programming and Scripting

I want to compare some files. say iam having 2 sets of files ,each is having some 10 files. ie, file1 1a.txt 1b.txt 1c.txt ... file2 2a.txt 2b.txt 2c.txt ... i need to read line by line of this files parralley.. ie.. i want to read file1 first line that is 1a.txt and file2... (2 Replies)
Discussion started by: nivas
2 Replies

3. Shell Programming and Scripting

Shell Programming and Scripting

Hi, Iam having the files as follows: file1 aa aa aa aa ab ac ad ae file2 aa aa ab Outputfile: (20 Replies)
Discussion started by: nivas
20 Replies

4. Infrastructure Monitoring

Shell Programming and Scripting

# set date to your spec: this is month/day/yr/hr/min/sec: sysdate=`date '+%m/%d/%Y-%H:%M:%S'` # get the last line before the history file is modified tail -1 /tmp/hosthistory.txt |while read lastdate mydevices do echo $lastdate echo $mydevices done LIST = 'ypcat hosts|| sort... (11 Replies)
Discussion started by: lemseffert
11 Replies

5. Shell Programming and Scripting

Shell Programming and Scripting

Hi All, How do I code a password with multiple special characters in it. Example: password is P#utar&@ None of the belwo options worked 1. passwd="P#utar&@" 2. passwd='P#utar&@' Any help will be greatly appreciated. (3 Replies)
Discussion started by: afredri
3 Replies

6. Shell Programming and Scripting

shell scripting and programming

RCS file: /home/rcap/.APCVS/regs/rc/power/analysis/pow_rtl/renes_setup.g,v Working file: ./power/analysis/pow_rtl/renes_setup.g head: 1.14 branch: locks: strict access list: symbolic names: br_2010_101_200: 1.13.0.12 br_2010_101_100: 1.13.0.10 br_2009_91_200:... (3 Replies)
Discussion started by: harjinder
3 Replies

7. Shell Programming and Scripting

shell programming and scripting

I was trying out some new series to get it print 1 1 2 1 2 3 1 2 3 4 1 2 3 4 5 and the seond one is 1 2 2 3 3 3 4 4 4 4 5 5 5 5 5 but was unable to get the result. (5 Replies)
Discussion started by: harjinder
5 Replies

8. Shell Programming and Scripting

shell programming and scripting

hi, i am trying this while loop and i only want that it should only read food as pizza....no other entry should be taken here. #!/usr/bin/perl -w $food = " "; while ( $food ne 'pizza' ) { print 'enter what you had last night: '; chomp ($food = <STDIN>); #print $food ; } ... (2 Replies)
Discussion started by: kullu
2 Replies

9. UNIX for Dummies Questions & Answers

Shell script to read lines in a text file and filter user data Shell Programming and Scripting

sxsaaas (3 Replies)
Discussion started by: VikrantD
3 Replies
JOIN(1) 							   User Commands							   JOIN(1)

NAME
join - join lines of two files on a common field SYNOPSIS
join [OPTION]... FILE1 FILE2 DESCRIPTION
For each pair of input lines with identical join fields, write a line to standard output. The default join field is the first, delimited by blanks. When FILE1 or FILE2 (not both) is -, read standard input. -a FILENUM also print unpairable lines from file FILENUM, where FILENUM is 1 or 2, corresponding to FILE1 or FILE2 -e EMPTY replace missing input fields with EMPTY -i, --ignore-case ignore differences in case when comparing fields -j FIELD equivalent to '-1 FIELD -2 FIELD' -o FORMAT obey FORMAT while constructing output line -t CHAR use CHAR as input and output field separator -v FILENUM like -a FILENUM, but suppress joined output lines -1 FIELD join on this FIELD of file 1 -2 FIELD join on this FIELD of file 2 --check-order check that the input is correctly sorted, even if all input lines are pairable --nocheck-order do not check that the input is correctly sorted --header treat the first line in each file as field headers, print them without trying to pair them -z, --zero-terminated line delimiter is NUL, not newline --help display this help and exit --version output version information and exit Unless -t CHAR is given, leading blanks separate fields and are ignored, else fields are separated by CHAR. Any FIELD is a field number counted from 1. FORMAT is one or more comma or blank separated specifications, each being 'FILENUM.FIELD' or '0'. Default FORMAT outputs the join field, the remaining fields from FILE1, the remaining fields from FILE2, all separated by CHAR. If FORMAT is the keyword 'auto', then the first line of each file determines the number of fields output for each line. Important: FILE1 and FILE2 must be sorted on the join fields. E.g., use "sort -k 1b,1" if 'join' has no options, or use "join -t ''" if 'sort' has no options. Note, comparisons honor the rules specified by 'LC_COLLATE'. If the input is not sorted and some lines cannot be joined, a warning message will be given. AUTHOR
Written by Mike Haertel. REPORTING BUGS
GNU coreutils online help: <http://www.gnu.org/software/coreutils/> Report join translation bugs to <http://translationproject.org/team/> COPYRIGHT
Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>. This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. SEE ALSO
comm(1), uniq(1) Full documentation at: <http://www.gnu.org/software/coreutils/join> or available locally via: info '(coreutils) join invocation' GNU coreutils 8.28 January 2018 JOIN(1)
All times are GMT -4. The time now is 07:13 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy