Shell Programming and Scripting

Hi,

Iam having file1 as follows:

ERTYUIOU|1234567689089767688
FDHJHKJH|6817738971783893499
JFKDKLLUI|9080986766433498444

FILE2

Code:

ERTYUIOU|1234567689089767688   resh@abc_com     767637218328322332                     893589893499                         asdsddssd                            2008 80930`2323232
JFKDKFDF|0980897489377324734     UIYUEEIIXCZHOPOW[OGTI   U IUEOIWERIWERERRE          78978978123823   9 90990990-033-93-0909  
JKDDFJLKJFDLFKD

I HAVE GIVEN ONLU 2 LINES IN FILE2

there are lacs of recorsd in file2.

i need to take 1st line in file1 and take that record in file2.

i have used grep command to fetch records from file2....but it is taking hours of time to fetch lacks of records

so i don't want to use grep. instaed how i can take the records from file2 by keeping file1 records.

Thanks in advance.


main goal is to optimise the time taken for greping.
i want to finish the entire fecthing within few minutes.

instead of grep use sed to fetch the record from file 2, followed by q command, so that you don't process the remaining file. something like:

Code:

sed -n '/pattern/ p; q;' file2

Try this :

############ Search.run ##############
FILE1=file1 ( Your lookup file )
FILE2=file2 ( Your data file with more than .1 MM recs )
awk ' NR==FNR { A[$0]=1; next; }
{ if (substr($0,1,8) in A) { A[$0]=0; } }
END { for (k in A) { if (A[k]!=1) { print k; } } } ' $FILE1 $FILE2
############ Search.run ##############

Courtesy : one post from this forum.

your explanation is somewhat vague.
what is the desired output given 2 of your sample files?

from the above file 1 and file2 , i have to get the output file as follows:

Code:

ERTYUIOU|1234567689089767688   resh@abc_com     767637218328322332                     893589893499                         asdsddssd                            2008 80930`2323232

the above commands are not working. pls give the solution.

Did you try #kanu_kanu's suggestion please ?
If you face any issue on that, please let us know

awk ' NR==FNR { A[$0]=1; next; }
{ if (substr($0,1,8) in A) { A[$0]=0; } }
END { for (k in A) { if (A[k]!=1) { print k; } } } ' file1.txt file2.txt >out.txt


no output for this command