I have two files one (numbers file)contains the numbers(approximately 30000) and the other file(record file) contains the records(approximately 40000)which may or may not contain the numbers from that file.

I want to seperate the records which has the field 1=(any of the number from numbers file). Can you please suggest how it can be achieved without having performance issues.


Regards
Shiv@jad

Can you post sample data from both the files , we can try something using AWKand FOR loop.

The sample numbers are
027245799
010479168
015286940
043385828
and sample recors are nothing but the records with comma seperated fields wherein we have to search these numbers in first comma seperated field

$> cat data.dat
1,3,4,
m,h,j
4,5,h
h,t,y
r,t,b
3,f,r

$> cat numbers.dat
1
2
3
4
5


for i in `cat numbers.dat`
do
cat data.dat|awk -F"," '{if($1==number) print $0}' number="$i"
done

OUTPUT
1,3,4,
3,f,r
4,5,h

"number" is a variable in AWK which is initialised to shell variable "i" .

Thanks a lot this is what i needed will try this code block

Can you please let me know how can i redirect it to some different file.