Login or Register to Ask a Question and Join Our Community


UNIX for Dummies Questions & Answers

Optimized Method

 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Optimized Method
# 1  
Old 12-14-2006
Optimized Method
Hi All,

I have got two files.

File A with 50000 records and
File B with some 500 million records.

I need to extract the mapping data (common data) from both the files.

There should be definitely many ways Smilie though I have a way which is definitely not optimzed and takes a longer time to run.

What bothers me is the time taken to run?
Any optimized way to do that?

Cheers!
# 2  
Old 12-14-2006
I would vote for Python to be the best performer ( based on my experience ) but depending on what you need to extract - you may use awk, or simple grep.
# 3  
Old 12-14-2006
See my suggestion in my last post in this thread (note that file A and B is reversed from what you have).
 
Login or Register to Ask a Question

Previous Thread | Next Thread

6 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sed optimized for replace substring

Hi All, I have this text file IR7013903069171012INT10171211864 Axxxxxxxxxx12345dddddddddddd Byyyyyyyyy99999999ddddddddd IR7013903069171012TOS10171211865 Cffffffffff5745747ehdefffffffffgggggggg Dyyyyyyyyy99999999ddddddddd I need to 1) find lines where the substring IR70139 is... (5 Replies)
Discussion started by: gio123bgg
5 Replies

2. Solaris

svc:/network/physical:default: Method "/lib/svc/method/net-physical" failed with exit status 96. [ n

After a memory upgrade all network interfaces are misconfigued. How do i resolve this issue. Below are some out puts.thanks. ifconfig: plumb: SIOCLIFADDIF: eg000g0:2: no such interface # ifconfig eg1000g0:2 plumb ifconfig: plumb: SIOCLIFADDIF: eg1000g0:2: no such interface # ifconfig... (2 Replies)
Discussion started by: andersonedouard
2 Replies

3. Shell Programming and Scripting

Optimized way of doing the task in shell programming

Hi I have a file consists of the following similar lines (10 mb file) 2008-05-15 02:15:38,268 RMSConnectionFactory - Setting session state for connection. 2008-05-15 02:15:38,277 RMSConnectionFactory - Returning WS connection. My task is to find out any missing second lines for... (14 Replies)
Discussion started by: pcjandyala
14 Replies

4. UNIX for Dummies Questions & Answers

searchin optimized

hi friens, :) if ther are files named .c++,.C++,.cpp,.Cpp,.CPp,.cPP,.CpP,.cpP,.c,.C wat is the pattern for finding them :confused: (1 Reply)
Discussion started by: arunsubbhian
1 Replies

5. Linux

Optimized Linux 2.6.10 Kernel for Dual Xeon with Hyperthreading

Anyone have tips on configuring the 2.6.10 kernel to take full advantage of dual 2.4 Ghz Xeons? I'm not getting expected benchmark results.... and seemingly was better off with a single 2600+ AMD processor. (1 Reply)
Discussion started by: Neo
1 Replies

6. Linux

Server Optimized Linux

Does anyone know where I can get Server Optimized Linux online? Computek:) :( :o :D ;) :p :cool: (3 Replies)
Discussion started by: computek
3 Replies
Login or Register to Ask a Question