Sed -f alternatives?


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Sed -f alternatives?
# 1  
Old 04-25-2012
Sed -f alternatives?

I have a list of items (control file) that I want to substitute in a text file, and it's BIG.

The file has two items, the original, and the new:

A B
B C
D E

The file has something like 10,000 entries.

So in the oldfile.txt, I'd like to basically make all these expression matched substitutions, is there any better way than sed -f?

Like is there a unix utility or script that I'm not aware of that will do this a bit more efficiently?

I'm open to any suggestions.
Thanks.
# 2  
Old 04-25-2012
Hi,
Could you please elaborate your query.


Thanks & Regards,
Mayur
# 3  
Old 04-25-2012
I have a text file: oldfile.txt
It has a lot of stuff I want to do multiple find and replace within.

I have a control file: controlfile.txt
In the control file, is a 2 column list of the "find" and the "replace"

i.e.

This That
Yay Nay
Ying Yang

etc..

I would like to run this control file on the oldfile so that all the substitutions are made within the oldfile. I can use sed -f, and run it as 10,000 sed commands (I don't know if it will die on me or not though)

I'm hoping however, there's a program to do this a bit more elegantly.
# 4  
Old 04-25-2012
What is the structure, if any, of the original (oldfile.txt) text file?
# 5  
Old 04-25-2012
oldfile.txt is actually in xml format.

so I guess I should have called it oldfile.xml
# 6  
Old 04-25-2012
Setting up a sed command file is relatively painless, so why not just run a sample of say 100 commands and test it against the xml file.
See how long it runs, and multiply that by 100 for 10000 entries. If the answer seems doable then be lazy.
This procedure will read the xml file once, and pass each line against the 10000 table entries.
The alternative is to pass the xml file against the table by using grep to see if the xml file even contains the find, then reducing the table size to only the ones found.
# 7  
Old 04-26-2012
The file is actually fairly big; almost 100 megs, so I'm just concerned that running through 10000+ find and replaces on a 100meg file, will be a formula for crashing.. But I'll give it a try.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Builtin alternatives for several commands?

I'm adapting a BASH script to run with an absolute minimal amounts of Cygwin64 files so colleagues using Windows can use it without installing Cygwin. I am down to the following in /bin only (replacing cut with parameter substitution eliminated all needed things in /etc) bash.exe cygattr-1.dll... (5 Replies)
Discussion started by: Michael Stora
5 Replies

2. UNIX for Dummies Questions & Answers

Find command alternatives

Hi is there an alternative other than the find command to get the size of files which are 10 days older ? I already use a script with find command find . -mtime +10. However would want to have an alternative script to find the size of files which are over 10 days. Let me know if you... (1 Reply)
Discussion started by: venkidhadha
1 Replies

3. Shell Programming and Scripting

Alternatives to Expect

Are there any other alternatives to using Expect script? Can functionality provided by Expect be achieved by any other scripting language? (7 Replies)
Discussion started by: indianya
7 Replies

4. UNIX for Advanced & Expert Users

SSH alternatives

Hi, I am using SSH to execute unix commands on remote machines. But, SSH will be diabled soon and I am looking for other alternatives to execute remote scripts/commands, without SSH . any suggestions or workarounds with out SSH for remote program executions ? Thanks in advance. (4 Replies)
Discussion started by: talashil
4 Replies

5. Red Hat

Alternatives for sudo??

I am looking for an alternative for sudo in linux, where i need not type the password. OR is there any other version of 'growisofs', which can be executed under sudo??? As currently 'growisofs' refuses to start under sudo... Thanks in advance (12 Replies)
Discussion started by: sony star
12 Replies

6. Solaris

Metamail Alternatives on Solaris 10

Hi All, We have been trying to Install Metamail on our Solaris 10 server but have failed to do so. We are a bit topo short of time here so are now trying to Explore any Meta Mail alternatives. What we basically want to do is: Server will recieve email, Procmail will recieve the email... (0 Replies)
Discussion started by: paragkhanore
0 Replies

7. Linux

ntop/Nmon alternatives

Hi folks, Any folk has experience on ntop/Nmon ntop - network top and its spinoff NMON Welcome to nmon.net Nmon Nmon - Wikipedia, the free encyclopedia nmon for AIX and Linux Performance Monitoring IBM Wikis - AIX 5L Wiki - nmon A free tool to analyze AIX and Linux... (5 Replies)
Discussion started by: satimis
5 Replies

8. UNIX for Advanced & Expert Users

Alternatives for CLOCK_MONOTONIC

Hi, I need to develop timeout functionality in my code, which is not affected by system's time changes.Unfortunately I dont have CLOCK_MONOTONIC support in my OS. Are there any alternatives? (3 Replies)
Discussion started by: amitks21
3 Replies

9. UNIX for Advanced & Expert Users

Unix Sort - Alternatives

Hi All, I want to sort a flat file which will contain millions of records based on a key/field. For this I want to use unix sort command and before that I want to make sure that unix sort command has any file size limitations. And also please let me know whether I have to change any... (1 Reply)
Discussion started by: chprvkmr
1 Replies

10. UNIX for Dummies Questions & Answers

ASP alternatives

I have just found out that a project I have developed in ASP (ultradev) needs to be migrated to a unix server and won't be able to support asp. Can anyone point me in the right direction to see what my options are with Unix? I have never worked with or developed for a Unix box before. Also,... (3 Replies)
Discussion started by: Ricki
3 Replies
Login or Register to Ask a Question