Sed -f alternatives?


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Sed -f alternatives?
# 8  
Old 04-26-2012
Are you replacing the tags or the data?
If you are changing the tags, it might be simpler to parse the xml file, create a database, then re-create the xml file using the replacement tags.
Replacing the data is somewhat trickier if the replacement word is a portion of the data field.
# 9  
Old 04-26-2012
I'm replacing data.. :-( If I was replacing tags, I would have loaded it, changed the tags and exported it like you said.
# 10  
Old 04-26-2012
Some assumptions:
If the 100mb file contains 1 to 2 million records, and the control file is 10000 lines at 13 characters per line, using a simple sed routine will process about 130gb of data. Whether this is all disk i/o or memory will depend upon how well the shell uses memory.
If there is only one data field per line, create two temporary data files, one containing the tags, and the other the data. Add line numbers to the files.
Sort the data portion into data portion sequence. Sort the control file into original field sequence, write a merge program to read the sorted data only file, replace the field, and write a new temporary file with the new data (including the original line number).
Sort the new temporary data file back to line number sequence, and merge with the temporary tag file to produce a new xml file.
The total data processed this way should be less than 1gb.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Builtin alternatives for several commands?

I'm adapting a BASH script to run with an absolute minimal amounts of Cygwin64 files so colleagues using Windows can use it without installing Cygwin. I am down to the following in /bin only (replacing cut with parameter substitution eliminated all needed things in /etc) bash.exe cygattr-1.dll... (5 Replies)
Discussion started by: Michael Stora
5 Replies

2. UNIX for Dummies Questions & Answers

Find command alternatives

Hi is there an alternative other than the find command to get the size of files which are 10 days older ? I already use a script with find command find . -mtime +10. However would want to have an alternative script to find the size of files which are over 10 days. Let me know if you... (1 Reply)
Discussion started by: venkidhadha
1 Replies

3. Shell Programming and Scripting

Alternatives to Expect

Are there any other alternatives to using Expect script? Can functionality provided by Expect be achieved by any other scripting language? (7 Replies)
Discussion started by: indianya
7 Replies

4. UNIX for Advanced & Expert Users

SSH alternatives

Hi, I am using SSH to execute unix commands on remote machines. But, SSH will be diabled soon and I am looking for other alternatives to execute remote scripts/commands, without SSH . any suggestions or workarounds with out SSH for remote program executions ? Thanks in advance. (4 Replies)
Discussion started by: talashil
4 Replies

5. Red Hat

Alternatives for sudo??

I am looking for an alternative for sudo in linux, where i need not type the password. OR is there any other version of 'growisofs', which can be executed under sudo??? As currently 'growisofs' refuses to start under sudo... Thanks in advance (12 Replies)
Discussion started by: sony star
12 Replies

6. Solaris

Metamail Alternatives on Solaris 10

Hi All, We have been trying to Install Metamail on our Solaris 10 server but have failed to do so. We are a bit topo short of time here so are now trying to Explore any Meta Mail alternatives. What we basically want to do is: Server will recieve email, Procmail will recieve the email... (0 Replies)
Discussion started by: paragkhanore
0 Replies

7. Linux

ntop/Nmon alternatives

Hi folks, Any folk has experience on ntop/Nmon ntop - network top and its spinoff NMON Welcome to nmon.net Nmon Nmon - Wikipedia, the free encyclopedia nmon for AIX and Linux Performance Monitoring IBM Wikis - AIX 5L Wiki - nmon A free tool to analyze AIX and Linux... (5 Replies)
Discussion started by: satimis
5 Replies

8. UNIX for Advanced & Expert Users

Alternatives for CLOCK_MONOTONIC

Hi, I need to develop timeout functionality in my code, which is not affected by system's time changes.Unfortunately I dont have CLOCK_MONOTONIC support in my OS. Are there any alternatives? (3 Replies)
Discussion started by: amitks21
3 Replies

9. UNIX for Advanced & Expert Users

Unix Sort - Alternatives

Hi All, I want to sort a flat file which will contain millions of records based on a key/field. For this I want to use unix sort command and before that I want to make sure that unix sort command has any file size limitations. And also please let me know whether I have to change any... (1 Reply)
Discussion started by: chprvkmr
1 Replies

10. UNIX for Dummies Questions & Answers

ASP alternatives

I have just found out that a project I have developed in ASP (ultradev) needs to be migrated to a unix server and won't be able to support asp. Can anyone point me in the right direction to see what my options are with Unix? I have never worked with or developed for a Unix box before. Also,... (3 Replies)
Discussion started by: Ricki
3 Replies
Login or Register to Ask a Question