Sponsored Content
Full Discussion: sed or awk editing help
Top Forums Shell Programming and Scripting sed or awk editing help Post 302468404 by ctsgnb on Tuesday 2nd of November 2010 03:55:00 PM
Old 11-02-2010
Quote:
Originally Posted by Scrutinizer
Which is consistent with my findings. There is not much difference between using several replace statement and using a loop, but there is a significant gain when groups are not being used.

You state this is obvious ("of course") why then didn't you use it in the first place, especially since your main concern is speed?

I do not think it was obvious at all and I cannot think of a good reason why grouping would have to take up so much time. I am glad I found out that it does though.
Maybe the parsing Step, indeed, when ambiguous grouping is specified, it goes through a kind of "auto completion" step.
Also maybe using a memory copy instead of a memory mapping?.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Editing File using awk/sed

Hello Awk Gurus, Can anyone of you help me with the below problem. I have got a file having data in below format pmFaultyTransportBlocks ----------------------- 9842993 pmFrmNoOfDiscRachFrames ----------------------- NULL pmNoRecRandomAccSuccess -----------------------... (4 Replies)
Discussion started by: Mohammed
4 Replies

2. Shell Programming and Scripting

Editing Commas in a textfile using sed

Hi guys task removing the last commas of 5th and 6th columns. The bug in the script is causing effect because of whitespaces around commas. I tried to delete white spaces first and running the above script. but still some where getting the results wrong. I already have a script to do this... (12 Replies)
Discussion started by: repinementer
12 Replies

3. Homework & Coursework Questions

String editing using sed? awk?

1. The problem statement, all variables and given/known data: Problem Statement for project: When an account is created on the CS Unix network, a public html directory is created in the account's home directory. A default web page is put into that directory. Some users replace or... (13 Replies)
Discussion started by: peage1475
13 Replies

4. Shell Programming and Scripting

problem in using sed command in editing a file

Hi all, I have a conf file, i want to update some entries in that conf file. Below is the code for that using a temporary file. sed '/workgroup=/ c\workgroup=Workgroup' /usr/local/netx.conf > /usr/local/netx.conf.tmp mv -f /usr/local/netx.conf.tmp /usr/local/netx.conf Sample contents of... (9 Replies)
Discussion started by: ranj14r
9 Replies

5. Shell Programming and Scripting

Comparison and editing of files using awk.(And also a possible bug in awk for loop?)

I have two files which I would like to compare and then manipulate in a way. File1: pictures.txt 1.1 1.3 dance.txt 1.2 1.4 treehouse.txt 1.3 1.5 File2: pictures.txt 1.5 ref2313 1.4 ref2345 1.3 ref5432 1.2 ref4244 dance.txt 1.6 ref2342 1.5 ref2352 1.4 ref0695 1.3 ref5738 1.2... (1 Reply)
Discussion started by: linuxkid
1 Replies

6. Shell Programming and Scripting

Line/Variable Editing for Awk sed Cut

Hello, i have a file, i open the file and read the line, i want to get the first item in the csv file and also teh third+6 item and wirte it to a new csv file. only problem is that using echo it takes TOO LONG: please help a newbie. below is my code: WorkingDir=$1 FileName=`cut -d ',' -f... (2 Replies)
Discussion started by: limamichelle
2 Replies

7. UNIX for Dummies Questions & Answers

sed editing help....

Hello all, I need some help with sed. seems like i cant get through it. So here is what i am trying. when i do ps -ef|grep bla blah ...like below...i get /u01/app/oracle/11g/bin/tnslsnr .... but i want to replace that string with something using sed. So basically i want to get rid of... (3 Replies)
Discussion started by: abdul.irfan2
3 Replies

8. UNIX for Dummies Questions & Answers

sed help finding and editing

With sed 1. I need to find a line that contains "DVM" and "73069". 2. I need to insert a double quote at the beginning of the first line of the file. These two have been driving me crazy for the last 45 minutes. Any help would be greatly appreciated. Thanks (3 Replies)
Discussion started by: nlassiter
3 Replies

9. Shell Programming and Scripting

editing file with awk cut and sed

HI All, I am new to unix. I have a file would like to do some editing by using awk, cut and sed. Could anyone help? This file contain 100 lines. There are one line for example: 2,"102343454",5060,"579668","579668","579668","SIP",,,"825922","035885221283026",1,268,"00:59:00.782 APR 17... (2 Replies)
Discussion started by: mimilaw
2 Replies

10. Shell Programming and Scripting

Editing files with sed or something similar

{ "AFafa": "FAFA","AFafa": "FAFA" "baseball":"soccer","wrestling":"dancing" "rhinos":"crocodiles","roles":"foodchain" } I need to insert a new line before the closing brackets "}" so that the final output looks like this: { "AFafa": "FAFA","AFafa": "FAFA"... (6 Replies)
Discussion started by: SkySmart
6 Replies
WIGGLE(1)						      General Commands Manual							 WIGGLE(1)

NAME
wiggle - apply rejected patches and perform word-wise diffs SYNOPSIS
wiggle [function] [options] file [files] DESCRIPTION
The main function of wiggle is to apply a patch to a file in a similar manner to the patch(1) program. The distinctive difference of wiggle is that it will attempt to apply a patch even if the "before" part of the patch doesn't match the tar- get file perfectly. This is achieved by breaking the file and patch into words and finding the best alignment of words in the file with words in the patch. Once this alignment has been found, any differences (word-wise) in the patch are applied to the file as best as possi- ble. Also, wiggle will (in some cases) detect changes that have already been applied, and will ignore them. wiggle ensures that every change in the patch is applied to the target file somehow. If a particular change cannot be made in the file, the file is annotated to show where the change should be made is a similar way to the merge(1) program. Each annotation contains 3 compo- nents: a portion of the original file where the change should be applied, a portion of the patch that couldn't be matched precisely in the file, and the text that should replace that portion of the patch. These are separated by lines containing precisely 7 identical charac- ters, either '<', '|', '=', or '>', so <<<<<<< Some portion of the original file ||||||| text to replace ======= text to replace it with >>>>>>> indicates that "text to replace" should be replaced by "text to replace it with" somewhere in the portion of the original file. However wiggle was not able to find a place to make this change. wiggle can also produce conflict reports showing only the words that are involved rather than showing whole lines. In this case the output looks like: <<<---original|||old===new--->>> A typical usage of wiggle is to run patch to apply some patch, and to collect a list of rejects by monitoring the error messages from patch. Then for each file for which a reject was found, run wiggle --replace originalfile originalfile.rej Finally each file must be examined to resolve any unresolved conflicts, and to make sure the applied patch is semantically correct. OPTIONS The following options are understood by wiggle. Some of these are explained in more detail in the following sections on MERGE, DIFF, and EXTRACT. -m, --merge Select the "merge" function. This is the default function. -d, --diff Select the "diff" function. This displays the differences between files. -x, --extract Select the "extract" function. This extracts one branch of a patch or merge file. -w, --words Request that all operations and display be word based. This is the default for the "diff" function. -l, --lines Request that all operations and display be line based. -p, --patch Treat the last named file as a patch instead of a file (with --diff) or a merge (--extract). -r, --replace Normally the merged output is written to standard-output. With --replace, the original file is replaced with the merge output. -R, --reverse When used with the "diff" function, swap the files before calculating the differences. When used with the "merge" function, wiggle attempts to revert changes rather than apply them. -i, --no-ignore Normally wiggle with ignore changes in the patch which appear to already have been applied in the original. With this flag those changes are reported as conflicts rather than being ignored. -h, --help Print a simple help message. If given after one of the function selectors (--merge, --diff, --extract) help specific to that func- tion is displayed. -V, --version Display the version number of wiggle. -v, --verbose Enable verbose mode. Currently this makes no difference. -q, --quiet Enable quiet mode. This suppresses the message from the merge function when there are unresolvable conflicts. WORDS wiggle can divide a text into lines or words when performing it's tasks. A line is simply a string of characters terminated by a newline. A word is either a maximal contiguous string of alphanumerics (including underscore), a maximal contiguous string of space or tab charac- ters, or any other single character. MERGE The merge function modifies a given text by finding all changes between two other texts and imposing those changes on the given text. Normally wiggle considers words which have changed so as to maximise the possibility of finding a good match in the given text for the con- text of a given change. However it can consider only whole lines. wiggle extracts the three texts that it needs from files listed on the command line. Either 1, 2, or 3 files may be listed, and any one of them may be a lone hyphen signifying standard-input. If one file is given, it is treated as a merge file, i.e. the output of "merge -A" or "wiggle". Such a file implicitly contains three streams and these are extracted and compared. If two files are given, then the first simply contains the primary text, and the second is treated as a patch file (the output of "diff -u" or "diff -c", or a ".rej" file from patch) and the two other texts are extracted from that. Finally if three files are listed, they are taken to contain the given text and the two other texts, in order. Normally the result of the merge is written to standard-output. However if the "-r" flag is given, the output is written to a file which replaces the original given file. In this case the original file is renamed to have a .porig suffix (for "patched original" which makes sense if you first use patch to apply a patch, and then use wiggle to wiggle the rejects in). If no errors occur (such as file access errors) wiggle will exit with a status of 0 if all changes were successfully merged, and with an exit status of 1 and a brief message if any changes could not be fully merged and were instead inserted as annotations. The merge function can operate in three different modes with respect to lines or words. With the --lines option, whole lines are compared and any conflicts are reported as whole lines that need to be replaced. With the --words option, individual words are compared and any conflicts are reported just covering the words affected. This used the <<<|||===>>> conflict format. Without either of these options, a hybrid approach is taken. Individual words are compared and merged, but when a conflict is found the whole surrounding line is reported as being in conflict. wiggle will ensure that every change between the two other texts is reflected in the result of the merge somehow. There are four different ways that a change can be reflected. 1 If a change converts A to B and A is found at a suitable place in the original file, it is replaced with B. This includes the pos- sibility that B is empty, but not that A is empty. 2 If a change is found which simply adds B and the text immediately preceding and following the insertion are found adjacent in the original file in a suitable place, then B is inserted between those adjacent texts. 3 If a change is found which changes A to B and this appears (based on context) to align with B in the original, then it is assumed that this change has already been applied, and the change is ignored. When this happens, a message reflected the number of ignored changes is printed by wiggle. This optimisation can be suppressed with the -i flag. 4 If a change is found that does not fit any of the above possibilities, then a conflict is reported as described earlier. DIFF The diff function is provided primarily to allow inspection of the alignments that wiggle calculated between texts and that it uses for performing a merge. The output of the diff function is similar to the unified output of diff. However while diff does not output long stretches of common text, wiggle's diff mode outputs everything. When calculating a word-based alignment (the default), wiggle may need to show these word-based differences. This is done using an exten- sion to the unified-diff format. If a line starts with a vertical bar, then it may contain sections surrounded by special multi-character brackets. The brackets "<<<++" and "++>>>" surround added text while "<<<--" and "-->>>" surround removed text. wiggle can be given the two texts to compare in one of three ways. If only one file is given, then it is treated as a patch and the two branches of that diff are compared. This effectively allows a patch to be refined from a line-based patch to a word-based patch. If two files are given, then they are normally assumed to be simple texts to be compared. If two files are given along with the --patch option, then the second file is assumed to be a patch and either the first (with -1) or the second (with -2) branch is extracted and compared with text found in the first file. This last option causes wiggle to apply a "best-fit" algorithm for aligning patch hunks with the file before computing the differences. This algorithm is used when merging a patch with a file, and its value can be seen by comparing the difference produced this was with the difference produced by first extracting one branch of a patch into a file, and then computing the difference of that file with the main file. EXTRACT The extract function of wiggle simply exposes the internal functionality for extracting one branch of a patch or a merge file. Precisely one file should be given, and it will be assumed to be a merge file unless --patch is given, in which case a patch is assumed. The choice of branch in made by providing one of -1, -2, or -3 with obvious meanings. WARNING
Caution should always be exercised when applying a rejected patch with wiggle. When patch rejects a patch, it does so for a good reason. Even though wiggle may be able to find a believable place to apply each textual change, there is no guarantee that the result is correct in any semantic sense. The result should always be inspected to make sure it is correct. EXAMPLES
wiggle --replace file file.rej This is the normal usage of wiggle and will take any changes in file.rej that patch could not apply, and merge them into file. wiggle -dp1 file file.rej This will perform a word-wise comparison between the file and the before branch of the diff in file.rej and display the differences. This allows you to see where a given patch would apply. wiggle --merge --help Get help about the merge function of wiggle. QUOTE
The name of wiggle was inspired by the following quote, even though wiggle does not (yet) have a graphical interface. The problem I find is that I often want to take (file1+patch) -> file2, when I don't have file1. But merge tools want to take (file1|file2) -> file3. I haven't seen a graphical tool which helps you to wiggle a patch into a file. -- Andrew Morton - 2002 SHORTCOMINGS
- wiggle cannot read the extended unified-diff output that it produces for --diff --words. - wiggle cannot read the word-based merge format that it produces for --merge --words. AUTHOR
Neil Brown at Computer Science and Engineering at The University of New South Wales, Sydney, Australia SEE ALSO
patch(1), diff(1), merge(1), wdiff(1), diff3(1). v0.8 WIGGLE(1)
All times are GMT -4. The time now is 01:14 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy