Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Delete lines between two patterns excluding the other lines containing these pattern Post 303044637 by RudiC on Friday 28th of February 2020 01:07:38 PM
Old 02-28-2020
Not that easy as your start pattern occurs multiple times. For your sample, adapting your first attempt:
Code:
tac file | sed  '/ccc/,/aaa/{/^ *$/d;}' | tac
aaa 409
bbb 201

122 0.98
aaa 1.47
aaa 0.00
aaa 0.00
ccc 0.00
121 0.01
135 1.99

Are multiple end patterns ("ccc") possible?


EDIT: or

Code:
sed -zr 's/(aaa[^\n]*)\n\n([^\n]*ccc)/\1\n\2/' file
aaa 409
bbb 201

122 0.98
aaa 1.47
aaa 0.00
aaa 0.00
ccc 0.00
121 0.01
135 1.99


Last edited by RudiC; 02-28-2020 at 02:17 PM..
This User Gave Thanks to RudiC For This Post:
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Delete lines between two patterns without deleting the second pattern

I want to delete lines like this sed '/FROM_HERE/,/TO_HERE/d' but I would like to *not* delete the second match, i.e. the TO_HERE line. How can I achieve this? Thank you! (1 Reply)
Discussion started by: Ilja
1 Replies

2. Shell Programming and Scripting

delete lines between patterns

Hi, I've searched in this forum all day long but was not able to find enough codes to help me do a task. The only code that I can come up with is this: sed '/ /,/ /{//p;d;}' inputfile > outputfile I would like to sed/awk/grep a file for two patterns and then delete the lines between... (4 Replies)
Discussion started by: shamushamu
4 Replies

3. Shell Programming and Scripting

Delete Lines between the pattern

Hi All, Below is my requirement. Whatever coming in between ' ', needs to delete. Input File Contents: ============== This is nice 'boy' This 'is bad boy.' Got it Expected Output =========== This is nice This Got it (4 Replies)
Discussion started by: susau_79
4 Replies

4. Shell Programming and Scripting

sed pattern to delete lines containing a pattern, except the first occurance

Hello sed gurus. I am using ksh on Sun and have a file created by concatenating several other files. All files contain header rows. I just need to keep the first occurrence and remove all other header rows. header for file 1111 2222 3333 header for file 1111 2222 3333 header for file... (8 Replies)
Discussion started by: gary_w
8 Replies

5. Shell Programming and Scripting

print lines up to pattern excluding pattern

11 22 33 44 55 66 77 When pattern 55 is met, print upto it, so output is 11 22 33 44 (1 Reply)
Discussion started by: anilcliff
1 Replies

6. Shell Programming and Scripting

Delete lines and the first pattern between 2 matched patterns

Hi, i need help to delete all the lines between 2 matched patterns and the first pattern must be deleted too. sample as follows: inputfile.txt >kump_1 ........................... ........................... >start_0124 dgfhghgfh fgfdgfh fdgfdh >kump_2 ............................. (7 Replies)
Discussion started by: redse171
7 Replies

7. Shell Programming and Scripting

Sed: printing lines AFTER pattern matching EXCLUDING the line containing the pattern

'Hi I'm using the following code to extract the lines(and redirect them to a txt file) after the pattern match. But the output is inclusive of the line with pattern match. Which option is to be used to exclude the line containing the pattern? sed -n '/Conn.*User/,$p' > consumers.txt (11 Replies)
Discussion started by: essem
11 Replies

8. Shell Programming and Scripting

How to delete all lines before a particular pattern when the pattern is defined in a variable?

I have a file Line 1 a Line 22 Line 33 Line 1 b Line 22 Line 1 c Line 4 Line 5 I want to delete all lines before last occurrence of a line which contains something which is defined in a variable. Say a variable var contains 'Line 1', then I need the following in the output. ... (21 Replies)
Discussion started by: Soham
21 Replies

9. UNIX for Beginners Questions & Answers

Delete multiple lines between blank lines containing two patterns

Hi all, I'm looking for a way (sed or awk) to delete multiple lines between blank lines containing two patterns ex: user: alpha parameter_1 = 15 parameter_2 = 1 parameter_3 = 0 user: alpha parameter_1 = 15 parameter_2 = 1 parameter_3 = 0 user: alpha parameter_1 = 16... (3 Replies)
Discussion started by: ce9888
3 Replies

10. UNIX for Beginners Questions & Answers

How to print lines from a files with specific start and end patterns and pick only the last lines?

Hi, I need to print lines which are matching with start pattern "SELECT" and END PATTERN ";" and only select the last "select" statement including the ";" . I have attached sample input file and the desired input should be as: INPUT FORMAT: SELECT ABCD, DEFGH, DFGHJ, JKLMN, AXCVB,... (5 Replies)
Discussion started by: nani2019
5 Replies
XML::DT(3pm)						User Contributed Perl Documentation					      XML::DT(3pm)

NAME
XML::DT - a package for down translation of XML files SYNOPSIS
use XML::DT; %xml=( 'music' => sub{"Music from: $c "}, 'lyrics' => sub{"Lyrics from: $v{name} "}, 'title' => sub{ uc($c) }, '-userdata => { something => 'I like' }, '-default' => sub{"$q:$c"} ); print dt($filename,%xml); ABSTRACT
This module is a XML down processor. It maps tag (element) names to functions to process that element and respective contents. DESCRIPTION
This module processes XML files with an approach similar to OMNIMARK. As XML parser it uses XML::LibXML module in an independent way. You can parse HTML files as if they were XML files. For this, you must supply an extra option to the hash: %hander = ( -html => 1, ... ); You can also ask the parser to recover from XML errors: %hander = ( -recover => 1, ... ); Functions dt Down translation function "dt" receives a filename and a set of expressions (functions) defining the processing and associated values for each element. dtstring "dtstring" works in a similar way with "dt" but takes input from a string instead of a file. dturl "dturl" works in a similar way with "dt" but takes input from an Internet url instead of a file. pathdt The "pathdt" function is a "dt" function which can handle a subset of XPath on handler keys. Example: %handler = ( "article/title" => sub{ toxml("h1",{},$c) }, "section/title" => sub{ toxml("h2",{},$c) }, "title" => sub{ $c }, "//image[@type='jpg']" => sub{ "JPEG: <img src="$c">" }, "//image[@type='bmp']" => sub{ "BMP: sorry, no bitmaps on the web" }, ) pathdt($filename,%handler); Here are some examples of valid XPath expressions under XML::DT: /aaa /aaa/bbb //ccc - ccc somewhere (same as "ccc") /*/aaa/* //* - same as "-default" /aaa[@id] - aaa with an attribute id /*[@*] - root with an attribute /aaa[not(@name)] - aaa with no attribute "name" //bbb[@name='foo'] - ... attribute "name" = "foo" /ccc[normalize-space(@name)='bbb'] //*[name()='bbb'] - complex way of saying "//bbb" //*[starts-with(name(),'aa')] - an element named "aa.*" //*[contains(name(),'c')] - an element ".*c.*" //aaa[string-length(name())=4] "...." //aaa[string-length(name())&lt;4] ".{1,4}" //aaa[string-length(name())&gt;5] ".{5,}" Note that not all XPath is currently handled by XML::DT. A lot of XPath will never be added to XML::DT because is not in accordance with the down translation model. For more documentation about XPath check the specification at http://www.w3c.org or some tutorials under http://www.zvon.org pathdtstring Like the "dtstring" function but supporting XPath. pathdturl Like the "dturl" function but supporting XPath. ctxt Returns the context element of the currently being processed element. So, if you call ctxt(1) you will get your father element, and so on. inpath "inpath(pattern)" is true if the actual element path matches the provided pattern. This function is meant to be used in the element functions in order to achieve context dependent processing. inctxt "inctxt(pattern)" is true if the actual element father matches the provided pattern. toxml This is the default "-default" function. It can be used to generate XML based on $c $q and %v variables. Example: add a new attribute to element "ele1" without changing it: %handler=( ... ele1 => sub { $v{at1} = "v1"; toxml(); }, ) "toxml" can also be used with 3 arguments: tag, attributes and contents toxml("a",{href=> "http://local/f.html"}, "example") returns: <a href='http://local/f.html'>example</a> Empty tags are written as empty tags. If you want an empty tag with opening and closing tags, then use the "tohtml". tohtml See "toxml". xmltree This simple function just makes a HASH reference: { -c => $c, -q => $q, all_the_other_attributes } The function "toxml" understands this structure and makes XML with it. mkdtskel Used by the mkdtskel script to generate automatically a XML::DT perl script file based on an XML file. Check "mkdtskel" manpage for details. mkdtskel_fromDTD Used by the mkdtskel script to generate automatically a XML::DT perl script file based on an DTD file. Check "mkdtskel" manpage for details. mkdtdskel Used by the mkdtskel script to generate automatically a XML::DT perl script file based on a DTD file. Check "mkdtdskel" manpage for details. Accessing parents With XML::DT you can access an element parent (or grand-parent) attributes, till the root of the XML document. If you use c<$dtattributes[1]{foo} = 'bar'> on a processing function, you are defining the attribute "foo" for that element parent. In the same way, you can use $dtattributes[2] to access the grand-parent. $dtattributes[-1] is, as expected, the XML document root element. There are some shortcuts: "father" "gfather" "ggfather" You can use these functions to access to your "father", grand-father ("gfather") or great-grand-father ("ggfather"): father("x"); # returns value for attribute "x" on father element father("x", "value"); # sets value for attribute "x" on father # element You can also use it directly as a reference to @dtattributes: father->{"x"}; # gets the attribute father->{"x"} = "value"; # sets the attribute $attributes = father; # gets all attributes reference "root" You can use it as a function to access to your tree root element. root("x"); # gets attribute C<x> on root element root("x", "value"); # sets value for attribute C<x> on root You can also use it directly as a reference to $dtattributes[-1]: root->{"x"}; # gets the attribute x root->{"x"} = "value"; # sets the attribute x $attributes = root; # gets all attributes reference User provided element processing functions The user must provide an HASH with a function for each element, that computes element output. Functions can use the element name $q, the element content $c and the attribute values hash %v. All those global variables are defined in $CALLER::. Each time an element is find the associated function is called. Content is calculated by concatenation of element contents strings and interior elements return values. "-default" function When a element has no associated function, the function associated with "-default" called. If no "-default" function is defined the default function returns a XML like string for the element. When you use "/-type" definitions, you often need do set "-default" function to return just the contents: "sub{$c}". "-outputenc" option "-outputenc" defines the output encoding (default is Unicode UTF8). "-inputenc" option "-inputenc" forces a input encoding type. Whenever that is possible, define the input encoding in the XML file: <?xml version='1.0' encoding='ISO-8859-1'?> "-pcdata" function "-pcdata" function is used to define transformation over the contents. Typically this function should look at context (see "inctxt" function) The default "-pcdata" function is the identity "-cdata" function You can process "<CDATA"> in a way different from pcdata. If you define a "-cdata" method, it will be used. Otherwise, the "-pcdata" method is called. "-begin" function Function to be executed before processing XML file. Example of use: initialization of side-effect variables "-end" function Function to be executed after processing XML file. I can use $c content value. The value returned by "-end" will be the "dt" return value. Example of use: post-processing of returned contents "-recover" option If set, the parser will try to recover in XML errors. "-html" option If set, the parser will try to recover in errors. Note that this differs from the previous one in the sense it uses some knowledge of the HTML structure for the recovery. "-userdata" option Use this to pass any information you like to your handlers. The data structure you pass in this option will be available as $u in your code. -- New in 0.62. Elements with values other than strings (";-type") By default all elements return strings, and contents ($c) is the concatenation of the strings returned by the sub-elements. In some situations the XML text contains values that are better processed as a structured type. The following types (functors) are available: THE_CHILD Return the result of processing the only child of the element. LAST_CHILD Returns the result of processing the last child of the element. STR concatenates all the sub-elements returned values (DEFAULT) all the sub-element should return strings to be concatenated; SEQ makes an ARRAY with all the sub elements contents; attributes are ignored (they should be processed in the sub-element). (returns a ref) If you have different types of sub-elements, you should use SEQH SEQH makes an ARRAY of HASH with all the sub elements (returns a ref); for each sub-element: -q => element name -c => contents at1 => at value1 for each attribute MAP makes an HASH with the sub elements; keys are the sub-element names, values are their contents. Attributes are ignored. (they should be processed in the sub-element) (returns a ref) MULTIMAP makes an HASH of ARRAY; keys are the sub-element names; values are lists of contents; attributes are ignored (they should be processed in the sub-element); (returns a ref) MMAPON(element-list) makes an HASH with the sub-elements; keys are the sub-element names, values are their contents; attributes are ignored (they should be processed in the sub-element); for all the elements contained in the element-list, it is created an ARRAY with their contents. (returns a ref) XML return a reference to an HASH with: -q => element name -c => contents at1 => at value1 for each attribute ZERO don't process the sub-elements; return "" When you use "/-type" definitions, you often need do set "-default" function returning just the contents "sub{$id}". An example: use XML::DT; %handler = ( contacts => sub{ [ split(";",$c)] }, -default => sub{$c}, -type => { institution => 'MAP', degrees => MMAPON('name') tels => 'SEQ' } ); $a = dt ("f.xml", %handler); with the following f.xml <degrees> <institution> <id>U.M.</id> <name>University of Minho</name> <tels> <item>1111</item> <item>1112</item> <item>1113</item> </tels> <where>Portugal</where> <contacts>J.Joao; J.Rocha; J.Ramalho</contacts> </institution> <name>Computer science</name> <name>Informatica </name> <name> history </name> </degrees> would make $a { 'name' => [ 'Computer science', 'Informatica ', ' history ' ], 'institution' => { 'tels' => [ 1111, 1112, 1113 ], 'name' => 'University of Minho', 'where' => 'Portugal', 'id' => 'U.M.', 'contacts' => [ 'J.Joao', ' J.Rocha', ' J.Ramalho' ] } }; DT Skeleton generation It is possible to build an initial processor program based on an example To do this use the function "mkdtskel(filename)". Example: perl -MXML::DT -e 'mkdtskel "f.xml"' > f.pl DTD skeleton generation It makes a naive DTD based on an example(s). To do this use the function "mkdtdskel(filename*)". Example: perl -MXML::DT -e 'mkdtdskel "f.xml"' > f.dtd SEE ALSO
mkdtskel(1) and mkdtdskel(1) AUTHORS
Home for XML::DT; http://natura.di.uminho.pt/~jj/perl/XML/ Jose Joao Almeida, <jj@di.uminho.pt> Alberto Manuel Simo~es, <albie@alfarrabio.di.uminho.pt> ACKNOWLEDGEMENTS
Michel Rodriguez <mrodrigu@ieee.org> Jose Carlos Ramalho <jcr@di.uminho.pt> Mark A. Hillebrand COPYRIGHT AND LICENSE
Copyright 1999-2012 Project Natura. This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself. perl v5.14.2 2012-06-25 XML::DT(3pm)
All times are GMT -4. The time now is 01:32 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy