Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Delete lines in file containing duplicate strings, keeping longer strings
Top Forums Shell Programming and Scripting Delete lines in file containing duplicate strings, keeping longer strings Post 302556119 by Corona688 on Friday 16th of September 2011 04:15:10 PM
Old 09-16-2011
Assuming the XML is as you've shown it and not some slightly different arrangement:

Code:
$ awk -v FS="\"" '{
        # Remember the order tokens come in
        if(!L[$2]) { C[N++]=$2; L[$2]=1; }
        # Save the longest
        if(length($3) > length(A[$2])) { A[$2]=$3; B[$2]=$0 }
}

END { for(M=0; M<N; M++) print B[C[M]] }' < data
<string name="string1">RZ-LED</string>
<string name="string2">Version 2.0</string>
<string name="string3">BP</string>
$

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grep and delete lines except the lines with strings

Hi I am writing a script which should read a file and search for certain strings 'approved' or 'removed' and retain only those lines that contain the above strings. Ex: file name 'test' test: approved package waiting for approval package disapproved package removed package approved... (14 Replies)
Discussion started by: vj8436
14 Replies

2. UNIX for Dummies Questions & Answers

Delete lines with duplicate strings based on date

Hey all, a relative bash/script newbie trying solve a problem. I've got a text file with lots of lines that I've been able to clean up and format with awk/sed/cut, but now I'd like to remove the lines with duplicate usernames based on time stamp. Here's what the data looks like 2007-11-03... (3 Replies)
Discussion started by: mattv
3 Replies

3. UNIX for Dummies Questions & Answers

Delete strings in file1 based on the list of strings in file2

Hello guys, should be a very easy questn for you: I need to delete strings in file1 based on the list of strings in file2. like file2: word1_word2_ word3_word5_ word3_word4_ word6_word7_ file1: word1_word2_otherwords..,word3_word5_others... (7 Replies)
Discussion started by: roussine
7 Replies

4. Shell Programming and Scripting

Delete lines starting with these strings

Platform : RHEL 5.8 I have text file called myapplication.log . In this file, I have around 800 lines which start with the followng three strings PWRBRKER-3493 PWRBRKER-7834 SCHEDULER-ERROR How can I delete these lines in one go ? (13 Replies)
Discussion started by: omega3
13 Replies

5. Shell Programming and Scripting

Getting lines between two strings with duplicate set of data

if I have the following lines in a file app.log some lines here <AAAA> abc <id>123456789</id> ddd </AAAA>some lines here too <BBBB> abc <id>123456789</id> ddd </BBBB>some lines here too <AAAA> xyz <id>987654321</id> ssss </AAAA>some lines here again... How do I get the... (5 Replies)
Discussion started by: nariwithu
5 Replies

6. Shell Programming and Scripting

Delete duplicate strings in a line

Hi, i need help to remove duplicates in my file. The problem is i need to delete one duplicate for each line only. the input file as follows and it is not tab delimited:- The output need to remove 2nd word (in red) that duplicate with 1st word (in blue). Other duplicates should remained... (12 Replies)
Discussion started by: redse171
12 Replies

7. UNIX for Dummies Questions & Answers

Replace some strings keeping others

I want to replace strings in test2 according to test1 table. In doing so, I`m losing records that I dont need to replace, please suggest modifications. what i have $ cat > test1 a b c d 　 $ cat > test2 a a a d d 　 what i tried $ awk ' BEGIN {FS=OFS=" "} FNR==NR{a=$2;next}... (2 Replies)
Discussion started by: senhia83
2 Replies

8. Shell Programming and Scripting

Remove lines containing 2 or more duplicate strings

Within my text file i have several thousand lines of text with some lines containing duplicate strings/words. I would like to entirely remove those lines which contain the duplicate strings. Eg; One and a Two Unix.com is the Best This as a Line Line Example duplicate sentence with the word... (22 Replies)
Discussion started by: martinsmith
22 Replies

9. UNIX for Beginners Questions & Answers

How to pass strings from a list of strings from another file and create multiple files?

Hello Everyone , Iam a newbie to shell programming and iam reaching out if anyone can help in this :- I have two files 1) Insert.txt 2) partition_list.txt insert.txt looks like this :- insert into emp1 partition (partition_name) (a1, b2, c4, s6, d8) select a1, b2, c4, (2 Replies)
Discussion started by: nubie2linux
2 Replies

10. UNIX for Beginners Questions & Answers

Use strings from nth field from one file to match strings in entire line in another file, awk

I cannot seem to get what should be a simple awk one-liner to work correctly and cannot figure out why. I would like to use patterns from a specific field in one file as regex to search for matching strings in the entire line ($0) of another file. I would like to output the lines of File2 which... (1 Reply)
Discussion started by: jvoot
1 Replies

LEARN ABOUT DEBIAN

template::plugin::xml::xpath

Template::Plugin::XML::XPath(3pm)			User Contributed Perl Documentation			 Template::Plugin::XML::XPath(3pm)

NAME

       Template::Plugin::XML::XPath - Plugin interface to XML::XPath

SYNOPSIS

	   # load plugin and specify XML file to parse
	   [% USE xpath = XML.XPath(xmlfile) %]
	   [% USE xpath = XML.XPath(file => xmlfile) %]
	   [% USE xpath = XML.XPath(filename => xmlfile) %]

	   # load plugin and specify XML text to parse
	   [% USE xpath = XML.XPath(xmltext) %]
	   [% USE xpath = XML.XPath(xml => xmltext) %]
	   [% USE xpath = XML.XPath(text => xmltext) %]

	   # then call any XPath methods (see XML::XPath docs)
	   [% FOREACH page = xpath.findnodes('/html/body/page') %]
	      [% page.getAttribute('title') %]
	   [% END %]

	   # define VIEW to present node(s)
	   [% VIEW repview notfound='xmlstring' %]
	      # handler block for a <report>...</report> element
	      [% BLOCK report %]
		 [% item.content(view) %]
	      [% END %]

	      # handler block for a <section title="...">...</section> element
	      [% BLOCK section %]
	      <h1>[% item.getAttribute('title') | html %]</h1>
	      [% item.content(view) %]
	      [% END %]

	      # default template block passes tags through and renders
	      # out the children recursivly
	      [% BLOCK xmlstring;
		 item.starttag; item.content(view); item.endtag;
	      END %]

	      # block to generate simple text
	      [% BLOCK text; item | html; END %]
	   [% END %]

	   # now present node (and children) via view
	   [% repview.print(page) %]

	   # or print node content via view
	   [% page.content(repview) %]

DESCRIPTION

       This is a Template Toolkit plugin interfacing to the XML::XPath module.

       All methods implemented by the XML::XPath modules are available.  In addition, the XML::XPath::Node::Element module implements
       present($view) and content($view) methods method for seamless integration with Template Toolkit VIEWs.  The XML::XPath::Node::Text module
       is also adorned with a present($view) method which presents itself via the view using the 'text' template.

       To aid the reconstruction of XML, methods starttag and endtag are added to XML::XPath::Node::Element which return the start and end tag for
       that element.  This means that you can easily do:

	 [% item.starttag %][% item.content(view) %][% item.endtag %]

       To render out the start tag, followed by the content rendered in the view "view", followed by the end tag.

AUTHORS

       This plugin module was written by Andy Wardley.

       The XML::XPath module is by Matt Sergeant.

COPYRIGHT

       Copyright (C) 1996-2006 Andy Wardley.  All Rights Reserved.

       This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

SEE ALSO

       Template::Plugin, XML::XPath, XML::Parser

perl v5.8.8							    2008-03-01					 Template::Plugin::XML::XPath(3pm)
All times are GMT -4. The time now is 01:22 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy