Delete lines in file containing duplicate strings, keeping longer strings Post: 302556119

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grep and delete lines except the lines with strings

Hi I am writing a script which should read a file and search for certain strings 'approved' or 'removed' and retain only those lines that contain the above strings. Ex: file name 'test' test: approved package waiting for approval package disapproved package removed package approved...

2. UNIX for Dummies Questions & Answers

Delete lines with duplicate strings based on date

Hey all, a relative bash/script newbie trying solve a problem. I've got a text file with lots of lines that I've been able to clean up and format with awk/sed/cut, but now I'd like to remove the lines with duplicate usernames based on time stamp. Here's what the data looks like 2007-11-03...

3. UNIX for Dummies Questions & Answers

Delete strings in file1 based on the list of strings in file2

Hello guys, should be a very easy questn for you: I need to delete strings in file1 based on the list of strings in file2. like file2: word1_word2_ word3_word5_ word3_word4_ word6_word7_ file1: word1_word2_otherwords..,word3_word5_others...

4. Shell Programming and Scripting

Delete lines starting with these strings

Platform : RHEL 5.8 I have text file called myapplication.log . In this file, I have around 800 lines which start with the followng three strings PWRBRKER-3493 PWRBRKER-7834 SCHEDULER-ERROR How can I delete these lines in one go ?

5. Shell Programming and Scripting

Getting lines between two strings with duplicate set of data

if I have the following lines in a file app.log some lines here <AAAA> abc <id>123456789</id> ddd </AAAA>some lines here too <BBBB> abc <id>123456789</id> ddd </BBBB>some lines here too <AAAA> xyz <id>987654321</id> ssss </AAAA>some lines here again... How do I get the...

6. Shell Programming and Scripting

Delete duplicate strings in a line

Hi, i need help to remove duplicates in my file. The problem is i need to delete one duplicate for each line only. the input file as follows and it is not tab delimited:- The output need to remove 2nd word (in red) that duplicate with 1st word (in blue). Other duplicates should remained...

7. UNIX for Dummies Questions & Answers

Replace some strings keeping others

I want to replace strings in test2 according to test1 table. In doing so, I`m losing records that I dont need to replace, please suggest modifications. what i have $ cat > test1 a b c d 　 $ cat > test2 a a a d d 　 what i tried $ awk ' BEGIN {FS=OFS=" "} FNR==NR{a=$2;next}...

8. Shell Programming and Scripting

Remove lines containing 2 or more duplicate strings

Within my text file i have several thousand lines of text with some lines containing duplicate strings/words. I would like to entirely remove those lines which contain the duplicate strings. Eg; One and a Two Unix.com is the Best This as a Line Line Example duplicate sentence with the word...

9. UNIX for Beginners Questions & Answers

How to pass strings from a list of strings from another file and create multiple files?

Hello Everyone , Iam a newbie to shell programming and iam reaching out if anyone can help in this :- I have two files 1) Insert.txt 2) partition_list.txt insert.txt looks like this :- insert into emp1 partition (partition_name) (a1, b2, c4, s6, d8) select a1, b2, c4,

10. UNIX for Beginners Questions & Answers

Use strings from nth field from one file to match strings in entire line in another file, awk

I cannot seem to get what should be a simple awk one-liner to work correctly and cannot figure out why. I would like to use patterns from a specific field in one file as regex to search for matching strings in the entire line ($0) of another file. I would like to output the lines of File2 which...

LEARN ABOUT REDHAT

xml::dumper

Dumper(3)						User Contributed Perl Documentation						 Dumper(3)

NAME

       XML::Dumper - Perl module for dumping Perl objects from/to XML

SYNOPSIS

	# Convert Perl code to XML
	use XML::Dumper;
	my $dump = new XML::Dumper;
	$data = [
		 {
		   first => 'Jonathan',
		   last => 'Eisenzopf',
		   email => 'eisen@pobox.com'
		 },
		 {
		   first => 'Larry',
		   last => 'Wall',
		   email => 'larry@wall.org'
		 }
		];
	$xml =	$dump->pl2xml($perl);

	# Convert XML to Perl code
	use XML::Dumper;
	my $dump = new XML::Dumper;

	# some XML
	my $xml = <<XML;
       <perldata>
	<scalar>foo</scalar>
       </perldata>
       XML

	# load Perl data structure from dumped XML
	$data = $dump->xml2pl($Tree);

DESCRIPTION

       XML::Dumper dumps Perl data to a structured XML format.	XML::Dumper can also read XML data that was previously dumped by the module and
       convert it back to Perl.

       This is done via the following 2 methods: XML::Dumper::pl2xml XML::Dumper::xml2pl

AUTHOR

       Jonathan Eisenzopf <eisen@pobox.com>

CREDITS

       Chris Thorman <ct@ignitiondesign.com> L.M.Orchard <deus_x@pobox.com> DeWitt Clinton <dewitt@eziba.com>

SEE ALSO

       perl(1), XML::Parser(3).

perl v5.8.0							    1999-06-20								 Dumper(3)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grep and delete lines except the lines with strings

Discussion started by: vj8436

2. UNIX for Dummies Questions & Answers

Delete lines with duplicate strings based on date

Discussion started by: mattv

3. UNIX for Dummies Questions & Answers

Delete strings in file1 based on the list of strings in file2

Discussion started by: roussine

4. Shell Programming and Scripting

Delete lines starting with these strings

Discussion started by: omega3