Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Remove not only the duplicate string but also the keyword of the string in Perl
Top Forums Shell Programming and Scripting Remove not only the duplicate string but also the keyword of the string in Perl Post 302892457 by askari on Wednesday 12th of March 2014 08:09:52 PM
Old 03-12-2014
Hi disedorgue,

Thanks for the script, it works for one-liners but why the script is not work when I try to modify the script as below.
Code:
#!/usr/bin/perl -w
use strict;

my $file = "in.txt";
my %X = ();

open (FH, '<', $file) or die $!;

my @F = <FH>;

foreach my $i (@F) 
{ 
  $X{$i}+=1; 
}  

foreach my $i (@F) 
{
  
  if ($X{$i}==1)
  {
    printf "%s ","$i";
  } 
}
print "\n";
%X= ();

close (FH);

---------- Post updated at 08:09 AM ---------- Previous update was at 06:36 AM ----------

Hi,
it works with small modification. Thanks

Code:
#!/usr/bin/perl -w
use strict;

my %X = ();
open (FH, '<', "in.txt") or die $!;

my @F = <FH>;
my @temp;

foreach my $line (@F) 
{ 
  chomp $line;
  @temp = split " ", $line;  
  for my $i ( 0 .. $#temp)
  {
    $X{$temp[0]}{$temp[$i]}++;    
  }
} 

foreach my $key(keys %X)
{ 
  foreach my $subkey(keys %{$X{$key}})
  {
     print "$subkey " if $X{$key}{$subkey} == 1;
  }
  print "\n";
}

close (FH);

Last edited by askari; 03-12-2014 at 09:28 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Match keyword on string and substitute under vi

Hi guys, with sed when I need to make a substitution inside a line containing a specific keyword, I usually use: sed '/keyword/ s/cat/dog/g' This will substitute "cat" with "dog" on those lines containing "keyword". Now I want to use this inside vi, for several reason that I cannot... (2 Replies)
Discussion started by: lycaon
2 Replies

2. Shell Programming and Scripting

How to remove duplicate sentence/string in perl?

Hi, I have two strings like this in an array: For example: @a=("Brain aging is associated with a progressive imbalance between intracellular concentration of Reactive Oxygen Species","Brain aging is associated with a progressive imbalance between intracellular concentration of Reactive... (9 Replies)
Discussion started by: vanitham
9 Replies

3. Shell Programming and Scripting

Remove duplicate files based on text string?

Hi I have been struggling with a script for removing duplicate messages from a shared mailbox. I would like to search for duplicate messages based on the “Message-ID” string within the messages files. I have managed to find the duplicate “Message-ID” strings and (if I would like) delete... (1 Reply)
Discussion started by: spangberg
1 Replies

4. Shell Programming and Scripting

filtering out duplicate substrings, regex string from a string

My input contains a single word lines. From each line data.txt prjtestBlaBlatestBlaBla prjthisBlaBlathisBlaBla prjthatBlaBladpthatBlaBla prjgoodBlaBladpgoodBlaBla prjgood1BlaBla123dpgood1BlaBla123 Desired output --> data_out.txt prjtestBlaBla prjthisBlaBla... (8 Replies)
Discussion started by: kchinnam
8 Replies

5. Shell Programming and Scripting

remove characters from string based on occurrence of a string

Hello Folks.. I need your help .. here the example of my problem..i know its easy..i don't all the commands in unix to do this especiallly sed...here my string.. dwc2_dfg_ajja_dfhhj_vw_dec2_dfgh_dwq desired output is.. dwc2_dfg_ajja_dfhhj it's a simple task with tail... (5 Replies)
Discussion started by: victor369
5 Replies

6. Shell Programming and Scripting

Remove duplicate chars and sort string [SED]

Hi, INPUT: DCBADD OUTPUT: ABCD The SED script should alphabetically sort the chars in the string and remove the duplicate chars. (5 Replies)
Discussion started by: jds93
5 Replies

7. Shell Programming and Scripting

Remove lines between the start string and end string including start and end string Python

Hi, I am trying to remove lines once a string is found till another string is found including the start string and end string. I want to basically grab all the lines starting with color (closing bracket). PS: The line after the closing bracket for color could be anything (currently 'more').... (1 Reply)
Discussion started by: Dabheeruz
1 Replies

8. Shell Programming and Scripting

Remove multiple lines from a particular string to particular string

Hi, I have a file containing the DDLs of tables in a schema. From that I need to remove all the lines from a starting string till a specific string. Here is an example. File1.txt ------------- CREATE TABLE "SCHEMA1"."LKP11_TBL_USERS" ( "ID" NUMBER(8,0) NOT NULL ENABLE, "USER_ID"... (3 Replies)
Discussion started by: satyaatcgi
3 Replies

9. Shell Programming and Scripting

Remove string perl with first or last word is in a list

Hello, I try to delete all strings if their first or last word is one of this list of words : "the", "i", "in", "there", "this", "with", "on", "we", "that", "of" For example if i have this string in an input file "with me" this string will be removed, Example: input "the european... (2 Replies)
Discussion started by: cyrine
2 Replies

10. Shell Programming and Scripting

Remove duplicate consecutive lines with specific string

Hello, I'm trying to remove the duplicate consecutive lines with specific string "WARNING". File.txt abc; WARNING 2345 WARNING 2345 WARNING 2345 WARNING 2345 WARNING 2345 bcd; abc; 123 123 123 WARNING 1234 WARNING 2345 WARNING 2345 efgh; (6 Replies)
Discussion started by: Mannu2525
6 Replies

LEARN ABOUT CENTOS

test::script

Test::Script(3) 					User Contributed Perl Documentation					   Test::Script(3)

NAME

       Test::Script - Basic cross-platform tests for scripts

DESCRIPTION

       The intent of this module is to provide a series of basic tests for 80% of the testing you will need to do for scripts in the script (or
       bin as is also commonly used) paths of your Perl distribution.

       Further, it aims to provide this functionality with perfect platform-compatibility, and in a way that is as unobtrusive as possible.

       That is, if the program works on a platform, then Test::Script should always work on that platform as well. Anything less than 100% is
       considered unacceptable.

       In doing so, it is hoped that Test::Script can become a module that you can safely make a dependency of all your modules, without risking
       that your module won't on some platform because of the dependency.

       Where a clash exists between wanting more functionality and maintaining platform safety, this module will err on the side of platform
       safety.

FUNCTIONS

   script_compiles
	   script_compiles( 'script/foo.pl', 'Main script compiles' );

       The "script_compiles" test calls the script with "perl -c script.pl", and checks that it returns without error.

       The path it should be passed is a relative unix-format script name. This will be localised when running "perl -c" and if the test fails the
       local name used will be shown in the diagnostic output.

       Note also that the test will be run with the same perl interpreter that is running the test script (and not with the default system perl).
       This will also be shown in the diagnostic output on failure.

   script_runs
	   script_runs( 'script/foo.pl', 'Main script runs' );

       The "script_runs" test executes the script with "perl script.pl" and checks that it returns success.

       The path it should be passed is a relative unix-format script name. This will be localised when running "perl -c" and if the test fails the
       local name used will be shown in the diagnostic output.

       The test will be run with the same perl interpreter that is running the test script (and not with the default system perl). This will also
       be shown in the diagnostic output on failure.

SUPPORT

       All bugs should be filed via the bug tracker at

       <http://rt.cpan.org/NoAuth/ReportBug.html?Queue=Test-Script>

       For other issues, or commercial enhancement and support, contact the author.

AUTHOR

       Adam Kennedy <adamk@cpan.org>

SEE ALSO

       prove, <http://ali.as/>

COPYRIGHT

       Copyright 2006 - 2009 Adam Kennedy.

       This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

       The full text of the license can be found in the LICENSE file included with this module.

perl v5.16.3							    2009-11-24							   Test::Script(3)
All times are GMT -4. The time now is 05:56 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy