Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Remove not only the duplicate string but also the keyword of the string in Perl
Top Forums Shell Programming and Scripting Remove not only the duplicate string but also the keyword of the string in Perl Post 302892457 by askari on Wednesday 12th of March 2014 08:09:52 PM
Old 03-12-2014
Hi disedorgue,

Thanks for the script, it works for one-liners but why the script is not work when I try to modify the script as below.
Code:
#!/usr/bin/perl -w
use strict;

my $file = "in.txt";
my %X = ();

open (FH, '<', $file) or die $!;

my @F = <FH>;

foreach my $i (@F) 
{ 
  $X{$i}+=1; 
}  

foreach my $i (@F) 
{
  
  if ($X{$i}==1)
  {
    printf "%s ","$i";
  } 
}
print "\n";
%X= ();

close (FH);

---------- Post updated at 08:09 AM ---------- Previous update was at 06:36 AM ----------

Hi,
it works with small modification. Thanks

Code:
#!/usr/bin/perl -w
use strict;

my %X = ();
open (FH, '<', "in.txt") or die $!;

my @F = <FH>;
my @temp;

foreach my $line (@F) 
{ 
  chomp $line;
  @temp = split " ", $line;  
  for my $i ( 0 .. $#temp)
  {
    $X{$temp[0]}{$temp[$i]}++;    
  }
} 

foreach my $key(keys %X)
{ 
  foreach my $subkey(keys %{$X{$key}})
  {
     print "$subkey " if $X{$key}{$subkey} == 1;
  }
  print "\n";
}

close (FH);

Last edited by askari; 03-12-2014 at 09:28 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Match keyword on string and substitute under vi

Hi guys, with sed when I need to make a substitution inside a line containing a specific keyword, I usually use: sed '/keyword/ s/cat/dog/g' This will substitute "cat" with "dog" on those lines containing "keyword". Now I want to use this inside vi, for several reason that I cannot... (2 Replies)
Discussion started by: lycaon
2 Replies

2. Shell Programming and Scripting

How to remove duplicate sentence/string in perl?

Hi, I have two strings like this in an array: For example: @a=("Brain aging is associated with a progressive imbalance between intracellular concentration of Reactive Oxygen Species","Brain aging is associated with a progressive imbalance between intracellular concentration of Reactive... (9 Replies)
Discussion started by: vanitham
9 Replies

3. Shell Programming and Scripting

Remove duplicate files based on text string?

Hi I have been struggling with a script for removing duplicate messages from a shared mailbox. I would like to search for duplicate messages based on the “Message-ID” string within the messages files. I have managed to find the duplicate “Message-ID” strings and (if I would like) delete... (1 Reply)
Discussion started by: spangberg
1 Replies

4. Shell Programming and Scripting

filtering out duplicate substrings, regex string from a string

My input contains a single word lines. From each line data.txt prjtestBlaBlatestBlaBla prjthisBlaBlathisBlaBla prjthatBlaBladpthatBlaBla prjgoodBlaBladpgoodBlaBla prjgood1BlaBla123dpgood1BlaBla123 Desired output --> data_out.txt prjtestBlaBla prjthisBlaBla... (8 Replies)
Discussion started by: kchinnam
8 Replies

5. Shell Programming and Scripting

remove characters from string based on occurrence of a string

Hello Folks.. I need your help .. here the example of my problem..i know its easy..i don't all the commands in unix to do this especiallly sed...here my string.. dwc2_dfg_ajja_dfhhj_vw_dec2_dfgh_dwq desired output is.. dwc2_dfg_ajja_dfhhj it's a simple task with tail... (5 Replies)
Discussion started by: victor369
5 Replies

6. Shell Programming and Scripting

Remove duplicate chars and sort string [SED]

Hi, INPUT: DCBADD OUTPUT: ABCD The SED script should alphabetically sort the chars in the string and remove the duplicate chars. (5 Replies)
Discussion started by: jds93
5 Replies

7. Shell Programming and Scripting

Remove lines between the start string and end string including start and end string Python

Hi, I am trying to remove lines once a string is found till another string is found including the start string and end string. I want to basically grab all the lines starting with color (closing bracket). PS: The line after the closing bracket for color could be anything (currently 'more').... (1 Reply)
Discussion started by: Dabheeruz
1 Replies

8. Shell Programming and Scripting

Remove multiple lines from a particular string to particular string

Hi, I have a file containing the DDLs of tables in a schema. From that I need to remove all the lines from a starting string till a specific string. Here is an example. File1.txt ------------- CREATE TABLE "SCHEMA1"."LKP11_TBL_USERS" ( "ID" NUMBER(8,0) NOT NULL ENABLE, "USER_ID"... (3 Replies)
Discussion started by: satyaatcgi
3 Replies

9. Shell Programming and Scripting

Remove string perl with first or last word is in a list

Hello, I try to delete all strings if their first or last word is one of this list of words : "the", "i", "in", "there", "this", "with", "on", "we", "that", "of" For example if i have this string in an input file "with me" this string will be removed, Example: input "the european... (2 Replies)
Discussion started by: cyrine
2 Replies

10. Shell Programming and Scripting

Remove duplicate consecutive lines with specific string

Hello, I'm trying to remove the duplicate consecutive lines with specific string "WARNING". File.txt abc; WARNING 2345 WARNING 2345 WARNING 2345 WARNING 2345 WARNING 2345 bcd; abc; 123 123 123 WARNING 1234 WARNING 2345 WARNING 2345 efgh; (6 Replies)
Discussion started by: Mannu2525
6 Replies

LEARN ABOUT MINIX

firefox

FIREFOX(1)							Linux User's Manual							FIREFOX(1)

NAME

       firefox - a Web browser for X11 derived from the Mozilla browser

SYNOPSIS

       firefox [OPTIONS] [URL]

DESCRIPTION

       Mozilla Firefox is an open-source web browser, designed for standards compliance, performance and portability.

USAGE

       firefox is a simple shell script that will set up the environment for the actual executable.

OPTIONS

       A summary of the options supported by firefox is included below.

   GTK options
       --gdk-debug=FLAGS Gdk debugging flags to set

       --gdk-no-debug=FLAGS
	      Gdk debugging flags to unset

       --gtk-debug=FLAGS
	      Gtk+ debugging flags to set

       --gtk-no-debug=FLAGS
	      Gtk+ debugging flags to unset

       --gtk-module=MODULE
	      Load an additional Gtk module

   X11 options
       --display=DISPLAY
	      X display to use

       --sync Make X calls synchronous

       --no-xshm
	      Don't use X shared memory extension

       --xim-preedit=STYLE

       --xim-status=STYLE

       --g-fatal-warnings
	      Make all warnings fatal

   Firefox options
       -h, -help
	      Show summary of options.

       -height value
	      Set height of startup window to value.

       -width value
	      Set width of startup window to value.

       -v, -version
	      Print /usr/bin/firefox-bin version.

       -CreateProfile profile
	      Create profile.

       -P profile
	      Start with profile.

       -ProfileManager
	      Start with profile manager.

       -UILocale lang-region
	      Start with lang-region resources.

       -contentLocale lang-region
	      Start with lang-region resources.

       -remote command
	      Execute command in an already running Firefox process.  For more info, see: http://www.mozilla.org/unix/remote.html

       -no-remote
	      Don't try to control an already running instance.

       -jsconsole
	      Start with Javascript Console

       -chrome url
	      Load the specified chrome.

       -new-window url
	      Open URL in a new window if Firefox is already running.

       -new-tab url
	      Open URL in a new tab if Firefox is already running.

       -preferences
	      Open Firefox preferences menu.

       -safe-mode
	      Disables extensions and themes for this session.

       FILES  /usr/bin/firefox - shell script wrapping firefox
	      /usr/lib/firefox/firefox - firefox executable

VERSION

       3.0

BUGS

       To report a bug, please visit http://bugzilla.mozilla.org/

SEE ALSO

       mozilla(1)

AUTHORS

       The Mozilla Organization
	      http://www.mozilla.org/about.html

firefox 							 January 04, 2006							FIREFOX(1)
All times are GMT -4. The time now is 05:57 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy