Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Remove not only the duplicate string but also the keyword of the string in Perl
Top Forums Shell Programming and Scripting Remove not only the duplicate string but also the keyword of the string in Perl Post 302892457 by askari on Wednesday 12th of March 2014 08:09:52 PM
Old 03-12-2014
Hi disedorgue,

Thanks for the script, it works for one-liners but why the script is not work when I try to modify the script as below.
Code:
#!/usr/bin/perl -w
use strict;

my $file = "in.txt";
my %X = ();

open (FH, '<', $file) or die $!;

my @F = <FH>;

foreach my $i (@F) 
{ 
  $X{$i}+=1; 
}  

foreach my $i (@F) 
{
  
  if ($X{$i}==1)
  {
    printf "%s ","$i";
  } 
}
print "\n";
%X= ();

close (FH);

---------- Post updated at 08:09 AM ---------- Previous update was at 06:36 AM ----------

Hi,
it works with small modification. Thanks

Code:
#!/usr/bin/perl -w
use strict;

my %X = ();
open (FH, '<', "in.txt") or die $!;

my @F = <FH>;
my @temp;

foreach my $line (@F) 
{ 
  chomp $line;
  @temp = split " ", $line;  
  for my $i ( 0 .. $#temp)
  {
    $X{$temp[0]}{$temp[$i]}++;    
  }
} 

foreach my $key(keys %X)
{ 
  foreach my $subkey(keys %{$X{$key}})
  {
     print "$subkey " if $X{$key}{$subkey} == 1;
  }
  print "\n";
}

close (FH);

Last edited by askari; 03-12-2014 at 09:28 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Match keyword on string and substitute under vi

Hi guys, with sed when I need to make a substitution inside a line containing a specific keyword, I usually use: sed '/keyword/ s/cat/dog/g' This will substitute "cat" with "dog" on those lines containing "keyword". Now I want to use this inside vi, for several reason that I cannot... (2 Replies)
Discussion started by: lycaon
2 Replies

2. Shell Programming and Scripting

How to remove duplicate sentence/string in perl?

Hi, I have two strings like this in an array: For example: @a=("Brain aging is associated with a progressive imbalance between intracellular concentration of Reactive Oxygen Species","Brain aging is associated with a progressive imbalance between intracellular concentration of Reactive... (9 Replies)
Discussion started by: vanitham
9 Replies

3. Shell Programming and Scripting

Remove duplicate files based on text string?

Hi I have been struggling with a script for removing duplicate messages from a shared mailbox. I would like to search for duplicate messages based on the “Message-ID” string within the messages files. I have managed to find the duplicate “Message-ID” strings and (if I would like) delete... (1 Reply)
Discussion started by: spangberg
1 Replies

4. Shell Programming and Scripting

filtering out duplicate substrings, regex string from a string

My input contains a single word lines. From each line data.txt prjtestBlaBlatestBlaBla prjthisBlaBlathisBlaBla prjthatBlaBladpthatBlaBla prjgoodBlaBladpgoodBlaBla prjgood1BlaBla123dpgood1BlaBla123 Desired output --> data_out.txt prjtestBlaBla prjthisBlaBla... (8 Replies)
Discussion started by: kchinnam
8 Replies

5. Shell Programming and Scripting

remove characters from string based on occurrence of a string

Hello Folks.. I need your help .. here the example of my problem..i know its easy..i don't all the commands in unix to do this especiallly sed...here my string.. dwc2_dfg_ajja_dfhhj_vw_dec2_dfgh_dwq desired output is.. dwc2_dfg_ajja_dfhhj it's a simple task with tail... (5 Replies)
Discussion started by: victor369
5 Replies

6. Shell Programming and Scripting

Remove duplicate chars and sort string [SED]

Hi, INPUT: DCBADD OUTPUT: ABCD The SED script should alphabetically sort the chars in the string and remove the duplicate chars. (5 Replies)
Discussion started by: jds93
5 Replies

7. Shell Programming and Scripting

Remove lines between the start string and end string including start and end string Python

Hi, I am trying to remove lines once a string is found till another string is found including the start string and end string. I want to basically grab all the lines starting with color (closing bracket). PS: The line after the closing bracket for color could be anything (currently 'more').... (1 Reply)
Discussion started by: Dabheeruz
1 Replies

8. Shell Programming and Scripting

Remove multiple lines from a particular string to particular string

Hi, I have a file containing the DDLs of tables in a schema. From that I need to remove all the lines from a starting string till a specific string. Here is an example. File1.txt ------------- CREATE TABLE "SCHEMA1"."LKP11_TBL_USERS" ( "ID" NUMBER(8,0) NOT NULL ENABLE, "USER_ID"... (3 Replies)
Discussion started by: satyaatcgi
3 Replies

9. Shell Programming and Scripting

Remove string perl with first or last word is in a list

Hello, I try to delete all strings if their first or last word is one of this list of words : "the", "i", "in", "there", "this", "with", "on", "we", "that", "of" For example if i have this string in an input file "with me" this string will be removed, Example: input "the european... (2 Replies)
Discussion started by: cyrine
2 Replies

10. Shell Programming and Scripting

Remove duplicate consecutive lines with specific string

Hello, I'm trying to remove the duplicate consecutive lines with specific string "WARNING". File.txt abc; WARNING 2345 WARNING 2345 WARNING 2345 WARNING 2345 WARNING 2345 bcd; abc; 123 123 123 WARNING 1234 WARNING 2345 WARNING 2345 efgh; (6 Replies)
Discussion started by: Mannu2525
6 Replies

LEARN ABOUT DEBIAN

dpkg-www

DPKG-WWW(1)						      General Commands Manual						       DPKG-WWW(1)

NAME

       dpkg-www - program to remotely open a WWW Debian package browser

SYNOPSIS

       dpkg-www [-s|--stdout] [-h|--host host] [query]

DESCRIPTION

       dpkg-www is used to remotely control a WEB browser and open a dpkg URL on the local host from an interactive shell or script.

       If  the	command  is invoked while running under X-window the script will try to find an installed X browser to open the specified URL.	If
       not running under X it will try to use a text browser instead.

       If Netscape is found and a Netscape instance is already running it will be asked to open the dpkg URL on localhost with the optional  query
       supplied on the command line.  If there is no browser running, it will start automatically a new one.

       The  functionality  provided  by this program is identical to running a web browser with the -remote openURL(http://localhost/cgi-bin/dpkg)
       argument or opening the same URL from within the browser.

       dpkg-www-installer is an helper application which can configured in the WWW browser for	web  installation.  It	should	never  be  invoked
       directly by the user.

OPTIONS

       -s, --stdout
	      Redirect output to stdout. Requires one of the text browsers (lynx, lynx-ssl or links) installed.

       -h, --host host
	      Send the query to a remote host, where dpkg-www must be installed.

       query  Specifies  an  optional  package name, an absolute pathname or a query argument which is passed to the dpkg cgi-bin. See dpkg-www(8)
	      for more information about the use of the cgi.

FILES

       /etc/dpkg-www.conf

       ~/.dpkg-www
	      Configuration files for dpkg-www. It is not necessary for these files to exist, there are sensible defaults for everything, but  you
	      can specify your preferred www browser with the DPKG_WWW_BROWSER variable, for example: DPKG_WWW_BROWSER=mozilla

EXAMPLES

       dpkg-www
	      This would open a dpkg URL on localhost listing all the installed packages.

       dpkg-www bash
	      This would open a dpkg URL asking info on the bash package.

       dpkg-www -h pisolo bash
	      This would open a dpkg URL asking info on the bash package on host pisolo.

       dpkg-www 'dpkg*'
	      This would open a dpkg URL listing all packages matching dpkg*.

       dpkg-www /bin/bash
	      This would open a dpkg URL asking info on the package(s) owning the file /bin/bash .

       dpkg-www depends=svgalib
	      This would open a dpkg URL listing all packages depending on svgalib.

       dpkg-www --stdout depends=awk | grep ^ii
	      This would list on stdout all packages depending on awk and grep all lines of installed packages.

SEE ALSO

       dpkg(8), dpkg-www(8)

AUTHOR

       Massimo Dal Zotto <dz@debian.org>.
       Bugs should be reported via the normal Debian bug reporting system.

LICENCE

       dpkg-www is licensed under the GNU General Public License version 2.

								 September 1, 2004						       DPKG-WWW(1)
All times are GMT -4. The time now is 08:14 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy