Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Help removing lines with duplicated columns
Top Forums Shell Programming and Scripting Help removing lines with duplicated columns Post 302196166 by yahyaaa on Friday 16th of May 2008 10:34:55 PM
Old 05-16-2008
Your help again.
I went back and checked the problem stated here https://www.unix.com/shell-programmin...#post302196106 .
, believe me it's different....

I have 3 matched fields out of 4, NOT one out of 4.
Here is another example.

SSSSS DDDDDDD 10:10:00 15:22:22
XXXXX AAAAAAA 00:00:11 00:02:11
XXXXX AAAAAAA 00:00:11 06:02:10
EEEEEE VVVVVVV 04:12:00 01:10:02
EEEEEE VVVVVVV 04:12:00 05:12:00
SSSSS DDDDDDD 10:10:00 13:23:21
EEEEEE FFFFFFFF 20:20:20 24:00:00

I want the output to be like

XXXXX AAAAAAA 00:00:11 06:02:10
EEEEEE VVVVVVV 04:12:00 05:12:00
SSSSS DDDDDDD 10:10:00 13:23:21
EEEEEE FFFFFFFF 20:20:20 24:00:00

If 2 lines are matched by 3 fields, I want to delete the first.

Thanks...
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

remove duplicated lines without sort

Hi Just wondering whether or not I can remove duplicated lines without sort For example, I use the command who, which shows users who are logging on. In some cases, it shows duplicated lines of users who are logging on more than one terminal. Normally, I would do who | cut -d" " -f1 |... (6 Replies)
Discussion started by: lalelle
6 Replies

2. UNIX for Dummies Questions & Answers

Removing lines that are (same in content) based on columns

I have a file which looks like AA BB CC DD EE FF GG HH KK AA BB GG HH KK FF CC DD EE AA BB CC DD EE UU VV XX ZZ AA BB VV XX ZZ UU CC DD EE .... I want the script to give me only one line based on duplicate contents: AA BB CC DD EE FF GG HH KK AA BB CC DD EE UU VV XX ZZ (7 Replies)
Discussion started by: adsforall
7 Replies

3. Shell Programming and Scripting

remove duplicated columns

hi all, i have a file contain multicolumns, this file is sorted by col2 and col3. i want to remove the duplicated columns if the col2 and col3 are the same in another line. example fileA AA BB CC DD CC XX CC DD BB CC ZZ FF DD FF HH HH the output is AA BB CC DD BB CC ZZ FF... (6 Replies)
Discussion started by: kamel.seg
6 Replies

4. Shell Programming and Scripting

using sed to get rid of duplicated columns...

I can not figure out this one, so I turn to unix.com for help, I have a file, in which there are some lines containing continuously duplicate columns, like the following adb abc abc asd adfj 123 123 123 345 234 444 444 444 444 444 23 and the output I want is adb abc asd adfj 123 345... (5 Replies)
Discussion started by: fedora
5 Replies

5. Shell Programming and Scripting

finding duplicates in columns and removing lines

I am trying to figure out how to scan a file like so: 1 ralphs office","555-555-5555","ralph@mail.com","www.ralph.com 2 margies office","555-555-5555","ralph@mail.com","www.ralph.com 3 kims office","555-555-5555","kims@mail.com","www.ralph.com 4 tims... (17 Replies)
Discussion started by: totus
17 Replies

6. UNIX for Dummies Questions & Answers

Removing duplicated lines??

Hi Guys.. I have a problem for some reason my database has copied everything 4 times. My Database looks like this: >BAC233456 rhjieaheiohjteo tjtjrj6jkk6k6 j54ju54jh54jh >ANI124365 afrhtjykulilil htrjykuk rtkjryky ukrykyrk >BAC233456 rhjieaheiohjteo tjtjrj6jkk6k6 j54ju54jh54jh... (6 Replies)
Discussion started by: Iifa
6 Replies

7. UNIX for Dummies Questions & Answers

Find duplicated values in two columns out of three

hi! could u help in the following? I have the data (long list!) that looks like (three coumns white space separated): rs3094315 0.0665173 742429 rs12562034 0.0738998 758311 rs3934834 0.396449 995669 rs9442372 0.402693 1008567 rs3737728 0.406271 1011278 rs6687776 0.435429 1020428 rs9651273... (4 Replies)
Discussion started by: kush
4 Replies

8. Shell Programming and Scripting

How to remove duplicated lines?

Hi, if i have a file like this: Query=1 a a b c c c d Query=2 b b b c c e . . . (7 Replies)
Discussion started by: the_simpsons
7 Replies

9. Shell Programming and Scripting

Removing duplicated first field rows

Hello, I am trying to eliminate rows where the first field is duplicated, leaving the row where the last field is "NET". Data file: 345234|22.34|LST 546543|55.33|LST 793929|98.23|LST 793929|64.69|NET 149593|49.22|LST Desired output: 345234|22.34|LST 546543|55.33|LST... (2 Replies)
Discussion started by: palex
2 Replies

10. Shell Programming and Scripting

Removing carriage returns from multiple lines in multiple files of different number of columns

Hello Gurus, I have a multiple pipe separated files which have records going over multiple Lines. End of line separator is \n and records going over multiple lines have <CR> as separator. below is example from one file. 1|ABC DEF|100|10 2|PQ RS T|200|20 3| UVWXYZ|300|30 4| GHIJKL|400|40... (7 Replies)
Discussion started by: dJHa
7 Replies

LEARN ABOUT CENTOS

datetime::locale::pa_arab

DateTime::Locale::pa_Arab(3)				User Contributed Perl Documentation			      DateTime::Locale::pa_Arab(3)

NAME

       DateTime::Locale::pa_Arab

SYNOPSIS

	 use DateTime;

	 my $dt = DateTime->now( locale => 'pa_Arab' );
	 print $dt->month_name();

DESCRIPTION

       This is the DateTime locale package for Punjabi Arabic.

DATA

       This locale inherits from the DateTime::Locale::pa locale.

       It contains the following data.

   Days
       Wide (format)

	 XXX
	 XXXX
	 XXXX
	 XXXXXX
	 XXXX
	 XXXX
	 XXXXX

       Abbreviated (format)

	 XXX
	 XXXX
	 XXXX
	 XXXXXX
	 XXXX
	 XXXX
	 XXXXX

       Narrow (format)

	 XX
	 XX
	 XXX
	 XX
	 XXXX
	 XX
	 X

       Wide (stand-alone)

	 XXX
	 XXXX
	 XXXX
	 XXXXXX
	 XXXX
	 XXXX
	 XXXXX

       Abbreviated (stand-alone)

	 XXX
	 XXXX
	 XXXX
	 XXXXXX
	 XXXX
	 XXXX
	 XXXXX

       Narrow (stand-alone)

	 XX
	 XX
	 XXX
	 XX
	 XXXX
	 XX
	 X

   Months
       Wide (format)

	 XXXXX
	 XXXXX
	 XXXX
	 XXXXX
	 XX
	 XXX
	 XXXXXX
	 XXXX
	 XXXXX
	 XXXXXX
	 XXXXX
	 XXXXX

       Abbreviated (format)

	 XXXXX
	 XXXXX
	 XXXX
	 XXXXX
	 XX
	 XXX
	 XXXXXX
	 XXXX
	 XXXXX
	 XXXXXX
	 XXXXX
	 XXXXX

       Narrow (format)

	 X
	 X
	 XX
	 X
	 X
	 XX
	 XX
	 X
	 X
	 X
	 X
	 X

       Wide (stand-alone)

	 XXXXX
	 XXXXX
	 XXXX
	 XXXXX
	 XX
	 XXX
	 XXXXXX
	 XXXX
	 XXXXX
	 XXXXXX
	 XXXXX
	 XXXXX

       Abbreviated (stand-alone)

	 1
	 2
	 3
	 4
	 5
	 6
	 7
	 8
	 9
	 10
	 11
	 12

       Narrow (stand-alone)

	 X
	 X
	 XX
	 X
	 X
	 XX
	 XX
	 X
	 X
	 X
	 X
	 X

   Quarters
       Wide (format)

	 XXXXXX XXXXX
	 XXXXXX XXXX
	 XXXXXX XXXX
	 XXXXXX XXXXX

       Abbreviated (format)

	 XXXXXX XXXXX
	 XXXXXX XXXX
	 XXXXXX XXXX
	 XXXXXX XXXXX

       Narrow (format)

	 1
	 2
	 3
	 4

       Wide (stand-alone)

	 XXXXXX XXXXX
	 XXXXXX XXXX
	 XXXXXX XXXX
	 XXXXXX XXXXX

       Abbreviated (stand-alone)

	 XXXXXX XXXXX
	 XXXXXX XXXX
	 XXXXXX XXXX
	 XXXXXX XXXXX

       Narrow (stand-alone)

	 1
	 2
	 3
	 4

   Eras
       Wide

	 XXXXXXXX
	 XX

       Abbreviated

	 XXXXXXXX
	 XX

       Narrow

	 XXXXXXXX
	 XX

   Date Formats
       Full

	  2008-02-05T18:30:30 = XXXX, 05 XXXXX 2008
	  1995-12-22T09:05:02 = XXXX, 22 XXXXX 1995
	 -0010-09-15T04:44:23 = XXXX, 15 XXXXX -10

       Long

	  2008-02-05T18:30:30 = 5 XXXXX 2008
	  1995-12-22T09:05:02 = 22 XXXXX 1995
	 -0010-09-15T04:44:23 = 15 XXXXX -10

       Medium

	  2008-02-05T18:30:30 = 5 XXXXX 2008
	  1995-12-22T09:05:02 = 22 XXXXX 1995
	 -0010-09-15T04:44:23 = 15 XXXXX -10

       Short

	  2008-02-05T18:30:30 = 05/02/2008
	  1995-12-22T09:05:02 = 22/12/1995
	 -0010-09-15T04:44:23 = 15/09/-010

       Default

	  2008-02-05T18:30:30 = 5 XXXXX 2008
	  1995-12-22T09:05:02 = 22 XXXXX 1995
	 -0010-09-15T04:44:23 = 15 XXXXX -10

   Time Formats
       Full

	  2008-02-05T18:30:30 = 6:30:30 XXXX UTC
	  1995-12-22T09:05:02 = 9:05:02 XXXXX UTC
	 -0010-09-15T04:44:23 = 4:44:23 XXXXX UTC

       Long

	  2008-02-05T18:30:30 = 6:30:30 XXXX UTC
	  1995-12-22T09:05:02 = 9:05:02 XXXXX UTC
	 -0010-09-15T04:44:23 = 4:44:23 XXXXX UTC

       Medium

	  2008-02-05T18:30:30 = 6:30:30 XXXX
	  1995-12-22T09:05:02 = 9:05:02 XXXXX
	 -0010-09-15T04:44:23 = 4:44:23 XXXXX

       Short

	  2008-02-05T18:30:30 = 6:30 XXXX
	  1995-12-22T09:05:02 = 9:05 XXXXX
	 -0010-09-15T04:44:23 = 4:44 XXXXX

       Default

	  2008-02-05T18:30:30 = 6:30:30 XXXX
	  1995-12-22T09:05:02 = 9:05:02 XXXXX
	 -0010-09-15T04:44:23 = 4:44:23 XXXXX

   Datetime Formats
       Full

	  2008-02-05T18:30:30 = XXXX, 05 XXXXX 2008 6:30:30 XXXX UTC
	  1995-12-22T09:05:02 = XXXX, 22 XXXXX 1995 9:05:02 XXXXX UTC
	 -0010-09-15T04:44:23 = XXXX, 15 XXXXX -10 4:44:23 XXXXX UTC

       Long

	  2008-02-05T18:30:30 = 5 XXXXX 2008 6:30:30 XXXX UTC
	  1995-12-22T09:05:02 = 22 XXXXX 1995 9:05:02 XXXXX UTC
	 -0010-09-15T04:44:23 = 15 XXXXX -10 4:44:23 XXXXX UTC

       Medium

	  2008-02-05T18:30:30 = 5 XXXXX 2008 6:30:30 XXXX
	  1995-12-22T09:05:02 = 22 XXXXX 1995 9:05:02 XXXXX
	 -0010-09-15T04:44:23 = 15 XXXXX -10 4:44:23 XXXXX

       Short

	  2008-02-05T18:30:30 = 05/02/2008 6:30 XXXX
	  1995-12-22T09:05:02 = 22/12/1995 9:05 XXXXX
	 -0010-09-15T04:44:23 = 15/09/-010 4:44 XXXXX

       Default

	  2008-02-05T18:30:30 = 5 XXXXX 2008 6:30:30 XXXX
	  1995-12-22T09:05:02 = 22 XXXXX 1995 9:05:02 XXXXX
	 -0010-09-15T04:44:23 = 15 XXXXX -10 4:44:23 XXXXX

   Available Formats
       d (d)

	  2008-02-05T18:30:30 = 5
	  1995-12-22T09:05:02 = 22
	 -0010-09-15T04:44:23 = 15

       EEEd (d EEE)

	  2008-02-05T18:30:30 = 5 XXXX
	  1995-12-22T09:05:02 = 22 XXXX
	 -0010-09-15T04:44:23 = 15 XXXX

       HHmmss (HH:mm:ss)

	  2008-02-05T18:30:30 = 18:30:30
	  1995-12-22T09:05:02 = 09:05:02
	 -0010-09-15T04:44:23 = 04:44:23

       Hm (H:mm)

	  2008-02-05T18:30:30 = 18:30
	  1995-12-22T09:05:02 = 9:05
	 -0010-09-15T04:44:23 = 4:44

       hm (h:mm a)

	  2008-02-05T18:30:30 = 6:30 XXXX
	  1995-12-22T09:05:02 = 9:05 XXXXX
	 -0010-09-15T04:44:23 = 4:44 XXXXX

       Hms (H:mm:ss)

	  2008-02-05T18:30:30 = 18:30:30
	  1995-12-22T09:05:02 = 9:05:02
	 -0010-09-15T04:44:23 = 4:44:23

       hms (h:mm:ss a)

	  2008-02-05T18:30:30 = 6:30:30 XXXX
	  1995-12-22T09:05:02 = 9:05:02 XXXXX
	 -0010-09-15T04:44:23 = 4:44:23 XXXXX

       M (L)

	  2008-02-05T18:30:30 = 2
	  1995-12-22T09:05:02 = 12
	 -0010-09-15T04:44:23 = 9

       Md (d/M)

	  2008-02-05T18:30:30 = 5/2
	  1995-12-22T09:05:02 = 22/12
	 -0010-09-15T04:44:23 = 15/9

       MEd (E, M-d)

	  2008-02-05T18:30:30 = XXXX, 2-5
	  1995-12-22T09:05:02 = XXXX, 12-22
	 -0010-09-15T04:44:23 = XXXX, 9-15

       MMM (LLL)

	  2008-02-05T18:30:30 = 2
	  1995-12-22T09:05:02 = 12
	 -0010-09-15T04:44:23 = 9

       MMMd (MMM d)

	  2008-02-05T18:30:30 = XXXXX 5
	  1995-12-22T09:05:02 = XXXXX 22
	 -0010-09-15T04:44:23 = XXXXX 15

       MMMEd (E MMM d)

	  2008-02-05T18:30:30 = XXXX XXXXX 5
	  1995-12-22T09:05:02 = XXXX XXXXX 22
	 -0010-09-15T04:44:23 = XXXX XXXXX 15

       MMMMd (MMMM d)

	  2008-02-05T18:30:30 = XXXXX 5
	  1995-12-22T09:05:02 = XXXXX 22
	 -0010-09-15T04:44:23 = XXXXX 15

       MMMMEd (E MMMM d)

	  2008-02-05T18:30:30 = XXXX XXXXX 5
	  1995-12-22T09:05:02 = XXXX XXXXX 22
	 -0010-09-15T04:44:23 = XXXX XXXXX 15

       mmss (mm:ss)

	  2008-02-05T18:30:30 = 30:30
	  1995-12-22T09:05:02 = 05:02
	 -0010-09-15T04:44:23 = 44:23

       ms (mm:ss)

	  2008-02-05T18:30:30 = 30:30
	  1995-12-22T09:05:02 = 05:02
	 -0010-09-15T04:44:23 = 44:23

       y (y)

	  2008-02-05T18:30:30 = 2008
	  1995-12-22T09:05:02 = 1995
	 -0010-09-15T04:44:23 = -10

       yM (y-M)

	  2008-02-05T18:30:30 = 2008-2
	  1995-12-22T09:05:02 = 1995-12
	 -0010-09-15T04:44:23 = -10-9

       yMEd (EEE, y-M-d)

	  2008-02-05T18:30:30 = XXXX, 2008-2-5
	  1995-12-22T09:05:02 = XXXX, 1995-12-22
	 -0010-09-15T04:44:23 = XXXX, -10-9-15

       yMMM (y MMM)

	  2008-02-05T18:30:30 = 2008 XXXXX
	  1995-12-22T09:05:02 = 1995 XXXXX
	 -0010-09-15T04:44:23 = -10 XXXXX

       yMMMEd (EEE, y MMM d)

	  2008-02-05T18:30:30 = XXXX, 2008 XXXXX 5
	  1995-12-22T09:05:02 = XXXX, 1995 XXXXX 22
	 -0010-09-15T04:44:23 = XXXX, -10 XXXXX 15

       yMMMM (y MMMM)

	  2008-02-05T18:30:30 = 2008 XXXXX
	  1995-12-22T09:05:02 = 1995 XXXXX
	 -0010-09-15T04:44:23 = -10 XXXXX

       yQ (y Q)

	  2008-02-05T18:30:30 = 2008 1
	  1995-12-22T09:05:02 = 1995 4
	 -0010-09-15T04:44:23 = -10 3

       yQQQ (y QQQ)

	  2008-02-05T18:30:30 = 2008 XXXXXX XXXXX
	  1995-12-22T09:05:02 = 1995 XXXXXX XXXXX
	 -0010-09-15T04:44:23 = -10 XXXXXX XXXX

       yyMMM (MMM yy)

	  2008-02-05T18:30:30 = XXXXX 08
	  1995-12-22T09:05:02 = XXXXX 95
	 -0010-09-15T04:44:23 = XXXXX -10

       yyQ (Q yy)

	  2008-02-05T18:30:30 = 1 08
	  1995-12-22T09:05:02 = 4 95
	 -0010-09-15T04:44:23 = 3 -10

   Miscellaneous
       Prefers 24 hour time?

       No

       Local first day of the week

       XXX

SUPPORT

       See DateTime::Locale.

AUTHOR

       Dave Rolsky <autarch@urth.org>

COPYRIGHT

       Copyright (c) 2008 David Rolsky. All rights reserved. This program is free software; you can redistribute it and/or modify it under the
       same terms as Perl itself.

       This module was generated from data provided by the CLDR project, see the LICENSE.cldr in this distribution for details on the CLDR data's
       license.

perl v5.16.3							    2014-06-10					      DateTime::Locale::pa_Arab(3)
All times are GMT -4. The time now is 11:12 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy