Sponsored Content
Top Forums Shell Programming and Scripting Remove duplicate based on Group Post 302610787 by yale_work on Wednesday 21st of March 2012 08:36:55 PM
Old 03-21-2012
Thanks.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Remove duplicate rows of a file based on a value of a column

Hi, I am processing a file and would like to delete duplicate records as indicated by one of its column. e.g. COL1 COL2 COL3 A 1234 1234 B 3k32 2322 C Xk32 TTT A NEW XX22 B 3k32 ... (7 Replies)
Discussion started by: risk_sly
7 Replies

2. Shell Programming and Scripting

Remove duplicate files based on text string?

Hi I have been struggling with a script for removing duplicate messages from a shared mailbox. I would like to search for duplicate messages based on the “Message-ID” string within the messages files. I have managed to find the duplicate “Message-ID” strings and (if I would like) delete... (1 Reply)
Discussion started by: spangberg
1 Replies

3. UNIX for Dummies Questions & Answers

How to get remove duplicate of a file based on many conditions

Hii Friends.. I have a huge set of data stored in a file.Which is as shown below a.dat: RAO 1869 12 19 0 0 0.00 17.9000 82.3000 10.0 0 0.00 0 3.70 0.00 0.00 0 0.00 3.70 4 NULL LEE 1870 4 11 1 0 0.00 30.0000 99.0000 0.0 0 0.00 0 0.00 0.00 0.00 0 ... (3 Replies)
Discussion started by: reva
3 Replies

4. UNIX for Dummies Questions & Answers

Remove duplicate rows when >10 based on single column value

Hello, I'm trying to delete duplicates when there are more than 10 duplicates, based on the value of the first column. e.g. a 1 a 2 a 3 b 1 c 1 gives b 1 c 1 but requires 11 duplicates before it deletes. Thanks for the help Video tutorial on how to use code tags in The UNIX... (11 Replies)
Discussion started by: informaticist
11 Replies

5. Shell Programming and Scripting

Remove duplicate lines based on field and sort

I have a csv file that I would like to remove duplicate lines based on field 1 and sort. I don't care about any of the other fields but I still wanna keep there data intact. I was thinking I could do something like this but I have no idea how to print the full line with this. Please show any method... (8 Replies)
Discussion started by: cokedude
8 Replies

6. Shell Programming and Scripting

Remove duplicate value based on two field $4 and $5

Hi All, i have input file like below... CA009156;20091003;M;AWBKCA72;123;;CANADIAN WESTERN BANK;EDMONTON;;2300, 10303, JASPER AVENUE;;T5J 3X6;; CA009156;20091003;M;AWBKCA72;321;;CANADIAN WESTERN BANK;EDMONTON;;2300, 10303, JASPER AVENUE;;T5J 3X6;; CA009156;20091003;M;AWBKCA72;231;;CANADIAN... (2 Replies)
Discussion started by: mohan sharma
2 Replies

7. Shell Programming and Scripting

How To Remove Duplicate Based on the Value?

Hi , Some time i got duplicated value in my files , bundle_identifier= B Sometext=ABC bundle_identifier= A bundle_unit=500 Sometext123=ABCD bundle_unit=400 i need to check if there is a duplicated values or not if yes , i need to check if the value is A or B when Bundle_Identified ,... (2 Replies)
Discussion started by: OTNA
2 Replies

8. Shell Programming and Scripting

Remove duplicate entries based on the range

I have file like this: chr start end chr15 99874874 99875874 chr15 99875173 99876173 aa1 chr15 99874923 99875923 chr15 99875173 99876173 aa1 chr15 99874962 99875962 chr15 99875173 99876173 aa1 chr1 ... (7 Replies)
Discussion started by: raj_k
7 Replies

9. Shell Programming and Scripting

Remove duplicate rows based on one column

Dear members, I need to filter a file based on the 8th column (that is id), and does not mather the other columns, because I want just one id (1 line of each id) and remove the duplicates lines based on this id (8th column), and does not matter wich duplicate will be removed. example of my file... (3 Replies)
Discussion started by: clarissab
3 Replies

10. Shell Programming and Scripting

Remove sections based on duplicate first line

Hi, I have a file with many sections in it. Each section is separated by a blank line. The first line of each section would determine if the section is duplicate or not. if the section is duplicate then remove the entire section from the file. below is the example of input and output.... (5 Replies)
Discussion started by: ahmedwaseem2000
5 Replies
W2DO(1) 						User Contributed Perl Documentation						   W2DO(1)

NAME
w2do - a simple text-based todo manager SYNOPSIS
w2do [-l] [-t task] [-g group] [-d date] [-p priority] [-f|-u] w2do -a task [-g group] [-d date] [-p priority] [-f|-u] w2do -c id [-t task] [-g group] [-d date] [-p priority] [-f|-u] w2do -r id w2do [options] DESCRIPTION
w2do is a simple to use yet efficient command-line todo manager written in Perl. OPTIONS
General Options -l, --list Display items in the task list. All tasks are listed by default, but desired subset can be easily selected via specifying options as well. Since listing is the default action, this option can be safely omitted. -a task, --add task Add new item with selected task name to the task list. When no additional specifying options are given, the group general, the due date anytime and the priority 3 is used by default and the task is marked as unfinished. -c id, --change id Change item with selected id in the task list. Further specifying options are required in order to take any effect. -r id, --remove id Remove item with selected id from the task list. --change-group group Change all items in the selected group. Further specifying options are required in order to take any effect. --remove-group group Remove all items from the selected group. --purge-group group Remove all finished items from the selected group. --change-date date Change all items with selected due date. Further specifying options are required in order to take any effect. --remove-date date Remove all items with selected due date. --purge-date date Remove all finished items with selected due date. --change-pri priority Change all items with selected priority. Further specifying options are required in order to take any effect. --remove-pri priority Remove all items with selected priority. --purge-pri priority Remove all finished items with selected priority. --change-old Change all items with passed due date. Further specifying options are required in order to take any effect. --remove-old Remove all items with passed due date. --purge-old Remove all finished items with passed due date. --change-all Change all items in the task list. Further specifying options are required in order to take any effect. --remove-all Remove all items from the task list. --purge-all Remove all finished items from the task list. --undo Revert last action. When invoked, the data are restored from the backup file (i.e. "~/.w2do.bak" by default), which is deleted at the same time. --groups Display comma-delimited list of all groups in the task list. --stats Display detailed task list statistics. -h, --help Display help message and exit. -v, --version Display version information and exit. Specifying Options -t task, --task task Specify the task name. -g group, --group group Specify the group name. The group name should be a single word with maximum of 10 characters, but longer names are shortened automatically. -d date, --date date Specify the due date. Available options are anytime, today, yesterday, tomorrow, month, year, or an exact date in the YYYY-MM-DD format, e.g. 2008-06-17 for 17 June 2008. -p priority, --priority priority Specify the priority. Available options are integers between 1 and 5, where 1 represents the highest priority. -f, --finished Specify the finished task. -u, --unfinished Specify the unfinished task. Additional Options -s file, --savefile file Use selected file instead of the default "~/.w2do" as a save file. -w width, --width width Use selected line width; the minimal value is 75. -q, --quiet Avoid displaying messages that are not necessary. -V, --verbose Display all messages; this is the default option. -C, --colour, --color Use coloured output instead of the default plain text version. -X, --no-colour, --no-color Use plain text output (no colours); this is the default option. -b, --bare Do not display table header and group separators. -B, --no-bare Display table header and group separators; the default option. -I, --no-id Do not display ID column in the listing. --with-id Display ID column in the listing; the default option. -G, --no-group Do not display group column in the listing. --with-group Display group column in the listing; the default option. -D, --no-date Do not display due date column in the listing. --with-date Display due date column in the listing; the default option. -P, --no-priority Do not display priority column in the listing. --with-priority Display priority column in the listing; the default option. -S, --no-state Do not display state column in the listing. --with-state Display state column in the listing; the default option. ENVIRONMENT
W2DO_SAVEFILE Use selected file instead of the default "~/.w2do" as a save file. W2DO_WIDTH Use selected line width; the minimal value is 75. FILES
~/.w2do Default save file. ~/.w2do.bak Default backup file. SEE ALSO
w2html(1), w2text(1), perl(1). BUGS
To report bugs or even send patches, you can either add new issue to the project bugtracker at <http://code.google.com/p/w2do/issues/>, visit the discussion group at <http://groups.google.com/group/w2do/>, or you can contact the author directly via e-mail. AUTHOR
Written by Jaromir Hradilek <jhradilek@gmail.com>. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included as a file called FDL in the main directory of the w2do source package. COPYRIGHT
Copyright (C) 2008, 2009, 2010 Jaromir Hradilek This program is free software; see the source for copying conditions. It is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. Version 2.3.1 2010-02-13 W2DO(1)
All times are GMT -4. The time now is 04:14 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy