06-24-2013
How to remove duplicated lines?
Hi, if i have a file like this:
Query=1
a
a
b
c
c
c
d
Query=2
b
b
b
c
c
e
.
.
.
How could i remove the duplicated lines under each query with the duplicated numbers like this:
Query=1
a 2
b 1
c 3
d 1
Query=2
b 3
c 2
e 1
Thanks!!!
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
If i have a file with xml format, i would like to remove duplicated records and save to a new file. Is it possible...to write script to do it? (8 Replies)
Discussion started by: happyv
8 Replies
2. Shell Programming and Scripting
Hi
Just wondering whether or not I can remove duplicated lines without sort
For example, I use the command who, which shows users who are logging on. In some cases, it shows duplicated lines of users who are logging on more than one terminal.
Normally, I would do
who | cut -d" " -f1 |... (6 Replies)
Discussion started by: lalelle
6 Replies
3. Shell Programming and Scripting
hi all,
i have a file contain multicolumns, this file is sorted by col2 and col3.
i want to remove the duplicated columns if the col2 and col3 are the same in another line.
example
fileA
AA BB CC DD
CC XX CC DD
BB CC ZZ FF
DD FF HH HH
the output is
AA BB CC DD
BB CC ZZ FF... (6 Replies)
Discussion started by: kamel.seg
6 Replies
4. Shell Programming and Scripting
Input file:
hcmv-US25-2-3p hsa-3160-5
hcmv-US33 hsa-47
hcmv-UL70-3p hsa-4508
hcmv-UL70-3p hsa-4486
hcms-US25 hsa-360-5
hcms-US25 hsa-4
hcms-US25 hsa-458
hcms-US25 hsa-44812
.
.
Desired Output file:
hcmv-US25-2-3p hsa-3160-5
hcmv-US33 hsa-47
hcmv-UL70-3p hsa-4508
hsa-4486... (3 Replies)
Discussion started by: perl_beginner
3 Replies
5. Shell Programming and Scripting
Hi,
I am trying to use awk to remove all rows where the first 4 fields are duplicates. e.g. in the following data lines 6-9 would be removed, leaving one copy of the duplicated row (row 5)
Borgarhraun FH9822 ol24 FH9822_ol24_m20 ol Deformed c
Borgarhraun FH9822 ol24 ... (3 Replies)
Discussion started by: tomahawk
3 Replies
6. UNIX for Dummies Questions & Answers
Hi Guys..
I have a problem for some reason my database has copied everything 4 times.
My Database looks like this:
>BAC233456
rhjieaheiohjteo
tjtjrj6jkk6k6
j54ju54jh54jh
>ANI124365
afrhtjykulilil
htrjykuk
rtkjryky
ukrykyrk
>BAC233456
rhjieaheiohjteo
tjtjrj6jkk6k6
j54ju54jh54jh... (6 Replies)
Discussion started by: Iifa
6 Replies
7. Shell Programming and Scripting
In a folder I'll several times daily receive new files that I want to combine into one big file, without any duplicate rows.
The file name in the folder will look like e.q:
MissingData_2014-08-25_09-30-18.txt
MissingData_2014-08-25_09-30-14.txt
MissingData_2014-08-26_09-30-12.txt
The content... (9 Replies)
Discussion started by: Bergans
9 Replies
8. Shell Programming and Scripting
Dear all,
How can I remove duplicated column in a text file?
Input:
LG10_PM_map_19_LEnd 1000560 G AA AA AA AA AA GG
LG10_PM_map_19_LEnd 1005621 G GG GG GG AA AA GG
LG10_PM_map_19_LEnd 1011214 A AA AA AA AA GG GG
LG10_PM_map_19_LEnd 1011673 T TT TT TT TT CC CC... (1 Reply)
Discussion started by: huiyee1
1 Replies
9. AIX
Hello.
I have a server with 2 boot disk but in the bootlist there are 5 paths of one disk but no path of the other.
How can I remove paths from one disk to insert paths from the other disk?
Thanks in advance.
server074:root:/# bootlist -om normal
hdisk0 blv=hd5 pathid=0
hdisk0... (7 Replies)
Discussion started by: Gabriander
7 Replies
10. Shell Programming and Scripting
Hi Gurus,
I need to remove duplicate line in file and update TRAILER (last line) record count. the file is comma delimited, field 2 is key to identify duplicated record.
I can use below command to remove duplicated. but don't know how to replace last line 2nd field to new count.
awk -F","... (11 Replies)
Discussion started by: green_k
11 Replies
LEARN ABOUT DEBIAN
rdf::query::plan::subselect
RDF::Query::Plan::SubSelect(3pm) User Contributed Perl Documentation RDF::Query::Plan::SubSelect(3pm)
NAME
RDF::Query::Plan::SubSelect - Executable query plan for sub-select queries.
VERSION
This document describes RDF::Query::Plan::SubSelect version 2.908.
METHODS
Beyond the methods documented below, this class inherits methods from the RDF::Query::Plan class.
"new ( $query, [ \%logging_keys ] )"
Returns a new SubSelect query plan object. "<$query"> is a RDF:Query object representing a SELECT query.
"execute ( $execution_context )"
"next"
"close"
"query"
Returns the sub-select query object.
"plan"
Returns the sub-select query plan object.
"distinct"
Returns true if the pattern is guaranteed to return distinct results.
"ordered"
Returns true if the pattern is guaranteed to return ordered results.
"plan_node_name"
Returns the string name of this plan node, suitable for use in serialization.
"plan_prototype"
Returns a list of scalar identifiers for the type of the content (children) nodes of this plan node. See RDF::Query::Plan for a list of
the allowable identifiers.
"plan_node_data"
Returns the data for this plan node that corresponds to the values described by the signature returned by "plan_prototype".
"graph ( $g )"
AUTHOR
Gregory Todd Williams <gwilliams@cpan.org>
perl v5.14.2 2012-01-31 RDF::Query::Plan::SubSelect(3pm)