10-09-2012
Quote:
Originally Posted by
Mike Smith
Tried -k2,2 and it binned loads of old entries which I wanted!
Say I have this data, the highest number (newest) one will always be at the top and I only want to keep the top one as everything right of, and including, column 2 is the same (nothing has changed since last sweep).
1349455502 ygtr-1b:3/1/19 10/100/Gig Ethernet SFP
1349246545 ygtr-1b:3/1/19 10/100/Gig Ethernet SFP
However if we get the following then I want both entries retaining
1349455502 ygtr-1b:3/1/19 10/100/Gig Ethernet SFP
1349246545 ygtr-1b:3/1/19 Old customer name typed in here
-k2,2 seems to ONLY consider column 2 which is no good based on my first post's criteria.
This is tricky!
It isn't tricky at all. You can't say that the first field doesn't matter when throwing away duplicates
and at the same time say that you want the highest value for the first field to be the one that is kept when throwing away duplicates. If you care which duplicate is kept, you don't think they are duplicates. If you want both, you have to do it in two separate steps:
- sort in reverse order with the data from the start of field 2 to the end of the line as your primary sort key and the numeric value in field 1 as your secondary sort key, and then
- on a second pass, discard or ignore the second and subsequent lines that match (including field separators other than the separator between the 1st and 2nd fields) from the start of the 2nd field to the end of the line.
So why does it now matter which timestamp is kept when throwing away duplicates if it didn't matter when you were running this application on Solaris 8?
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
Hi All,
I have a file 1.txt which has the duplicate dns entries as shown:
Name: 000f9fbc6738.net.in|Addresses: 10.241.66.169, 10.84.2.222,212.241.66.170
Name: 001371e8ed3e.net.in|Addresses: 10.241.65.153, 10.84.1.101
Name: 00e06f5bd42a.net.in|Addresses: 10.72.19.218,... (6 Replies)
Discussion started by: imas
6 Replies
2. Shell Programming and Scripting
My data is something like shown below.
date1 date2 aaa bbbb ccccc
date3 date4 dddd eeeeeee ffffffffff ggggg hh
I want the output like this
date1date2 aaa eeeeee
I serached in the forum but didn't find the exact matching solution. Please help. (7 Replies)
Discussion started by: rdhanek
7 Replies
3. Shell Programming and Scripting
Hi to all.
I'm trying to sort this with the Unix command sort.
user1:12345678:3.5:2.5:8:1:2:3
user2:12345679:4.5:3.5:8:1:3:2
user3:12345687:5.5:2.5:6:1:3:2
user4:12345670:5.5:2.5:5:3:2:1
user5:12345671:2.5:5.5:7:2:3:1
I need to get this:
user3:12345687:5.5:2.5:6:1:3:2... (7 Replies)
Discussion started by: daniel.gbaena
7 Replies
4. UNIX for Dummies Questions & Answers
Hi Everybody,
I am just new to UNIX as well as to this forum. I have a text file with 10,000 coloumns and each coloumn contains values separated by space. I want to separate them into new coloumns..the file is something like this
as ad af 1 A
as ad af 1 D
...
...
1 and A are in one... (7 Replies)
Discussion started by: Unilearn
7 Replies
5. UNIX for Advanced & Expert Users
Hello all -
I am to this forum and fairly new in learning unix and finding some difficulty in preparing a small shell script. I am trying to make script to sort all the files given by user as input (either the exact full name of the file or say the files matching the criteria like all files... (3 Replies)
Discussion started by: pankaj80
3 Replies
6. Shell Programming and Scripting
Hi All, Need Suggestion, Want to sort a file using awk & sed to get required, output as below, such that each LUN shows correct WWPN and FA port Numbers correctly:
Required output:
01FB 10000000c97843a2 8C 0
01FB 10000000c96fb279 9C 0
22AF 10000000c97843a2 8C 0
22AF 10000000c975adbd ... (10 Replies)
Discussion started by: aix_admin_007
10 Replies
7. Shell Programming and Scripting
Input file:
100%ABC2 3.44E-12 USA
A2M%H02579 0E0 UK
100%ABC2 5.34E-8 UK
100%ABC2 3.25E-12 USA
A2M%H02579 5E-45 UK
Output file:
100%ABC2 3.44E-12 USA
100%ABC2 3.25E-12 USA
100%ABC2 5.34E-8 UK
A2M%H02579 0E0 UK
A2M%H02579 5E-45 UK
Code try:
sort -k1,1 -g -k2 -r input.txt... (2 Replies)
Discussion started by: perl_beginner
2 Replies
8. Shell Programming and Scripting
Hi Experts,
I have a filelist collected from another server , now want to sort the output using date/time stamp filed.
- Filed 6, 7,8 are showing the date/time/stamp.
Here is the input:
#----------------------------------------------------------------------
-rw------- 1 root ... (3 Replies)
Discussion started by: rveri
3 Replies
9. UNIX for Dummies Questions & Answers
Any good way to check if code has the required output
# /sbin/sysctl net.ipv4.icmp_echo_ignore_broadcasts
net.ipv4.icmp_echo_ignore_broadcasts = 1
/sbin/sysctl net.ipv4.icmp_echo_ignore_broadcasts | grep "= 1"
net.ipv4.icmp_echo_ignore_broadcasts = 1
What I can think of is above, and it... (16 Replies)
Discussion started by: alvinoo
16 Replies
10. Shell Programming and Scripting
I have the below contents in a file after making the below curl call
curl ... | grep -E "state|Rno" | paste -sd',\n' | grep "Disconnected" > test
"state" : "Disconnected",, "Rno" : "5554f1d2"
"state" : "Disconnected",, "Rno" : "10587563"
"state" : "Disconnected",, "Rno" :... (2 Replies)
Discussion started by: Vaibhav H
2 Replies
LEARN ABOUT DEBIAN
sort-dctrl
SORT-DCTRL(1) Debian user's manual SORT-DCTRL(1)
NAME
sort-dctrl - sort Debian control files
SYNOPSIS
sort-dctrl [options] [ file ... ]
sort-dctrl --copying | --help | --version | -ChV
DESCRIPTION
The sort-dctrl program sorts Debian control files according to specified criteria.
A Debian control (dctrl) file is a semistructured single-table database stored in a machine-parseable text file. Such a database consists
of a set of records; each record is a mapping from field names to field content. Textually, records are separated by empty lines, while
each field is encoded as one or more nonempty lines inside a record. A field starts with its name, followed by a colon, followed by the
field content. The colon must reside on the first line of the field, and the first line must start with no whitespace. Subsequent lines,
in contrast, always start with linear whitespace (one or more space or tab characters).
The sort-dctrl program recognizes two field types: string fields and version fields. Version fields act also as numeric fields. String
fields are compared according to strict lexicographical octet-by-octet comparison, after ignoring any initial whitespace after the colon.
Version fields are parsed and compared as Debian version numbers. When comparing version numbers, if a field content does not in fact con-
form to the version number syntax, it compares less than any field content that does conform, and equal to any other nonconforming field
content. The sort-dctrl program assumes all fields are string fields unless told otherwise.
You can specify arbitrary number of keys for sorting, using the -k option. The keys are interpreted in a descending order of priority: the
first key specified is primary, the second key specified is secondary, and so on. If two records compare equal under the primary key, then
they are compared under the secondary key, and so on. If no keys are specified, a default key is assumed (the "Package" field with no mod-
ifiers).
OPTIONS
-k keyspec, --key-spec=keyspec
Specify one or more keys for sorting. You may specify this option any number of times. The keyspec argument consists of a comma-
separated list of key specifications. Each key specification consists of the name of the field that serves as the key, optionally
followed by a colon and key modifiers. The following key modifiers are supported:
r Invert the comparison for this key, reversing the sorting order.
v Treat this field as a version number field.
n Treat this field as numeric, which currently is synonymous with v.
-q, --quiet, --silent
Output nothing to the standard output stream. Instead, exit immediately after finding the first match.
-l level, --errorlevel=level
Set log level to level. level is one of fatal, important, informational and debug, but the last may not be available, depending on
the compile-time options. These categories are given here in order; every message that is emitted when fatal is in effect, will be
emitted in the important error level, and so on. The default is important.
-V, --version
Print out version information.
-C, --copying
Print out the copyright license. This produces much output; be sure to redirect or pipe it somewhere (such as your favourite
pager).
-h, --help
Print out a help summary.
EXAMPLES
Here are some sample invocations of the program:
sort-dctrl /var/lib/dpkg/available
Output the dpkg available file sorted by the package name.
sort-dctrl -k Version:v /var/lib/dpkg/available
Output the dpkg available file sorted in ascending order of version numbers.
sort-dctrl -k Version:vr /var/lib/dpkg/available
Output the dpkg available file sorted in descending order of version numbers.
sort-dctrl -k Package,Version:v /var/lib/dpkg/available
Output the dpkg available file sorted primarily in ascending order of package names and secondarily in descending order of version
numbers.
sort-dctrl -k Installed-Size:n,Size:nr /var/lib/dpkg/available
Output the dpkg available file sorted primarily in ascending order of installation sizes and secondarily in descending order of
package sizes.
AUTHOR
The program and this manual page were written by Antti-Juhani Kaijanaho <ajk@debian.org>.
SEE ALSO
Debian Policy Manual. Published as the Debian package debian-policy. Also available in the Debian website.
grep-dctrl(1)
Debian Project 2005-06-08 SORT-DCTRL(1)