03-06-2013
Quote:
Originally Posted by
JoshCrosby
Thank you so much, based on the dataset it is perfect.. however on the larger files it takes quite a while which is fine. The one issue is that its not taking product (column 1) into account and seems to be grouping on the count
Any ideas? I sincerely appreciate your help.
Some logic
-> product (sort by top 3 - based on how many rows it appears on)
----> skew (sort by top 5 skews from the products found above)
----> count of skews
I hope that helps explain a bit more.
A bit more, yes. But still not clear. In your sample input there are 6 occurrences each of products p1, p2, p3, and p4. You say you want the top 3 products, but your sample output only shows 2. (And since there are four products with the same number of occurrences, you don't say how to choose which 3 of those 4 should be chosen.) Your sample output didn't show the top 2 product/skew pairs p1/12345 and p2/23456 both of which appear 6 times even though p1 and p2 appear the same number of times as p3 and p4???
From what you did with your 1 count sample, you chose the last two of the set of the four most common products based on the fact that their product names sorted last. Is that really what you want?
If there are ties, should your results include all products that match the number of occurrences of the third most common product? If there are ties in the number of appearances of a skew within a product, should the results include all skews with the fifth most common skew within that product?
Will a single skew ever appear with more than one product, or are skews supposed to be unique to a product.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
How can i do a simple record count in my shell script? i just want to count the number of records i receive from a specific file. (11 Replies)
Discussion started by: k@ssidy
11 Replies
2. UNIX for Dummies Questions & Answers
To start I have a table that has ticketholders. Each ticket holder has a unique number and each ticket holder is associated to a so called household number. You can have multiple guests w/i a household.
I would like to create 3 flags (form a, for a household that has 1-4 gst) form b 5-8 gsts... (3 Replies)
Discussion started by: sbr262
3 Replies
3. Shell Programming and Scripting
I run awk
cat $1|awk '{print $6}'
and get a lot of results and I want results to group them. For example my result is (o/p is unknown to user)
xyz
xyz
abc
pqr
xyz
pqr
etc
I wanna group them as
xyz=total found 7
abc=total ....
pqr=
Thank (3 Replies)
Discussion started by: pujansrt
3 Replies
4. Shell Programming and Scripting
Hello
I am trying to figure out a script which could group a log file by user names. I worked with awk command and I could trim the log file to:
<USER: John Frisbie > /* Thu Aug 06 2009 15:11:45.7974 */ FLOAT GRANT WRITE John Frisbie (500 of 3005 write)
<USER: Shawn Sanders > /* Thu Aug 06... (2 Replies)
Discussion started by: Avto
2 Replies
5. Shell Programming and Scripting
Hi,
I need an awk script (or whatever shell-construct) that would take data like below and get the max value of 3 column, when grouping by the 1st column.
clientname,day-of-month,max-users
-----------------------------------
client1,20120610,5
client2,20120610,2
client3,20120610,7... (3 Replies)
Discussion started by: ckmehta
3 Replies
6. Shell Programming and Scripting
Hello folks.
After awk, i have decided to start to learn perl, and i need some help.
I have following output :
1 a
1 b
2 k
2 f
3 s
3 p
Now with awk i get desired output by issuing :
awk ' { a = a FS $2 } END { for ( i in a) print i,a }' input
1 a b
2 k f
3 s p
Can... (1 Reply)
Discussion started by: Peasant
1 Replies
7. Shell Programming and Scripting
I have below inside a file.
11.22.33.44
user1
11.22.33.55
user2
I need this manipulated as
alias server1.domain.com='ssh user1@11.22.33.44'
alias server2.domain.com='ssh user2@11.22.33.55' (3 Replies)
Discussion started by: anil510
3 Replies
8. UNIX for Dummies Questions & Answers
Hello
Im new treat me nicely, I have a headache :)
I have a script that seemed to work now it doesnt anyway, the last part is adding counts of unique items in a csv file eg
05492U34 38
05492U34 47
two columns, (many different values like this in file)
i want... (7 Replies)
Discussion started by: aniquebmx
7 Replies
9. Shell Programming and Scripting
I have a data which looks like
1440993600|L|ABCDEF
1440993600|L|ABCD
1440993601|L|ABCDEF
1440993602|L|ABC
1440993603|L|ABCDE
.
.
.
1441015200|L|AB
1441015200|L|ABC
1441015200|L|ABCDEF
So basically, the $1 is epoch date, $2 and $3 is some application data
From one if the... (5 Replies)
Discussion started by: hemanty4u
5 Replies
10. Shell Programming and Scripting
The awk below is supposed to count all the matching $5 strings and count how many $7 values is less than 20. I don't think I need the portion in bold as I do not need any decimal point or format, but can not seem to get the correct counts. Thank you :).
file
chr5 77316500 77316628 ... (6 Replies)
Discussion started by: cmccabe
6 Replies
LEARN ABOUT DEBIAN
dh_installzope
DH_INSTALLZOPE(1) Debhelper DH_INSTALLZOPE(1)
NAME
dh_installzope - install zope product and extension files into package build directories
SYNOPSIS
dh_installzope [debhelper options] [-n] [-Xitem] [dir ...]
DESCRIPTION
dh_installzope is a debhelper program that is responsible for installing zope products and extensions into package build directories.
Directory names are interpreted as zope product names and will be installed into the first package dh_installzope is told to act on. By
default, this is the first binary package in debian/control, but if you use -p, -i, or -a flags, it will be the first package specified by
those flags.
dh_installzope automatically installs debian/dzproduct and debian/dzextension if it exists. If dh_installzope is acting on multiple
packages, debian/dzproduct and debian/dzextension files will be installed into the first package. Use debian/package.dzproduct and
debian/package.dzextension for different binary packages.
If your package needs to register more than one product or extension, you need multiple files. To accomplish this, you can use files named
debian/package.dzproduct.* and debian/package.dzextension.*
Missing dzproduct and dzextension files for the first package dh_installzope is told to act on are generated and installed automatically.
The substitution variable zope:Depends is replaced by a list of the available zope versions.
OPTIONS
-n, --noscripts
Do not modify postinst/prerm scripts.
-Xitem, --exclude=item
Exclude files that contain "item" anywhere in their filename from being installed.
directory ...
Install these directories as products into the first package acted on.
EXAMPLES
This is an example of a debian/package.dzproduct file:
Package: zope-cmfdefault1.4
Name: CMFDefault
Directory: CMFDefault:1.4
Depends: CMFTopic:1.4
Version: 1.4.7-1
ZopeVersions: 2.9 2.8
The Version field is added or updated by dh_installzope. If Name and Directory match, the latter can be omitted. A deviating Directory is
used to install different product versions. A Directory has the form <product name>[:<suffix>].
It is possible to specify the list of zope versions for the 2.x serie using a >= relation, like in this example:
Package: zope-psycopgda
ZopeVersions: >= 2.7
This allows bin-NMUs of zope products on new Zope 2.x major versions, and for this reason it should be the preferred syntax.
NOTES
Note that this command is not idempotent. "dh_clean -k" should be called between invocations of this command. Otherwise, it may cause
multiple instances of the same text to be added to maintainer scripts.
SEE ALSO
debhelper(7)
This program is a part of zope-debhelper.
AUTHOR
Matthias Klose <doko@ubuntu.com> Fabio Tranchitella <kobold@debian.org>
0.3.15 2011-06-21 DH_INSTALLZOPE(1)