HELP with Unix scripts in summing columns in a file.
Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted!
1. The problem statement, all variables and given/known data:
Hi guys, i'm a new guy here, and it's my first time creating a unix script.
can you guys help me out here? i'd really appreciate it.
Here's my problem:
This is the file i'm using, it has 6 columns, the first three columns are like the key columns, and i put one header row. I need to sum the values of 4th, 5th and 6th row, by grouping each row by date, prod id and store id.
Code:
1st file:
date prod id store id amt 1 amt 2 amt 3
20111017 45671 11801 -12 -12348 1080
20111017 45671 11801 12 12348 1030
20111018 45672 11802 7 7868 990
20111018 45672 11802 4 4496 950
20111019 45673 11803 -12 -12348 910
20111019 45674 11804 12 12348 866
then i have this second file:
this file contains a list of "prod id's" that should be ignored in the first file.
2nd file:
Code:
prod id
45671
The third file consists of a list of "store id's" that should be ignored from the 1st file.
3rd file:
Code:
store id
11803
So basically, i need to come up with a script to sum the 4th, 5th and 6th columns of the first file, while taking consideration, those that are present in the 2nd and 3rd file, so that those that should be ignored should not be included when columns are summed.
I would really appreciate a lot of love and help and mercy from you guys.
Thanks a lot!
2. Relevant commands, code, scripts, algorithms:
3. The attempts at a solution (include all code and scripts):
4. Complete Name of School (University), City (State), Country, Name of Professor, and Course Number (Link to Course):
Note: Without school/professor/course information, you will be banned if you post here! You must complete the entire template (not just parts of it).
Hi everyone,
I need a help on Unix scripting.
I have a file is like this
Date Amt
20071205 10
20071204 10
20071203 200
20071204 300
20071203 400
20071205 140
20071203 100
20071205 100... (1 Reply)
Hi All,
I have a file like -
num.txt
12, 34, 65, line1
34, 65, 89, line2
43, 65, 77, line3
I want to do two things -
1. Add first three columns of each line and print the line with largest value.
i.e. (12+34+65) for 1st line and so on.
2. Add middle column of each line i.e.... (3 Replies)
Basically I have to process a text file which has been sorted this way:
John 12
John 13
John 10
John 900
Peter 20
Peter 30
Peter 32
The first column is a name, and the second an arbitrary value, both delimited by a space. How can I sum them up such that it would become:
John 935... (2 Replies)
1. The problem statement, all variables and given/known data:
Hi guys, i'm a new guy here, and it's my first time creating a unix script.
can you guys help me out here? i'd really appreciate it. :(
Here's my problem:
This is the file i'm using, it has 6 columns, the first three columns are... (12 Replies)
a,b,d,e,f,g,h,i,j,k,l,m,n,o,p,q,r,s,t,u,v,w,x,y,z,aa,bb,cc,dd,ee,ff,gg,hh,ii
a thru ii are digits and strings....
The awk needed....if coloumn 9 == i (coloumn 9 is string ), output the sum of x's(coloumn 22 ) in all records and sum of y's (coloumn 23 ) in all records in a file (records.txt).... (6 Replies)
Can anyone tell me how sum values in each record of a file and append that value to the end? For instance a typical record will be:
FY12,Budget,771100,,,,,,,,,250,-250
I'd like the record to become
FY12,Budget,771100,,,,,,,,,250,-250,0
which can be put into another file.
Thank you. (6 Replies)
I have a file with the following format
AAAAA 1.34B 0.76B 0.00B 0.00B 0.00B 0.00B 0.00B 0.00B 0.00B 0.00B 0.00B 0.00B 0.00B 0.00B 0.90B 0.00B 0.00B 0.46B 0.00B 0.03B 0.00B ... (4 Replies)
Hello,
I am facing issue in summing up a column in unix.I am displaying a column sum up to 4 decimal places and below is the code snippet
sed '1d' abc.csv | cut -d',' -f7 | awk '{s+=$1}END{ printf("%.4f\n",s)}'
-170552450514.8603
example of data values in the column(not... (3 Replies)
Discussion started by: karthik adiga
3 Replies
LEARN ABOUT DEBIAN
dnstop
DNSTOP(8) BSD System Manager's Manual DNSTOP(8)NAME
dnstop -- displays various tables of DNS traffic on your network
SYNOPSIS
dnstop [-46apsQR] [-b expression] [-i address] [-f filter] [-r interval] [device] [savefile]
DESCRIPTION
dnstop is a small tool to listen on device or to parse the file savefile and collect and print statistics on the local network's DNS traffic.
You must have read access to /dev/bpf*.
COMMAND LINE OPTIONS
The options are as follows:
-4 count only messages with IPv4 addresses
-6 count only messages with IPv6 addresses
-Q count only DNS query messages
-R count only DNS reply messages
-a anonymize addresses
-b expression
BPF filter expression
(default: udp port 53)
-i address
ignore select addresses
-p Do not put the interface into promiscuous mode.
-r Redraw interval (seconds).
-l level
keep counts on names up to level domain name levels.
For example, with -l 2 (the default), dnstop will keep two tables: one with top-level domain names, and another with second-level
domain names. Increasing the level provides more details, but also requires more memory and CPU.
-f input filter name
The "unknown-tlds" filter includes only queries for TLDs that are bogus. Useful for identifying hosts/servers that leak queries for
things like "localhost" or "workgroup."
The "A-for-A" filter includes only A queries for names that are already IP addresses. Certain Microsoft Windows DNS servers have a
known bug that forward these queries.
The "rfc1918-ptr" filter includes only PTR queries for addresses in RFC1918 space. These should never leak from inside an organiza-
tion.
The "refused" filter, when used with the -R option, tells dnstop to count only replies with rcode REFUSED.
The "qtype-any" filter tells dnstop to count only message of type ANY.
-n name
Only count messages within the domain name
-P Print "progress" messages on stderr when in non-interactive mode.
-B buckets
Use buckets hash table buckets.
-X Do not tabulate the sources + query name counters. This can significantly reduce memory usage on busy servers and large savefiles.
savefile
a captured network trace in pcap format
device ethernet device (ie fxp0)
RUN TIME OPTIONS
While running, the following options are available to alter the display:
s display the source address table
d display the destination address table
t display the breakdown of query types seen
r display the breakdown of response codes seen
o display the breakdown of opcodes seen
1 show 1st level query names
2 show 2nd level query names
3 show 3rd level query names
4 show 4th level query names
5 show 5th level query names
6 show 6th level query names
7 show 7th level query names
8 show 8th level query names
9 show 9th level query names
! show sources + 1st level query names
@ show sources + 2nd level query names
# show sources + 3rd level query names
$ show sources + 4th level query names
% show sources + 5th level query names
^ show sources + 6th level query names
& show sources + 7th level query names
* show sources + 8th level query names
( show sources + 9th level query names
^R reset the counters
^X exit the program
space redraw
? help
NON-INTERACTIVE MODE
If stdout is not a tty, dnstop runs in non-interactive mode. In this case, you must supply a savefile for reading, instead of capturing live
packets. After reading the entire savefile, dnstop prints the top 50 entries for each table.
HOW MESSAGES ARE COUNTED
By default dnstop examines only query messages and ignores replies. In this case the response code table is meaningless and will likely show
100% "Noerror."
If you supply (only) the -R command line option, dnstop examines replies and ignores queries. This allows you to see meaningful response
code values, as well as all the other tables. In this case all the query attributes (such as type and name) are taken from the Question sec-
tion of the reply.
Note, however, that it is common for a stream of DNS messages to contain more queries than replies. This could happen, for example, if the
server is too busy to respond to every single query, or if the server is designed to ignore malformed query messages. Therefore, you might
want to examine both queries and replies by giving both -R and -Q command line options. In this case, only the response code counts are
taken from the replies and all other attributes are taken from the queries.
AUTHORS
Duane Wessels (wessels@measurement-factory.com)
Mark Foster (mark@foster.cc)
Jose Nazario (jose@monkey.org)
Sam Norris <@ChangeIP.com>
Max Horn <@quendi.de>
John Morrissey <jwm@horde.net>
Florian Forster <octo@verplant.org>
Dave Plonka <plonka@cs.wisc.edu>
http://dnstop.measurement-factory.com/
BUGS
Does not support TCP at this time.
BSD 21 March, 2008 BSD
08-21-2012
