Sampling and Binning- Engineering problem Post: 302231867

Sponsored Content

Top Forums Shell Programming and Scripting Sampling and Binning- Engineering problem Post 302231867 by Needhelp2 on Wednesday 3rd of September 2008 10:19:01 AM

09-03-2008

Registered User

Sampling and Binning- Engineering problem

Hi everyone!

Can you please help me with some shell scripting?

I have an input file input.txt

It has 3 columns (Time, Event, Value)

Time event Value
03:38:22 A 57
03:38:23 A 56
03:38:24 B 24
03:38:25 C 51
03:38:26 B 7
03:38:26 B 59
03:38:27 A 98
03:38:28 A 24
03:38:29 A 35
03:38:30 A 55

Require code to do the following steps.

1) Sort by column 1 (Time) - Ascending order
2) Perform sampling every 5 second and within this 5 second block count the number event (event type ="A") and average the Value. Hence the output for the 1st 5 second block should be .

TBlocks Count_of_EVENT("A") Average Value

1 3 70.33

And continue for the 2nd 5 second block ( which starts from T= 03:38:28 ).... until end of the file .

Thanks for your support

Needhelp2

View Public Profile for Needhelp2

Find all posts by Needhelp2

6 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

trimming and binning rows

I could not find this on the search.. I want to know how to trim a row so lets say I have a file that looks like this: bob 88888888888888 and I want to trim column 2 (lets say 4 off the front and end) bob 888888 Also, how would I bin column 2 Lets so I want to add and average...

2. Shell Programming and Scripting

data sampling

I have a requirement where I have multiple flat file sources. I need to create sample data from each source. Example: Source 1 has 10 flat files-- member, transaction,item,email,....etc Now if I get any 10 records (say first 10 records) from the member flat file, I need to find those matching...

3. Shell Programming and Scripting

Binning rows while skipping the first column

Hi I have a file that I want to bin. I am using this code: awk -F'\t' -v r=40 '{for(i=r;i<=NF;i+=r){for(j=0;j<r;j++){sum+=$(i-j)}printf "%s ", sum/r;sum=0}; printf "\n"}' file1 > file2 So basically what this code does is that it will averaging every 40 columns (creating bins of 40). But...

4. Shell Programming and Scripting

Sampling pcap file

Hi, I have a standard pcap file created using tcpdump. The file looks like 06:49:36.487629 IP 202.1.175.252 > 71.126.222.64: ICMP echo request, id 52765, seq 1280, length 40 06:49:36.489552 IP 192.120.148.227 > 71.126.222.64: ICMP echo request, id 512, seq 1280, length 40 06:49:36.491812 IP...

5. Shell Programming and Scripting

problem in binning the data

hi i have some data like this input: 1 apples oranges 234 2 oranges apples 2345 3 grapes bananas 1000000 4 melons banans 10000000 5 bananas apples 5000000 6 mangoes banans 2000000 7 apples bananas 1999999 i want to put all those which are coming between 1 and 999999 in to one bin...

6. Shell Programming and Scripting

Gnuplot 3d binning

Hello I have a text file with tens of thousands of rows The format is x y where both x and y can be anything between -100 and +100. What I would like to do is have a 3d gnuplot where there are 10,000 squared or bins and each bin will count how many rows have a value that would be...

LEARN ABOUT DEBIAN

vconsole.conf

VCONSOLE.CONF(5)						   vconsole.conf						  VCONSOLE.CONF(5)

NAME

       vconsole.conf - configuration file for the virtual console

SYNOPSIS

       /etc/vconsole.conf

DESCRIPTION

       The /etc/vconsole.conf file configures the virtual console, i.e. keyboard mapping and console font.

       The basic file format of the vconsole.conf is a newline-separated list environment-like shell-compatible variable assignments. It is
       possible to source the configuration from shell scripts, however, beyond mere variable assignments no shell features are supported,
       allowing applications to read the file without implementing a shell compatible execution engine.

       Note that the kernel command line options vconsole.keymap=, vconsole.keymap.toggle=, vconsole.font=, vconsole.font.map=,
       vconsole.font.unimap= may be used to override the console settings at boot.

       Depending on the operating system other configuration files might be checked for configuration of the virtual console as well, however only
       as fallback.

OPTIONS

       The following options are understood:

       KEYMAP=, KEYMAP_TOGGLE=
	   Configures the key mapping table of for they keyboard.  KEYMAP= defaults to us if not set. The KEYMAP_TOGGLE= can be used to configured
	   a second toggle keymap and is by default unset.

       FONT=, FONT_MAP=, FONT_UNIMAP=
	   Configures the console font, the console map and the unicode font map.  FONT= defaults to latarcyrheb-sun16.

EXAMPLE

       Example 1. German keyboard and console

       /etc/vconsole.conf:

	   KEYMAP=de-latin1
	   FONT=latarcyrheb-sun16

SEE ALSO

       systemd(1), loadkeys(1), setfont(8), locale.conf(5)

AUTHOR

       Lennart Poettering <lennart@poettering.net>
	   Developer

systemd 							    10/07/2013							  VCONSOLE.CONF(5)