Fill in missing hours and interpolate values using awk. Post: 302984447

Sponsored Content

Top Forums UNIX for Beginners Questions & Answers Fill in missing hours and interpolate values using awk. Post 302984447 by RudiC on Wednesday 26th of October 2016 05:03:36 AM

10-26-2016

Registered User

How about

Code:

awk -F, '
NR > 1 &&
$4 > L4+100     {CNT4 = ($4 - L4) / 100
                 STP5 = ($5 - L5) / CNT4
                 for (i=1; i<=CNT4; i++)        {$4 = L4 + 100 * i
                                                 $5 = sprintf ("%.1f", L5 + STP5 * i)
                                                 if (i < CNT4) print
                                                }

                }
                {L4 = $4
                 L5 = $5
                 print
                }
' OFS="," CONVFMT="%.0f" file
40754,35.6931,51.3092,201610160700,21.0
40754,35.6931,51.3092,201610160800,23.0
40754,35.6931,51.3092,201610160900,24.0
40754,35.6931,51.3092,201610161000,24.0
40754,35.6931,51.3092,201610161100,24.3
40754,35.6931,51.3092,201610161200,24.7
40754,35.6931,51.3092,201610161300,25.0
40754,35.6931,51.3092,201610161400,23.0
40754,35.6931,51.3092,201610161500,22.0

Note: it doesn't allow for crossing midnight.

This User Gave Thanks to RudiC For This Post:

RudiC

View Public Profile for RudiC

Find all posts by RudiC

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Fill in missing numbers in range

I need to edit a list of numbers on the following form: 1 1.0 2 1.4 5 2.1 7 1.9 I want: 1 1.0 2 1.4 3 0.0 4 0.0 5 2.1 6 0.0 7 1.9 (i want to add the missing number in column 1 together with 0.0 in column 2). I guess it is rather trivial but i didn't even manage to read column...

2. Shell Programming and Scripting

fill in missing columns

It can't be that hard, but I just can't figure it out: I have file like: File Sub-brick M_1 S_1 M_2 S_2 M_4 S_4 ... xxx 1 214 731 228 621 132 578 ... and would like to get 0 0 where M_3 S_3 is missing xxx 1 214 731 228 621 0 0 132 578 ... I wrote following script, but can't figure out...

3. Shell Programming and Scripting

Fill the values between -500 to 500 -awk

input -200 2.4 0 2.6 30 2.8 output -500 0 -499 0 -488 0 .......... .......... .... -200 2.4 .... ... 0 2.6

4. Shell Programming and Scripting

Fill missing numbers in second column with zeros

Hi All, I have 100 files with names like this: 1.dat, 2.dat, 3.dat until 100.dat. My dat files look like this: 42323 0 438939 1 434 0 0.9383 3434 120.23 3 234 As you can see in the second column, some numbers are missing. I want to fill those missing places with 0's in all...

5. Shell Programming and Scripting

Fill missing values with 2

Hi All, I have 100 .txt files which look like this: 3 4 5 6 7 Now, some files have some numbers missing in them and they look like this: 4 5 6

6. Shell Programming and Scripting

Fill in missing Data

hello everyone, I have a task to input missing data into a file. example of my data below: Wed Feb 01 09:00:02 EST 2012,,,0.4,0.3,,0.3,,0.3,,0.5,,0.3,,,0.4,0.3, Wed Feb 01 09:00:11 EST 2012,,,,,,,0.2,,,,,,,,,, Wed Feb 01 09:00:22 EST...

7. Shell Programming and Scripting

Need help looking for missing hours.

I have a file that should cover a days worth of stats, at the beginning of each 15 minute report I have a unique header that looks like the below example. The "0000" and "0015" will change in the header line to show which 15 Minute interval the report is covering and of course from day to day the...

8. Shell Programming and Scripting

Fill in missing rows with zero to have uniform table

Hello, I have two files of same structure except some rows are missing randomly in each file. How do I fill the missing rows to have the exact ID column (S01 ~ S96) and rest columns filled with "0" with awk? The purpose of this step is to join the two files side by side. The closest thread is...

9. Shell Programming and Scripting

Fill in missing values

Hi, I have a data sample as shown below. I want to fill in the left column so that the line will be continuous. For example, between 1 and 5 should be 2,3,4. And corresponding values in the right column will be 0. Thus the expected data should look like that: 1 1 1 10 1 2 1 3 1 5 1 6 2 0...

LEARN ABOUT CENTOS

gsl-randist

GSL-RANDIST(1)						      General Commands Manual						    GSL-RANDIST(1)

NAME

       gsl-randist - generate random samples from various distributions

SYNOPSYS

       gsl-randist seed n DIST param1 param2 [..]

DESCRIPTION

       gsl-randist  is a demonstration program for the GNU Scientific Library.	It generates n random samples from the distribution DIST using the
       distribution parameters param1, param2, ...

EXAMPLE

       Here is an example.  We generate 10000 random samples from a Cauchy distribution with a width of 30 and histogram them over the range  -100
       to 100, using 200 bins.

	    gsl-randist 0 10000 cauchy 30 | gsl-histogram -100 100 200 > histogram.dat

       A  plot	of  the  resulting histogram will show the familiar shape of the Cauchy distribution with fluctuations caused by the finite sample
       size.

	    awk '{print $1, $3 ; print $2, $3}' histogram.dat | graph -T X

SEE ALSO

       gsl(3), gsl-histogram(1).

AUTHOR

       gsl-randist was written by James Theiler and Brian Gough.  Copyright 1996-2000; for copying conditions see the GNU General Public Licence.

       This manual page was added by the Dirk Eddelbuettel <edd@debian.org>, the Debian GNU/Linux maintainer for GSL.

GNU
																    GSL-RANDIST(1)