Fill in missing Data Post: 302609839

Sponsored Content

Top Forums Shell Programming and Scripting Fill in missing Data Post 302609839 by Nolph on Tuesday 20th of March 2012 01:30:18 PM

03-20-2012

Registered User

Fill in missing Data

hello everyone,

I have a task to input missing data into a file. example of my data below:

Code:

Wed Feb 01 09:00:02 EST 2012,,,0.4,0.3,,0.3,,0.3,,0.5,,0.3,,,0.4,0.3,
Wed Feb 01 09:00:11 EST 2012,,,,,,,0.2,,,,,,,,,,
Wed Feb 01 09:00:22 EST 2012,0.7,0.4,0.5,0.4,0.3,0.4,,0.4,0.5,0.6,0.3,0.4,,0.1,0.5,0.4,
Wed Feb 01 09:00:42 EST 2012,0.9,1.0,0.6,0.5,,,,,,,,0.5,,,,,
Wed Feb 01 09:01:02 EST 2012,1.0,0.8,,,,0.6,,,,,,0.6,,,,,
Wed Feb 01 09:01:22 EST 2012,,0.7,0.7,0.6,0.5,,,0.5,,,,,,,,,
Wed Feb 01 09:01:42 EST 2012,0.9,0.6,0.6,0.5,,,,0.4,0.7,0.7,0.4,0.5,,,0.6,0.5,
Wed Feb 01 09:02:02 EST 2012,0.8,,0.5,0.4,,,,1.1,,,0.3,0.4,,,,,
Wed Feb 01 09:02:22 EST 2012,0.9,,,,,,,0.7,,0.6,,,,,,,

This is what the data looks like in shell.

Each , is a space or empty cell. What i need to do is go through each column one at a time because theres thousands of lines and interpret the data and enter it.

Example:

In the first column is the first server reading:
0.7
0.9
1
<empty>
0.9
0.8

So it will go from the 1 to 0.9 and figure out the value that is missing. To get an accurate value you need to add +1 to the calculation instead of haveing just 1. (# of empty cells)

Nolph

View Public Profile for Nolph

Find all posts by Nolph

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Fill in missing numbers in range

I need to edit a list of numbers on the following form: 1 1.0 2 1.4 5 2.1 7 1.9 I want: 1 1.0 2 1.4 3 0.0 4 0.0 5 2.1 6 0.0 7 1.9 (i want to add the missing number in column 1 together with 0.0 in column 2). I guess it is rather trivial but i didn't even manage to read column...

2. Shell Programming and Scripting

fill in missing columns

It can't be that hard, but I just can't figure it out: I have file like: File Sub-brick M_1 S_1 M_2 S_2 M_4 S_4 ... xxx 1 214 731 228 621 132 578 ... and would like to get 0 0 where M_3 S_3 is missing xxx 1 214 731 228 621 0 0 132 578 ... I wrote following script, but can't figure out...

3. Shell Programming and Scripting

Fill missing numbers in second column with zeros

Hi All, I have 100 files with names like this: 1.dat, 2.dat, 3.dat until 100.dat. My dat files look like this: 42323 0 438939 1 434 0 0.9383 3434 120.23 3 234 As you can see in the second column, some numbers are missing. I want to fill those missing places with 0's in all...

4. Shell Programming and Scripting

Fill missing values with 2

Hi All, I have 100 .txt files which look like this: 3 4 5 6 7 Now, some files have some numbers missing in them and they look like this: 4 5 6

5. Shell Programming and Scripting

fill in last column of data

Hello, I am fairly new to awk, and I have the following problem. My file has missing data in the last column, and the program I am pre-processing this file for cannot interpret correctly shortened rows (it just wraps the data around). Is there a way to force awk to create the same...

6. Shell Programming and Scripting

Fill data if number range is given

Hi I want to get all numbers if number range is given as input. Eg: INPUT FILE 100-105 107 108-112 OUTPUT REQUIRED: 100 101 102 103 104 105 107 108 109 110 111 112 How can I do it using shell? :confused: Thanks in advance.

7. Shell Programming and Scripting

Fill in missing rows with zero to have uniform table

Hello, I have two files of same structure except some rows are missing randomly in each file. How do I fill the missing rows to have the exact ID column (S01 ~ S96) and rest columns filled with "0" with awk? The purpose of this step is to join the two files side by side. The closest thread is...

8. UNIX for Beginners Questions & Answers

Fill in missing hours and interpolate values using awk.

I have a time series data like this 40754,35.6931,51.3092,201610160700,21.0 40754,35.6931,51.3092,201610160800,23.0 40754,35.6931,51.3092,201610160900,24.0 40754,35.6931,51.3092,201610161000,24.0 40754,35.6931,51.3092,201610161300,25.0 40754,35.6931,51.3092,201610161400,23.0...

9. Shell Programming and Scripting

Fill in missing values

Hi, I have a data sample as shown below. I want to fill in the left column so that the line will be continuous. For example, between 1 and 5 should be 2,3,4. And corresponding values in the right column will be 0. Thus the expected data should look like that: 1 1 1 10 1 2 1 3 1 5 1 6 2 0...

LEARN ABOUT CENTOS

dlacon

dlacon.f(3)							      LAPACK							       dlacon.f(3)

NAME

       dlacon.f -

SYNOPSIS

   Functions/Subroutines
       subroutine dlacon (N, V, X, ISGN, EST, KASE)
	   DLACON estimates the 1-norm of a square matrix, using reverse communication for evaluating matrix-vector products.

Function/Subroutine Documentation
   subroutine dlacon (integerN, double precision, dimension( * )V, double precision, dimension( * )X, integer, dimension( * )ISGN, double
       precisionEST, integerKASE)
       DLACON estimates the 1-norm of a square matrix, using reverse communication for evaluating matrix-vector products.

       Purpose:

	    DLACON estimates the 1-norm of a square, real matrix A.
	    Reverse communication is used for evaluating matrix-vector products.

       Parameters:
	   N

		     N is INTEGER
		    The order of the matrix.  N >= 1.

	   V

		     V is DOUBLE PRECISION array, dimension (N)
		    On the final return, V = A*W,  where  EST = norm(V)/norm(W)
		    (W is not returned).

	   X

		     X is DOUBLE PRECISION array, dimension (N)
		    On an intermediate return, X should be overwritten by
			  A * X,   if KASE=1,
			  A**T * X,  if KASE=2,
		    and DLACON must be re-called with all the other parameters
		    unchanged.

	   ISGN

		     ISGN is INTEGER array, dimension (N)

	   EST

		     EST is DOUBLE PRECISION
		    On entry with KASE = 1 or 2 and JUMP = 3, EST should be
		    unchanged from the previous call to DLACON.
		    On exit, EST is an estimate (a lower bound) for norm(A).

	   KASE

		     KASE is INTEGER
		    On the initial call to DLACON, KASE should be 0.
		    On an intermediate return, KASE will be 1 or 2, indicating
		    whether X should be overwritten by A * X  or A**T * X.
		    On the final return from DLACON, KASE will again be 0.

       Author:
	   Univ. of Tennessee

	   Univ. of California Berkeley

	   Univ. of Colorado Denver

	   NAG Ltd.

       Date:
	   September 2012

       Contributors:
	   Nick Higham, University of Manchester.
	    Originally named SONEST, dated March 16, 1988.

       References:
	   N.J. Higham, 'FORTRAN codes for estimating the one-norm of
	     a real or complex matrix, with applications to condition estimation', ACM Trans. Math. Soft., vol. 14, no. 4, pp. 381-396, December
	   1988.

       Definition at line 116 of file dlacon.f.

Author
       Generated automatically by Doxygen for LAPACK from the source code.

Version 3.4.2							  Tue Sep 25 2012						       dlacon.f(3)