How to combine and insert missing consecutive numbers

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers How to combine and insert missing consecutive numbers - awk or script? Post 302809439 by jim mcnamara on Sunday 19th of May 2013 11:22:15 PM

05-20-2013

Registered User

Code:

awk 'FNR==1 {next} length($0)' file1 file2 |sort -n -k7 > tmp
awk 'BEGIN{dummy="--------      ------  ----    ----  ----  ----  "; n=0}
     FNR==1 {n=$(NF); 
             print "DATE          TIME    COL1    COL2  COL3  COL4   ID"
             print $0
             next}
            { while(++n < $(NF)) {print dummy, n}
              print $0
            } ' tmp > newfile

output:

Code:

$ cat newfile

DATE          TIME    COL1    COL2  COL3  COL4   ID
12/15/2013    1500    199     456   234   555    101
--------      ------  ----    ----  ----  ----   102
--------      ------  ----    ----  ----  ----   103
--------      ------  ----    ----  ----  ----   104
02/15/2013    1500    199     456   234   555    105
--------      ------  ----    ----  ----  ----   106
01/31/2013    1000    201     123   345   456    107
08/05/2013    1100    150     789   311   789    108
03/05/2013    1100    150     789   311   789    109
--------      ------  ----    ----  ----  ----   110
07/31/2013    1000    201     123   345   456    111
01/10/2013    0800    100     200   300   401    112
--------      ------  ----    ----  ----  ----   113
--------      ------  ----    ----  ----  ----   114
02/10/2013    0800    100     200   300   401    115

This User Gave Thanks to jim mcnamara For This Post:

jim mcnamara

View Public Profile for jim mcnamara

Find all posts by jim mcnamara

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

ksh/awk help - output missing numbers

Here is what I am trying to do: I have a list of numbers that I pulled from an awk command in a column like so: 1 3 4 7 8 I want to find which numbers in the list are missing out of a range. So let's say I want to find out from the list above which numbers are missing from the...

2. Shell Programming and Scripting

Script in SED and AWK so that it treats consecutive delimiters as one

Hi All, I am trying to cut to do a cut operation, but since there are seems to be more than one deltimiters in some occasion I am not able to get the exact field. Can you please provide an SED and AWK script for treating the source file in such a way that all consecutive delimiters are treated...

3. Shell Programming and Scripting

Insert missing field using perl,sed,awk

sample file (comma as field separators) MessageFlow,1,BusIntBatchMgr,a OOBEvent,1,BusIntBatchMgr,a TaskEvents,1,,a MTTrace,1,,a MTWarning,,1,a MessageFlow,1,Batch,a OOBEvent,1,Batch,a TaskEvents,1,,a EAISAPIdocWizard,1,BusIntMgr,a EAISAPBAPIWizard,1,BusIntMgr,a...

4. Shell Programming and Scripting

Print consecutive numbers in column2

Hi, I have an input file of the following style input.txt The 4000 at the end indicates the total no. of columns in that row. I would like to replace all -1s with consecutive 1 and 2 and print the whole line again. So, the output would be output.txt Thanks in advance.

5. Shell Programming and Scripting

Disruption of consecutive numbers

I do have a tab delimited file with the following format 200 46 201 67 204 89 205 98 206 89 208 890 210 23 .. ... 100's of rows I would like to output the missing consecutive number of the first column. The expected output will be:

6. Shell Programming and Scripting

Adding the corresponding values for every 5th consecutive numbers

Dear All, I have a file which is as follows: Input File: 231 100.1 233 99 235 200.9 238 80.1 239 90.2 240 77.0 243 99.5 245 16.20 246 13.55 247 11.8 249 13.7 250 99.6

7. Shell Programming and Scripting

Help with awk script to get missing numbers in column 1

Hello to all, I have show below a file separated by commas. In first column has numbers where the last number is 13. 1,4 2,6 3,7 5,2 6,5 7,5 8,65 9,10 11,78 13,2 What I want to know is which numbers are missing from 1 to 13 (in this case 13 is last number in column 1). My real...

8. UNIX for Dummies Questions & Answers

Sum every 3 consecutive numbers in a column

Dear All, I have a file with only one column. And I want to add every 3 consecutive numbers together and print the result. Input File: 21.1 10 10 55 11 99 10 8 4 Expected Output: 41.1

9. Shell Programming and Scripting

awk to insert missing string based on pattern in file

Using the file below, which will always have the first indicated by the digit after the - and last id in it, indicated by the digit after the -, I am trying to use awk to print the missing line or lines in file following the pattern of the previous line. For example, in the file below the next...

10. Shell Programming and Scripting

Check/print missing number in a consecutive range and remove duplicate numbers

Hi, In an ideal scenario, I will have a listing of db transaction log that gets copied to a DR site and if I have them all, they will be numbered consecutively like below. 1_79811_01234567.arc 1_79812_01234567.arc 1_79813_01234567.arc 1_79814_01234567.arc 1_79815_01234567.arc...

LEARN ABOUT DEBIAN

mrtg-ping-probe

MRTG-PING-PROBE(1)					      General Commands Manual						MRTG-PING-PROBE(1)

NAME

       mrtg-ping-probe - ping probe module for Multi Router Traffic Grapher

DESCRIPTION

       mrtg-ping-probe is a ping probe module for MRTG 2.x.  It is used to monitor the round trip time and packet loss to networked devices.  MRTG
       uses the output of mrtg-ping-probe to generate graphs visualizing minimum and maximum round trip times or packet loss.

       mrtg-ping-probe is not run directly, but is called by MRTG as a helper when it needs to determine ping time to a host.

       Act responsibly: do not use mrtg-ping-probe to ping devices without the owner's permission.  Just imagine if 10,000 people decided to  ping
       your hosts!  mrtg-ping-probe is meant to be used within your network to get round trip time performance figures for your network.

OPTIONS

       To  use	mrtg-ping-probe you need to configure MRTG to call it from within the definition of a target host. This is done in the MRTG config
       file, which is usually /etc/mrtg.conf.

       Here's an example snippet: change the target name and IP address to suit your needs.

       Target[your.target.ping]: `/usr/bin/mrtg-ping-probe 123.456.789.123`
       SetEnv[your.target.ping]: MRTG_INT_IP="123.456.789.123" MRTG_INT_DESCR="ping"
       MaxBytes[your.target.ping]: 100
       AbsMax[your.target.ping]: 200
       Options[your.target.ping]: gauge, growright
       YLegend[your.target.ping]: ping time (ms)
       ShortLegend[your.target.ping]: ms
       Legend1[your.target.ping]: Maximum Round Trip Time in ms
       Legend2[your.target.ping]: Minimum Round Trip Time in ms
       Legend3[your.target.ping]: Maximal 5 Minute Maximum Round Trip Time in ms
       Legend4[your.target.ping]: Maximal 5 Minute Minimum Round Trip Time in ms
       LegendI[your.target.ping]: &nbsp;Max:
       LegendO[your.target.ping]: &nbsp;Min:

       Pay close attention to the backticks in the first line which tell MRTG to execute the nominated external program. Note also that  you  need
       to use the "gauge" option, since the results of subsequent ping probes are independant values and not an incrementing counter.

SEE ALSO

       mrtg(1).

       The latest release of mrtg-ping-probe can be found on the web at http://pwo.de/projects/mrtg/

AUTHOR

       This manual page was written by Jonathan Oxer <jon@debian.org>, for the Debian project (but may be used by others).

								  April 14, 2003						MRTG-PING-PROBE(1)