How to combine and insert missing consecutive numbers

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers How to combine and insert missing consecutive numbers - awk or script? Post 302809439 by jim mcnamara on Sunday 19th of May 2013 11:22:15 PM

05-20-2013

Registered User

Code:

awk 'FNR==1 {next} length($0)' file1 file2 |sort -n -k7 > tmp
awk 'BEGIN{dummy="--------      ------  ----    ----  ----  ----  "; n=0}
     FNR==1 {n=$(NF); 
             print "DATE          TIME    COL1    COL2  COL3  COL4   ID"
             print $0
             next}
            { while(++n < $(NF)) {print dummy, n}
              print $0
            } ' tmp > newfile

output:

Code:

$ cat newfile

DATE          TIME    COL1    COL2  COL3  COL4   ID
12/15/2013    1500    199     456   234   555    101
--------      ------  ----    ----  ----  ----   102
--------      ------  ----    ----  ----  ----   103
--------      ------  ----    ----  ----  ----   104
02/15/2013    1500    199     456   234   555    105
--------      ------  ----    ----  ----  ----   106
01/31/2013    1000    201     123   345   456    107
08/05/2013    1100    150     789   311   789    108
03/05/2013    1100    150     789   311   789    109
--------      ------  ----    ----  ----  ----   110
07/31/2013    1000    201     123   345   456    111
01/10/2013    0800    100     200   300   401    112
--------      ------  ----    ----  ----  ----   113
--------      ------  ----    ----  ----  ----   114
02/10/2013    0800    100     200   300   401    115

This User Gave Thanks to jim mcnamara For This Post:

jim mcnamara

View Public Profile for jim mcnamara

Find all posts by jim mcnamara

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

ksh/awk help - output missing numbers

Here is what I am trying to do: I have a list of numbers that I pulled from an awk command in a column like so: 1 3 4 7 8 I want to find which numbers in the list are missing out of a range. So let's say I want to find out from the list above which numbers are missing from the...

2. Shell Programming and Scripting

Script in SED and AWK so that it treats consecutive delimiters as one

Hi All, I am trying to cut to do a cut operation, but since there are seems to be more than one deltimiters in some occasion I am not able to get the exact field. Can you please provide an SED and AWK script for treating the source file in such a way that all consecutive delimiters are treated...

3. Shell Programming and Scripting

Insert missing field using perl,sed,awk

sample file (comma as field separators) MessageFlow,1,BusIntBatchMgr,a OOBEvent,1,BusIntBatchMgr,a TaskEvents,1,,a MTTrace,1,,a MTWarning,,1,a MessageFlow,1,Batch,a OOBEvent,1,Batch,a TaskEvents,1,,a EAISAPIdocWizard,1,BusIntMgr,a EAISAPBAPIWizard,1,BusIntMgr,a...

4. Shell Programming and Scripting

Print consecutive numbers in column2

Hi, I have an input file of the following style input.txt The 4000 at the end indicates the total no. of columns in that row. I would like to replace all -1s with consecutive 1 and 2 and print the whole line again. So, the output would be output.txt Thanks in advance.

5. Shell Programming and Scripting

Disruption of consecutive numbers

I do have a tab delimited file with the following format 200 46 201 67 204 89 205 98 206 89 208 890 210 23 .. ... 100's of rows I would like to output the missing consecutive number of the first column. The expected output will be:

6. Shell Programming and Scripting

Adding the corresponding values for every 5th consecutive numbers

Dear All, I have a file which is as follows: Input File: 231 100.1 233 99 235 200.9 238 80.1 239 90.2 240 77.0 243 99.5 245 16.20 246 13.55 247 11.8 249 13.7 250 99.6

7. Shell Programming and Scripting

Help with awk script to get missing numbers in column 1

Hello to all, I have show below a file separated by commas. In first column has numbers where the last number is 13. 1,4 2,6 3,7 5,2 6,5 7,5 8,65 9,10 11,78 13,2 What I want to know is which numbers are missing from 1 to 13 (in this case 13 is last number in column 1). My real...

8. UNIX for Dummies Questions & Answers

Sum every 3 consecutive numbers in a column

Dear All, I have a file with only one column. And I want to add every 3 consecutive numbers together and print the result. Input File: 21.1 10 10 55 11 99 10 8 4 Expected Output: 41.1

9. Shell Programming and Scripting

awk to insert missing string based on pattern in file

Using the file below, which will always have the first indicated by the digit after the - and last id in it, indicated by the digit after the -, I am trying to use awk to print the missing line or lines in file following the pattern of the previous line. For example, in the file below the next...

10. Shell Programming and Scripting

Check/print missing number in a consecutive range and remove duplicate numbers

Hi, In an ideal scenario, I will have a listing of db transaction log that gets copied to a DR site and if I have them all, they will be numbered consecutively like below. 1_79811_01234567.arc 1_79812_01234567.arc 1_79813_01234567.arc 1_79814_01234567.arc 1_79815_01234567.arc...

LEARN ABOUT CENTOS

dh_missing

DH_MISSING(1)							     Debhelper							     DH_MISSING(1)

NAME

       dh_missing - check for missing files

SYNOPSIS

       dh_missing [-Xitem] [--sourcedir=dir] [debhelperoptions]

DESCRIPTION

       dh_missing compares the list of installed files with the files in the source directory. If any of the files (and symlinks) in the source
       directory were not installed to somewhere, it will warn on stderr about that (--list-missing) or fail (--fail-missing).	Please note that
       without either of these options, dh_missing will silently do nothing.

       This may be useful if you have a large package and want to make sure that you don't miss installing newly added files in new upstream
       releases.

       Remember to test different kinds of builds (dpkg-buildpackage -A/-B/...) as you may experience varying results when only a subset of the
       packages are built.

FILES

       debian/not-installed
	   List the files that are deliberately not installed in any binary package.  Paths listed in this file are ignored by dh_missing.
	   However, it is not a method to exclude files from being installed by any of the debhelper tool.  If you want a tool to not install a
	   given file, please use its --exclude option (where available).

	   dh_missing will expand wildcards in this file (since debhelper 11.1).  Wildcards without matches will be ignored.

OPTIONS

       --list-missing
	   Warn on stderr about source files not installed to somewhere.

	   Note that files that are excluded from being moved via the -X option are not warned about.

	   This is the default in compat 12 and later.

       --fail-missing
	   This option is like --list-missing, except if a file was missed, it will not only list the missing files, but also fail with a nonzero
	   exit code.

SEE ALSO

       debhelper(7)

       This program is a part of debhelper.

AUTHOR

       Michael Stapelberg <stapelberg@debian.org>

11.1.6ubuntu2							    2018-05-10							     DH_MISSING(1)