Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Match on first and last columns and merge
Top Forums Shell Programming and Scripting Match on first and last columns and merge Post 302597603 by jacobs.smith on Friday 10th of February 2012 06:24:34 PM
Old 02-10-2012
Quote:
Originally Posted by agama
Your sample output doesn't quite match your logic, but I think this is what you had in mind:


Code:
awk '
    BEGIN {
          getline;       # seed with first record
        split( $0, prev, " " );
        min = $2;
        max = $3;
    }

    {
        if( prev[1] == $1 && prev[4] == $4 )    # prev matches next record; capture min/max
        {
            if( min > $2 )
                min = $2;
            if( max < $3 )
                max = $3;
        }
        else      #prev does not match, put out min/max from the last set of records
        {
            print prev[1], min, max, prev[4];
            min = $2;
            max = $3;
        }
        split( $0, prev, " " )     # capture this rec for next go round
    }

    END {
          print prev[1], min, max,  prev[4];    # print out the last set
    }
' input-file


Thanks agama. I edited my output after u mentioned the error. Your code does exactly what I needed.

Thanks once again Agama.

Thanks to this forum.

---------- Post updated at 06:24 PM ---------- Previous update was at 06:22 PM ----------

Quote:
Originally Posted by agama
Your sample output doesn't quite match your logic, but I think this is what you had in mind:


Code:
awk '
    BEGIN {
          getline;       # seed with first record
        split( $0, prev, " " );
        min = $2;
        max = $3;
    }

    {
        if( prev[1] == $1 && prev[4] == $4 )    # prev matches next record; capture min/max
        {
            if( min > $2 )
                min = $2;
            if( max < $3 )
                max = $3;
        }
        else      #prev does not match, put out min/max from the last set of records
        {
            print prev[1], min, max, prev[4];
            min = $2;
            max = $3;
        }
        split( $0, prev, " " )     # capture this rec for next go round
    }

    END {
          print prev[1], min, max,  prev[4];    # print out the last set
    }
' input-file

Thanks for a lovely code with comments too.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merge columns

Hi all - I have a file like below: A: A1,A2,A3,A4 B: 1,2,3,4 C: z,y,x,w .... This format repeats The output should come in a single line merging the first line field with the other two rows: A1_1 A1_z A2_2 A2_y A3_3 A3_x A4_4 A4_w Could anyone help with some directions ... (4 Replies)
Discussion started by: deepakgang
4 Replies

2. Shell Programming and Scripting

AWK to match and merge data from 2 files into 1.

Hello, hopefully this is an easy on for the AWK guru's out there. I'm having some trouble figuring out how to match+merge data in 2 files into 1 single report. I've got my 2 files filtered and delimited, just need to MATCH $3 in file1 to $1 in file2, then put $0 from File1 and $2+$3 from File2... (6 Replies)
Discussion started by: right_coaster
6 Replies

3. Shell Programming and Scripting

Match on columns and replace other columns

Hi Friends, I have the following input file cat input chr1 100 200 0.1 0.2 na 1 na nd chr1 105 200 0.1 0.2 1 1 na 98 chr1 110 290 nf 1 na nd na 1 chr2 130 150 12 3 na 1 na 1 chr3 450 600 nf nf na 10 na nd chr4 300 330 1 1 10 11 23 34 My requirement is 1. If $6 is na make $7 nd and... (2 Replies)
Discussion started by: jacobs.smith
2 Replies

4. Shell Programming and Scripting

Evaluate 2 columns, add sum IF two columns match on two rows

Hi all, I know this sounds suspiciously like a homework course; but, it is not. My goal is to take a file, and match my "ID" column to the "Date" column, if those conditions are true, add the total number of minutes worked and place it in this file, while not printing the original rows that I... (6 Replies)
Discussion started by: mtucker6784
6 Replies

5. Shell Programming and Scripting

awk match and merge with 2 files

Dear Awk experts! I have been trying to get a one liner for a match and merge operation, but having difficulties as I'm an awk newb. I always get stuck on the match and merge with 2 files. I have 2 files as follows: File 1: field 1,field 2,field 3,field 4,field 5,field 6,field 7,field... (6 Replies)
Discussion started by: landossa
6 Replies

6. Shell Programming and Scripting

Request: How to Parse dynamic SQL query to pad extra columns to match the fixed number of columns

Hello All, I have a requirement in which i will be given a sql query as input in a file with dynamic number of columns. For example some times i will get 5 columns, some times 8 columns etc up to 20 columns. So my requirement is to generate a output query which will have 20 columns all the... (7 Replies)
Discussion started by: vikas_trl
7 Replies

7. UNIX for Dummies Questions & Answers

Merge rows into one if first 2 columns match

Hi, I wanted to merge the content and below is input and required output info. Input: /hello,a,r /hello,a,L /hello,a,X /hi,b,v /hi,b,c O/p: /hello,a,r:L:X /hi,v,:v:c Use code tags, thanks. (6 Replies)
Discussion started by: ankitas
6 Replies

8. Shell Programming and Scripting

Merge lines based on match

I am trying to merge two lines to one based on some matching condition. The file is as follows: Matches filter: 'request ', timestamp, <HTTPFlow request=<GET: Matches filter: 'request ', timestamp, <HTTPFlow request=<GET: Matches filter: 'request ', timestamp, <HTTPFlow ... (8 Replies)
Discussion started by: jamie_123
8 Replies

9. UNIX for Beginners Questions & Answers

Match and Merge two file

Hi All, I have two file . I need to merge both file based on a match. File 1: Column1 column2 column3 column4 File 2: column3 column5 I need to combine the two file based on match , Which in my case is column3 and combine the file as below Combined file Column1 (10 Replies)
Discussion started by: arunkumar_mca
10 Replies

10. UNIX for Beginners Questions & Answers

Data match 2 files based on first 2 columns matching only and join if match

Hi, i have 2 files , the data i need to match is in masterfile and i need to pull out column 3 from master if column 1 and 2 match and output entire row to new file I have tried with join and awk and i keep getting blank outputs or same file is there an easier way than what i am... (4 Replies)
Discussion started by: axis88
4 Replies

LEARN ABOUT OSX

prev

PREV(1) 							     [nmh-1.5]								   PREV(1)

NAME

       prev - show the previous message

SYNOPSIS

       prev [+folder] [-showproc program] [-showmimeproc program] [-header | -noheader] [-checkmime | -nocheckmime] [switches for showproc or
	    showmimeproc] [-version] [-help]

DESCRIPTION

       Prev performs a show on the previous message in the specified (or current) folder.  Like show, it passes any switches  on  to  the  program
       named by showproc or showmimeproc, which is called to list the message.	This command is almost exactly equivalent to "show prev".  Consult
       the manual entry for show(1) for all the details.

FILES

       $HOME/.mh_profile	  The user profile

PROFILE COMPONENTS

       Path:		    To determine the user's nmh directory
       Current-Folder:	    To find the default current folder
       showproc:	    Program to show non-MIME messages
       showmimeproc:	    Program to show MIME messages

SEE ALSO

       show(1), next(1)

DEFAULTS

       `+folder' defaults to the current folder
       `-checkmime'
       `-header'

CONTEXT

       If a folder is specified, it will become the current folder.  The message that is shown (i.e.,  the  previous  message  in  sequence)  will
       become the current message.

BUGS

       prev  is  really  a link to the show program.  As a result, if you make a link to prev and that link is not called prev, your link will act
       like show instead.  To circumvent this, add a profile-entry for the link to your nmh profile and add the argument prev to the entry.

MH.6.8								   11 June 2012 							   PREV(1)
All times are GMT -4. The time now is 02:43 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy