Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Reject the record if the record in the next line does not begin with 2.

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Reject the record if the record in the next line does not begin with 2.
# 1  
Old 10-16-2011
Reject the record if the record in the next line does not begin with 2.
Hi,
I have a input file with the following entries:

Code:
1one
2two
3three
1four
2five
3six
1seven
1eight
1nine
2ten
2eleven
2twelve
1thirteen
2fourteen

The output should be:

Code:
1one
2two
3three
1four
2five
3six 
1nine
2ten
1thirteen
2fourteen

The record that begins with 1 should have the next record to begin with 2 or 3 else reject that record.
The record that begins with 1 should have the next record to begin with 2 and if there are many records starting with 2, consider the first record only.
The rejected records should be captured in a file and the valid records in another file.
The requirement is this needs to be done in unix shell scripting. Please help me out in this.
Last edited by radoulov; 10-16-2011 at 10:34 AM.. Reason: Code tags!
# 2  
Old 10-16-2011
And what did you try so far?
# 3  
Old 10-16-2011
I have this requirement in ETL DatStage, but I was not able to derive this requirement so trying to split the records and save in a file through unix scripting and then this file will be utlized in datastage. Please help me in unix scripting as I dont have much knowledge on scripting
# 4  
Old 10-16-2011
Code:
$ cat f1
1one
2two
3three
1four
2five
3six
1seven
1eight
1nine
2ten
2eleven
2twelve
1thirteen
2fourteen

Code:
$ nawk '{x=y;y=$0}y~/^2/&&x~/^1/{print x RS y;x=y;getline y}y~/^3/{print y;x=y;getline y;}' f1
1one
2two
3three
1four
2five
3six
1nine
2ten
1thirteen
2fourteen
$

This User Gave Thanks to ctsgnb For This Post:
supchand
# 5  
Old 10-16-2011
Thanks a million. this code is working. Is it possible to capture the rejected records in another file.
# 6  
Old 10-16-2011
This code will generate two files: ok and rejected.

Code:
awk > ok 'END {
  for (i = 0; ++i <= NR;) {
    if (i in r && r[i] ~ /^1/ && i + 1 in r && r[i + 1] ~ /^2/) {
      print r[i] RS r[i + 1]
      delete r[i]; delete r[i + 1]
      if (i + 2 in r && r[i + 2] ~ /^3/) {
        print r[i + 2]; delete r[i + 2]
        }
      }
    if (i in r ) print r[i] > "rejected"        
    }
  }
{ r[NR] = $0 }' infile

Last edited by radoulov; 10-16-2011 at 06:07 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need code for updating second record to first record in shell scripting

Hi,, I have requirement that i need to get DISTINCT values from a table and if there are two records i need to update it to one record and then need to submit INSERT statements by using the updated value as a parameter. Here is the example follows.. SELECT DISTINCT ID FROM OFFER_GROUP WHERE... (1 Reply)
Discussion started by: Samah
1 Replies

2. Shell Programming and Scripting

Replace a string for every record after the 1st record

I have data coming in the below format for each record <?xml version="1.0" encoding="UTF-8" standalone="no"?><test_sox xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><testdetials>....</test_sox> <?xml version="1.0" encoding="UTF-8" standalone="no"?><test_sox... (8 Replies)
Discussion started by: dsravanam
8 Replies

3. Shell Programming and Scripting

Extract timestamp from first record in xml file and it checks if not it will replace first record

I have test.xml <emp><id>101</id><name>AAA</name><date>06/06/14 1811</date></emp> <Join><id>101</id><city>london</city><date>06/06/14 2011</date></join> <Join><id>101</id><city>new york</city><date>06/06/14 1811</date></join> <Join><id>101</id><city>sydney</city><date>06/06/14... (2 Replies)
Discussion started by: vsraju
2 Replies

4. Shell Programming and Scripting

How to compare current record,with next and previous record in awk without using array?

Hi! all can any one tell me how to compare current record of column with next and previous record in awk without using array my case is like this input.txt 0 32 1 26 2 27 3 34 4 26 5 25 6 24 9 23 0 32 1 28 2 15 3 26 4 24 (7 Replies)
Discussion started by: Dona Clara
7 Replies

5. Shell Programming and Scripting

Reject the record if the record in the next line does not satisfy the pattern

Hi, I have a input file with the following entries: 1one 2two 3three 1four 2five 3six 1seven 1eight 1nine 2ten The output should be 1one 2two 3three 1four 2five 3six (2 Replies)
Discussion started by: supchand
2 Replies

6. UNIX for Dummies Questions & Answers

922’ Code does not exist on ‘03’ Record, ‘901’ Code will be there instead, move ‘03’ Record to Outpu

01,011600033,011600033,110516,0834,2,90,,2/ 02,011600033,011103093,1,110317,0834,,2/ 03,105581,,015,+00000416418,,,901,+00000000148,,,922,+000000 00354,,/ 03,113806,,015,+00000559618,,,901,+00000000096,,,922,+000000 00621,,/ 88,902,+0000000025218,,/... (1 Reply)
Discussion started by: sgoud
1 Replies

7. Shell Programming and Scripting

Testing Next Record before processing is done on that Record

I am trying to see if there is a way in awk to test the next record before processing. All I am trying to do is see if the next line equal something then turn a flag off. Example: Problem Cron IneedThis KeyOnThis somemoredata somemoredata Cron somemoredata somemoredata IneedThis... (7 Replies)
Discussion started by: timj123
7 Replies

8. UNIX for Advanced & Expert Users

Print Full record and substring in that record

I have i got a requirement like below. I have input file which contains following fixed width records. 00000000000088500232007112007111 I need the full record and concatenated with ~ and characters from 1to 5 and concatenated with ~ and charactes from 10 to 15 The out put will be like... (1 Reply)
Discussion started by: ukatru
1 Replies

9. UNIX for Dummies Questions & Answers

how to read record by record from a file in unix

Hi guys, i have a big file with the following format.This includes header(H),detail(D) and trailer(T) information in the file.My problem is i have to search for the character "6h" at 14 th and 15 th position in all the records .if it is there i have to write all those records into a... (1 Reply)
Discussion started by: raoscb
1 Replies

10. Shell Programming and Scripting

splitting a record and adding a record to a file

Hi, I am new to UNIX scripting and woiuld appreicate your help... Input file contains only one (but long) record: aaaaabbbbbcccccddddd..... Desired file: NEW RECORD #new record (hardcoded) added as first record - its length is irrelevant# aaaaa bbbbb ccccc ddddd ... ... ... (1 Reply)
Discussion started by: rsolap
1 Replies
Login or Register to Ask a Question