Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Adding Fields to the file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Adding Fields to the file
# 1  
Old 12-17-2012
Adding Fields to the file
Hi All,

I get a file on weekly basis from client. I need to write a script which make sure the file should have 20 columns after the first column. If not then the script should add the remaining columns and default them to space(except for 2nd and 3rd). and at the same time the script should check the second and the third column if null then default those to ND.

Sample Input file:
Code:
0000000000||3|MAIL ORDER|MAIL ORDER DATA|N/A|MAIL ORDER|N/A|
0000010001|CASH||CASH|CASH|N/A|CASH|N/A|
0000020002|FFS MED|2|AL MEDICAID|MEDICAID|N/A|AL MEDICAID|N/A|"Tier2,PA|NPF"

Sample Outfile Required:
Code:
0000000000|ND|3|MAIL ORDER|MAIL ORDER DATA|N/A|MAIL ORDER|N/A| | | | | | | | | | | |
0000010001|CASH|ND|CASH|CASH|N/A|CASH|N/A| | | | | | | | | | | |
0000020002|FFS MED|2|AL MEDICAID|MEDICAID|N/A|AL MEDICAID|N/A|"Tier2,PA|NPF"| | | | | | | | | | |

Any help appreciated. Thanks in advance Smilie
# 2  
Old 12-17-2012
Hi Arun,

Please code tags. don't use icode tags. icode tags are used for displaying in the line itself like this...

Try

Code:
awk -F\| '{for(i=(NF+1);i<=20;i++){$i=" "};$2=$2?$2:"ND";$3=$3?$3:"ND";}1' OFS="|" file

Last edited by pamu; 12-19-2012 at 03:09 AM..
# 3  
Old 12-17-2012
Wow Pamu .. U seem to be having answer for every question.. grreatttt..
And thanks very much. It just worked fine for me. I verified from all scenarios and it was just fine cool!!!!!Smilie.
# 4  
Old 12-17-2012
There's a couple of other ways you can do this in awk. The shorter one I forget, but there's this:

Code:
$ awk 'BEGIN {FS=OFS="|"} NF<19{$19=FS}1' file
0000000000||3|MAIL ORDER|MAIL ORDER DATA|N/A|MAIL ORDER|N/A||||||||||||
0000010001|CASH||CASH|CASH|N/A|CASH|N/A||||||||||||
0000020002|FFS MED|2|AL MEDICAID|MEDICAID|N/A|AL MEDICAID|N/A|"Tier2,PA|NPF"||||||||||

# 5  
Old 12-17-2012
Scott,

Would this satisfy the condition "the script should check the second and the third column if null then default those to ND" ?? Smilie

I guess not.
# 6  
Old 12-17-2012
Um. Err.

Maybe I should have read the whole question!

I like pamu's solution Smilie

Thanks!
# 7  
Old 12-18-2012
I like concept of pamu's solution also, but it has a few problems:
  1. If there is an empty line or a line with only one field, fields 2 and 3 will be set to a space; not "ND".
  2. If there is a line with three fields in the input file, field 3 will be set to a space no matter what it originally contained.
  3. If a line has four to twenty fields (inclusive), the contents of the last field present will be replaced by a space.
I think the following does what was requested:
Code:
awk 'BEGIN{FS = OFS = "|"}
{       if(NF == 0) $1 = " "
        $2 = $2 ? $2 : "ND"
        $3 = $3 ? $3 : "ND"
        for(i = NF+1; i <= 20; i++) $i = " "
        print
}' file

These 2 Users Gave Thanks to Don Cragun For This Post:
PikK45 Scott
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Adding to an array in an external file, and adding elements to it.

I have an array in an external file, "array.txt", which contains: char *testarray={"Zero", "One", "Two", "Three", "Four", "Five", "Six", "Seven", "Eight", "Nine"};I want to be able to add an element to this array, and have that element display, whenever I call it, without having to recompile... (29 Replies)
Discussion started by: ignatius
29 Replies

2. Shell Programming and Scripting

Adding ' in particular fields

I have a file with 4 columns a|b|c|d I need to add single quotes around field 2 and 3 I need it to be like a|'b'|'c'|d (5 Replies)
Discussion started by: dsravanam
5 Replies

3. Shell Programming and Scripting

Awk: adding fields after matching $1

Dear AWK-experts! I did get stuck in the task of combining files after matching fields, so I'm still awkward with learning AWK. There are 2 files: one containing 3 columns with ID, coding status, and score for long noncoding RNAs: file1 (1.txt) (>5000 lines) ... (12 Replies)
Discussion started by: kben
12 Replies

4. Shell Programming and Scripting

Adding fields to a file

Hi All, I have a file(Pipe Delimited) where i need to add a blank field before the last field and a blank field after the last field. Please help. I have provided below the sample input records and desired output. Sample Input: A0010000|Abilene TX A 1|A0010957|Dallas TX|A0010998|West|US... (5 Replies)
Discussion started by: Arun Mishra
5 Replies

5. Shell Programming and Scripting

Adding fields to file

Hi All, I have a file(Pipe Delimited) where i need to add a blank field before the last field and a blank field after the last field. Please help. I have provided below the sample input records and desired output. Code: Sample Input: A0010000|Abilene TX A 1|A0010957|Dallas... (0 Replies)
Discussion started by: Arun Mishra
0 Replies

6. Homework & Coursework Questions

regarding adding fields to DSR protocol in ns2.34

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: want to add field to route cache and packet of DSR routing protocol in ns2.34, add field, DSR package in ns2.34... (2 Replies)
Discussion started by: khubalkar
2 Replies

7. Programming

regarding adding fields to DSR protocol in ns2.34

hi i am student doing project in ns2.34. i hav to add field in route cache and packet of DSR routing protocol. which files hv to be changed...pl help me (1 Reply)
Discussion started by: khubalkar
1 Replies

8. Shell Programming and Scripting

Adding new lines to a file + adding suffix to a pattern

I need some help with adding lines to file and substitute a pattern. Ok I have a file: #cat names.txt name: John Doe stationed: 1 name: Michael Sweets stationed: 41 . . . And would like to change it to: name: John Doe employed permanently stationed: 1-office (7 Replies)
Discussion started by: hemo21
7 Replies

9. Shell Programming and Scripting

Adding field to file and moving the last 2 fields

I have a file with 32 fields each separated by ‘|”. I need to add a file date exactly in the format “ "20100120" “ as the 32nd field moving the existing 32nd field to 33. so the field I added should be 32nd and the 33rd field is the last field before I added the file date. I know we can... (8 Replies)
Discussion started by: dsravan
8 Replies

10. Shell Programming and Scripting

Adding new fields to an existing layout

Hi Everybody, I have an layout file like below f1 1 char 10, f2 11 char 2, f3 13 char 1, lineend 14 char 1 Their I need to add a new field which would be like f5 char 3, f6 char 2 The o/p should be f1 1 char 10, f2 11 char 2, f3 13 char 1, f5 14 char 3, f6 17 char 2 (3 Replies)
Discussion started by: mr_manii
3 Replies
Login or Register to Ask a Question