Help with a flat file!!!


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with a flat file!!!
# 1  
Old 04-16-2007
Help with a flat file!!!

Hi All,

I get a flat file everyday with some records being invalid.Some records come with less number '|'.I just want to add the missing '|'s ,So the it doesnt give an error insufficient fields while loading...There area total of 32 pipes in each record.

Input:
ASADASD |Y|B|SDFGDSDFD| | |0|-2000|N|N|Y|Y| |P|111 |000 |N|N|N|N|N|N|N|ADJS|N |M| |N|N|N|A|Y|RC
ADASDAS|N|E|FSGDFGDFFS| | |0|0|Y|Y|N|N|N|P|111 |0000 |
DSASA|N|E|SDGFDGD| | |0|0|Y|Y|N|N|N|P|1111 |000 |

DASAS |Y|E|DFGDF| | |0|0|N|-|N|N| |P|111 |000 |N|N|N|N|N|N|N|ADJS|N |O| |N| |N|A|N|RC

Output :

ASADASD |Y|B|SDFGDSDFD| | |0|-2000|N|N|Y|Y| |P|111 |000 |N|N|N|N|N|N|N|ADJS|N |M| |N|N|N|A|Y|RC
ADASDAS|N|E|FSGDFGDFFS| | |0|0|Y|Y|N|N|N|P|111 |0000 |||||||| || ||||||
DSASA|N|E|SDGFDGD| | |0|0|Y|Y|N|N|N|P|1111 |000 |||||||| || ||||||
DASAS |Y|E|DFGDF| | |0|0|N|-|N|N| |P|111 |000 |N|N|N|N|N|N|N|ADJS|N |O| |N| |N|A|N|RC

Your help here is really appreciated..

regards,
Kumar
# 2  
Old 04-16-2007
With GNU Awk:

Code:
awk 'NF<33{NF=33}1' OFS="|" FS="|" inputfile

With nawk:

Code:
nawk 'NF<33{NF=33;$1=$1}1' OFS="|" FS="|" inputfile


Last edited by radoulov; 04-16-2007 at 08:11 AM..
# 3  
Old 04-16-2007
Code:
perl -aF"\|"  -lne ' print $_ . "|" x ( 31 - $#F ) ; ' file

# 4  
Old 04-16-2007
Quote:
Originally Posted by anbu23
Code:
perl -aF"\|"  -lne ' print $_ . "|" x ( 31 - $#F ) ; ' file

Thanks a lot Anbu and radoulov...
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Flat File Validation

Hi Team there is a requirement to do validate on Flat files using Shell Scripting. Suppose we have two flat files ( F1, F2). Validation 1. Row count between F1 and F2 a) Write it in a file with results of count of each file and differences if any 2. Apply checksum or any... (1 Reply)
Discussion started by: shlearner
1 Replies

2. Shell Programming and Scripting

reading a csv file and creating a flat file

hi i have written a script for reading a csv file and creating a flat file, suggest if this script can be optimized #---------------- FILENAME="$1" SCRIPT=$(basename $0) #-----------------------------------------// function usage { echo "\nUSAGE: $THIS_SCRIPT file_to_process\n"... (3 Replies)
Discussion started by: mprakasheee
3 Replies

3. Shell Programming and Scripting

Searching for Log / Bad file and Reading and writing to a flat file

Need to develop a unix shell script for the below requirement and I need your assistance: 1) search for file.log and file.bad file in a directory and read them 2) pull out "Load_Start_Time", "Data_File_Name", "Error_Type" from log file 4) concatinate each row from bad file as... (3 Replies)
Discussion started by: mlpathir
3 Replies

4. Shell Programming and Scripting

format a flat file

i have a flat file with around 700 columns . i want to break it into a flat file with say five columns like col1,col2,col3,col4 col5,col6,col7,col8 col9...... ,col700 how can i do this (5 Replies)
Discussion started by: r_t_1601
5 Replies

5. Programming

compare XML/flat file with UNIX file system structure

Before i start doing something, I wanted to know whether the approach to compare XML file with UNIX file system structure. I have a pre-configured file(contains a list of paths to executables) and i need to check against the UNIX directory structure. what are the various approches should i use ? I... (6 Replies)
Discussion started by: shafi2all
6 Replies

6. Shell Programming and Scripting

Awk to convert a flat file to CSV file

Hi , I have a file with contents as below: Contract Cancellation Report UARCNCL LOS CODE DATE REAS TYPE AMOUNT AMOUNT LETTER BY ========= ======= ==== ==== ==== ========= ==== ==== 8174739 7641509 1S NONE CRCD 30-JUN-2008 NPAR N .00 .00 CCAN 8678696 8091709 1S NONE DDEB 30-JUN-2008... (14 Replies)
Discussion started by: rkumudha
14 Replies

7. Shell Programming and Scripting

Flat File in HP-UX

Hi I have a file like below . IF the record starts with ASD then change the 20th offset to "K" follwed by that 20th offset value & if the record starts with ASDR then change the 38th offset to "K" followed by 38th offset value . But here the condition is the next value ... (0 Replies)
Discussion started by: Krishnaramjis
0 Replies

8. Shell Programming and Scripting

Flat file

Hi I have a flat file looking this QWER 2:35 7044 00001 ROUT 1188 EA SS ASD 2:36 7044 00010 ROUT BSD 2:37 7044 00011 ROUT END QWER 3:35 7044 00011 ROUT 1088 EA SS ASD 3:36 7044 00010 ROUT BSD 3:37 7044 00011 ROUT... (9 Replies)
Discussion started by: Krishnaramjis
9 Replies

9. Shell Programming and Scripting

Help with a Flat File!!!

Hi All, I need a help with a shelll script program.I get a '|' separated file which sometime has a encrypted column.And this encryption sometime breaks the last column data into a new line and this is not picked by the ETL.So when i run a script,it should append back the broken new line data... (11 Replies)
Discussion started by: kumarsaravana_s
11 Replies

10. Shell Programming and Scripting

Look up column in a flat file

Here is on more go ! Need a shortcut for my problem ! problem is i have a look_update with fixed sequence of column that is : MANDT:SERAIL:SERSCHA:SEREX:EQTYP:BSTVP I will be getting data in a flat file having same number of column but the sequence could be different in each... (5 Replies)
Discussion started by: jambesh
5 Replies
Login or Register to Ask a Question