10-23-2008
Unix File Validation! Help
Hi All,
I got a file with 3 fields delimited by hyphen "-". I have to validate & cleanse the data before i begine the processing
Requirements
1. No record should contain more than 2 delimiters
2. No record should even contain less than 2 delimiters
3. Any records that matches rule 1 & 2 should be captured to
bad_records.dat
4. Delete records satisfying rules 1 & 2 from original incoming data file
Sample Format
input.dat
COL1-COL2-COL3
scott-2000-10
tiger-1000-20
c-bill-1000-30
mike20-1000
so after the validation&cleansing process, the data should appear like below
input.dat
scott-2000-10
tiger-1000-20
bad_records.dat
c-bill-1000-30
mike20-1000
Please note i can't use perl progressive scanning. I need to achieve this via korn shell script
Thanks guys
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I am very new to scripting in UNIX and in need of help. I am creating a program that will check a file that has a target time in the form of HH:MM:SS before another program can begin executing. The file with the target time will only have that target time in it and nothing else.
Is there any way... (1 Reply)
Discussion started by: mosammey
1 Replies
2. UNIX for Dummies Questions & Answers
I am very new to scripting in UNIX and in need of help. I am creating a program that will check a file that has a target time in the form of HH:MM:SS before another program can begin executing. The file with the target time will only have that target time in it and nothing else.
Is there any... (4 Replies)
Discussion started by: mosammey
4 Replies
3. Shell Programming and Scripting
Hi,
I have a UNIX script which has two parts:
1. It connects to a database and refreshes a materialized view
2. It then connects to another database and inserts refresh statistics to a table
The script works, but I'm not too good at UNIX validation. Currently, if the first part of the job... (1 Reply)
Discussion started by: matchey
1 Replies
4. UNIX for Dummies Questions & Answers
is there any way to check null data against some of the column in file
My file have such structure
1,,4,SUMISHO ,SMG110880 ,1,12,SUMISHO CAPITAL MANAGEMENT (SINGAPORE) PTE LTD ,ACCT01,20080531,2008,5,30,20080630,1,1,TXGRP ,CGST ,1,74,5.18,74,0,5.18... (2 Replies)
Discussion started by: u263066
2 Replies
5. UNIX for Dummies Questions & Answers
Hi All,
I got a file with 3 fields delimited by hyphen "-". I have to validate & cleanse the data before i begine the processing
Requirements
1. No record should contain more than 2 delimiters
2. No record should even contain less than 2 delimiters
3. Any records that matches rule 1 &... (1 Reply)
Discussion started by: minnuverma
1 Replies
6. Shell Programming and Scripting
Hi All,
I got a file with 3 fields delimited by hyphen "-". I have to validate & cleanse the data before i begine the processing
Requirements
1. No record should contain more than 2 delimiters
2. No record should even contain less than 2 delimiters
3. Any records that matches rule 1 &... (8 Replies)
Discussion started by: minnuverma
8 Replies
7. Shell Programming and Scripting
I have a script which is take date as parameter
sh abc.sh <2010-02-01>
#!/sh/bin
my_date=$1
#Here i want to two diffrent dates
## 3 Days before
##date14query=$mydate - 4 (it will be 2010-01-28)
##date24query=$mydate +4 (it will be 2010-01-05)
#Please Help (3 Replies)
Discussion started by: pritish.sas
3 Replies
8. UNIX for Dummies Questions & Answers
Dears,
I am working on a batch that processes file with name containing date prefix eg., 20101222_file.dat.
The logic is to process files in order. Eg., 20101225 must be processed only after 20101222.
Ok first glance it looked simple, it use a variable to check this date value as number and... (2 Replies)
Discussion started by: naraink
2 Replies
9. Shell Programming and Scripting
Hi All,
I am completely new to Unix Shell Scripting.
I m validating(Basic File Validation) an .HHT file in TIBCO.
After that i need to do Data Validation through UNIX Shell scripting.
Rules in DataValidation:
1.) Need to Check Every field wheather it is a Char or Number?(Fields are... (1 Reply)
Discussion started by: Chaitanya K
1 Replies
10. Shell Programming and Scripting
Please help me to validate PAN card using unix
---------- Post updated at 03:06 AM ---------- Previous update was at 02:21 AM ----------
1) The first three letters are sequence of alphabets from AAA to zzz
2) The fourth character informs about the type of holder of the Card. Each assesse... (1 Reply)
Discussion started by: suryanarayana
1 Replies