Validating a datafile with the datatypes


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Validating a datafile with the datatypes
# 1  
Old 08-16-2012
Validating a datafile with the datatypes

I have two input files 1)datafile 2)metadata file.

I have a metadata file like:

Code:
field1datatypeformat1number2string3dateyy-mm-dd

I have a data file like:


Code:
1234abc12-8-16 xyz234512-9-163456acd14-08-12


In the first row there is no correction as everything is inline with the metadata.

In the second row,the first field is string instead of number.So I shoud get error for the corresponding row in field 1.

In the third row,the date format should be yy-mm-dd ,but here it is 14-08-12 .the year cannot be 14.It shuold throw error for the corresponding field.

I need a unix shell script for validating .

Could anyone please help me in this regard?

Thanks in advance
KVB


Moderator's Comments:
Mod Comment Please use code tags next time for your code and data.

Last edited by zaxxon; 08-16-2012 at 09:00 AM.. Reason: code tags
# 2  
Old 08-16-2012
please provide the sample data with desired output
# 3  
Old 08-16-2012
metadata:
Code:
field1  datatype  format
1        number    
2        string  
3        date        yy-mm-dd

data file:
Code:
1234  abc  12-08-16
xyz   2345 12-08-16  (this row should get error bcoz the first field should be number)
3456  acd  12-14-08  (error should be thrown bcoz it's invalid date '14 is invalid month)


Last edited by zaxxon; 08-16-2012 at 09:01 AM.. Reason: code tags
# 4  
Old 08-16-2012
Code:
awk '{if($1 ~ /[0-9]/){f1=1}else{print "field one not num";next};if($2 ~ /[a-z]|[A-Z]/){f1=1}else{f1=0};if(f1==1){print}
}' datafile

like this output you need.
Here right now i am not considering for date validation.
aND ALSO for date validation no. of days in month to be consider
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to check the datatypes of the columns are same through shell scripting?

Hi, We have a requirement like, to check the datatypes of columns against database. After loading the sample data in to one of the database, need to compare the datatypes of the columns are matching with the provided files. Is there a way that we can achieve through shell scripting. We... (7 Replies)
Discussion started by: Samah
7 Replies

2. Shell Programming and Scripting

Read in numbers from a datafile

Hi, I want to be able to read numbers from many files which have the same general form as follows: C3H8 4.032258004031807E-002 Phi = 1.000000E+00 Tau = 5.749E+00 sL0 = 3.805542E+01 dL0 = 1.514926E-02 Tb = 2.328291E+03 Tu = 3.450E+02 Alpha = ... (3 Replies)
Discussion started by: lost.identity
3 Replies

3. Shell Programming and Scripting

Help with datafile parsing and creating spreadsheet

I have a datafile containing data in the following format name1,employee_number1,cell1,home1,fax1 name2,employee_number2,cell2,home2,fax2 name3,employee_number3,cell3,home3,fax3 name4,employee_number4,cell4,home4,fax4 name5,employee_number5,cell5,home5,fax5 ... ... .... I would like... (6 Replies)
Discussion started by: inditopgun
6 Replies

4. Shell Programming and Scripting

sorting the datafile in an order given in second datafile

Hi, I have two files: first input file is having 7-8 columns, and second data file is like I want to arrange my datafile1 in the order given in second data file, by comparing the seconddatafile with the second column of first file and print the entire line....also if any... (2 Replies)
Discussion started by: CAch
2 Replies

5. UNIX for Advanced & Expert Users

How do we know which processis creating a datafile

Hi, Is there any way we can find out which process is creating a partucular datafile.I know the user and group but i am just curios to know is there any way to find the process. Thanks (7 Replies)
Discussion started by: ukatru
7 Replies

6. Shell Programming and Scripting

Combine a datafile with Master datafile, emergent!

Hi guys, my supervisor has asked me to solve the problem in 7 days, I've taken 3 days to think about it but couldn't figure out any idea. Please give me some thoughts with the following problem, I have index.database that has only index date: 1994 1995 1996 1997 1998 1999 I have... (6 Replies)
Discussion started by: onthetopo
6 Replies

7. UNIX for Dummies Questions & Answers

Append filename to datafile

I am working on an shell script which checks for all the file starting with abc*.* and if file found then the filelines need to append the file name in begining can some one help with the filename appending... for i in `ls $filename*.csv` do echo $i --- NEED to append file name befor... (3 Replies)
Discussion started by: Satyagiri
3 Replies

8. Shell Programming and Scripting

selective positions from a datafile

Hi dear friends, Im writing a shell script which has to select the strings based on the position. but the problem is there is no field seperator. Normally a datafile contains 2000 records (lines) and each line is of size 500 charecters. I want to select the fields from all the lines which... (10 Replies)
Discussion started by: ganapati
10 Replies

9. Solaris

oracle datafile *dbf

Hi ,,,, I have move an oracle db from old server to a new server ( solaris 5.9 is the operating system ) my problem is that to new server the datafile ( *.dbf ) are in a different path ..... example old : /export/home/data/blobs ........... new /oracle/data/blobs....... how i can... (3 Replies)
Discussion started by: tt155
3 Replies

10. Shell Programming and Scripting

replace one section in a datafile

Hi: First, this is not a homework problem. I just need enough of a hint to get this going... My datafile (dataf.in) is made up of 10 sections. Each section begins with & and with && So it looks like this:------------------------------------- &section1 ...etc... && &section2 ...etc...... (4 Replies)
Discussion started by: Paprika
4 Replies
Login or Register to Ask a Question