10-23-2008
Unix File Validation! Help
Hi All,
I got a file with 3 fields delimited by hyphen "-". I have to validate & cleanse the data before i begine the processing
Requirements
1. No record should contain more than 2 delimiters
2. No record should even contain less than 2 delimiters
3. Any records that matches rule 1 & 2 should be captured to
bad_records.dat
4. Delete records satisfying rules 1 & 2 from original incoming data file
Sample Format
input.dat
COL1-COL2-COL3
scott-2000-10
tiger-1000-20
c-bill-1000-30
mike20-1000
so after the validation&cleansing process, the data should appear like below
input.dat
scott-2000-10
tiger-1000-20
bad_records.dat
c-bill-1000-30
mike20-1000
Please note i can't use perl progressive scanning. I need to achieve this via korn shell script
Thanks guys
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I am very new to scripting in UNIX and in need of help. I am creating a program that will check a file that has a target time in the form of HH:MM:SS before another program can begin executing. The file with the target time will only have that target time in it and nothing else.
Is there any way... (1 Reply)
Discussion started by: mosammey
1 Replies
2. UNIX for Dummies Questions & Answers
I am very new to scripting in UNIX and in need of help. I am creating a program that will check a file that has a target time in the form of HH:MM:SS before another program can begin executing. The file with the target time will only have that target time in it and nothing else.
Is there any... (4 Replies)
Discussion started by: mosammey
4 Replies
3. Shell Programming and Scripting
Hi,
I have a UNIX script which has two parts:
1. It connects to a database and refreshes a materialized view
2. It then connects to another database and inserts refresh statistics to a table
The script works, but I'm not too good at UNIX validation. Currently, if the first part of the job... (1 Reply)
Discussion started by: matchey
1 Replies
4. UNIX for Dummies Questions & Answers
is there any way to check null data against some of the column in file
My file have such structure
1,,4,SUMISHO ,SMG110880 ,1,12,SUMISHO CAPITAL MANAGEMENT (SINGAPORE) PTE LTD ,ACCT01,20080531,2008,5,30,20080630,1,1,TXGRP ,CGST ,1,74,5.18,74,0,5.18... (2 Replies)
Discussion started by: u263066
2 Replies
5. UNIX for Advanced & Expert Users
Hi All,
I got a file with 3 fields delimited by hyphen "-". I have to validate & cleanse the data before i begine the processing
Requirements
1. No record should contain more than 2 delimiters
2. No record should even contain less than 2 delimiters
3. Any records that matches rule 1 &... (3 Replies)
Discussion started by: minnuverma
3 Replies
6. Shell Programming and Scripting
Hi All,
I got a file with 3 fields delimited by hyphen "-". I have to validate & cleanse the data before i begine the processing
Requirements
1. No record should contain more than 2 delimiters
2. No record should even contain less than 2 delimiters
3. Any records that matches rule 1 &... (8 Replies)
Discussion started by: minnuverma
8 Replies
7. Shell Programming and Scripting
I have a script which is take date as parameter
sh abc.sh <2010-02-01>
#!/sh/bin
my_date=$1
#Here i want to two diffrent dates
## 3 Days before
##date14query=$mydate - 4 (it will be 2010-01-28)
##date24query=$mydate +4 (it will be 2010-01-05)
#Please Help (3 Replies)
Discussion started by: pritish.sas
3 Replies
8. UNIX for Dummies Questions & Answers
Dears,
I am working on a batch that processes file with name containing date prefix eg., 20101222_file.dat.
The logic is to process files in order. Eg., 20101225 must be processed only after 20101222.
Ok first glance it looked simple, it use a variable to check this date value as number and... (2 Replies)
Discussion started by: naraink
2 Replies
9. Shell Programming and Scripting
Hi All,
I am completely new to Unix Shell Scripting.
I m validating(Basic File Validation) an .HHT file in TIBCO.
After that i need to do Data Validation through UNIX Shell scripting.
Rules in DataValidation:
1.) Need to Check Every field wheather it is a Char or Number?(Fields are... (1 Reply)
Discussion started by: Chaitanya K
1 Replies
10. Shell Programming and Scripting
Please help me to validate PAN card using unix
---------- Post updated at 03:06 AM ---------- Previous update was at 02:21 AM ----------
1) The first three letters are sequence of alphabets from AAA to zzz
2) The fourth character informs about the type of holder of the Card. Each assesse... (1 Reply)
Discussion started by: suryanarayana
1 Replies
LEARN ABOUT OSX
xml::libxml::schema
XML::LibXML::Schema(3) User Contributed Perl Documentation XML::LibXML::Schema(3)
NAME
XML::LibXML::Schema - XML Schema Validation
SYNOPSIS
use XML::LibXML;
$doc = XML::LibXML->new->parse_file($url);
$xmlschema = XML::LibXML::Schema->new( location => $filename_or_url );
$xmlschema = XML::LibXML::Schema->new( string => $xmlschemastring );
eval { $xmlschema->validate( $doc ); };
DESCRIPTION
The XML::LibXML::Schema class is a tiny frontend to libxml2's XML Schema implementation. Currently it supports only schema parsing and
document validation. As of 2.6.32, libxml2 only supports decimal types up to 24 digits (the standard requires at least 18).
METHODS
new
$xmlschema = XML::LibXML::Schema->new( location => $filename_or_url );
$xmlschema = XML::LibXML::Schema->new( string => $xmlschemastring );
The constructor of XML::LibXML::Schema may get called with either one of two parameters. The parameter tells the class from which
source it should generate a validation schema. It is important, that each schema only have a single source.
The location parameter allows to parse a schema from the filesystem or a URL.
The string parameter will parse the schema from the given XML string.
Note that the constructor will die() if the schema does not meed the constraints of the XML Schema specification.
validate
eval { $xmlschema->validate( $doc ); };
This function allows to validate a (parsed) document against the given XML Schema. The argument of this function should be a
XML::LibXML::Document object. If this function succeeds, it will return 0, otherwise it will die() and report the errors found. Because
of this validate() should be always evaluated.
AUTHORS
Matt Sergeant, Christian Glahn, Petr Pajas
VERSION
2.0008
COPYRIGHT
2001-2007, AxKit.com Ltd.
2002-2006, Christian Glahn.
2006-2009, Petr Pajas.
perl v5.16.2 2012-10-22 XML::LibXML::Schema(3)