|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
How to: Validate a CSV file using an XSD?
Post 302528541 by DGPickett on Tuesday 7th of June 2011 11:01:05 AM
06-07-2011
CSV does have some rules that might support a validation.Yeah, I always see XSD in the context of parsers like xerces having XML checking against XSD, although for speed I did my own checks. I was not sure if XSD was extensible to CSV format. XML is a slippery world, in terms of what you can do! 
- Lines should be cr-lf, but for most of us, that is not critical.
- You cannot leave double quotes open at end of line, or is that a line break embedded in a field? Probably, the user should have to allow that.
- It'd be nice if the field count of every line was identical (quoting problems, embedded linefeeds?), but that is somewhat a warning. The user should be able to provide an expected range of fields, or indicate if the field count is not always identical in the data set.
- You need to be double-quote sensitive when counting fields, it is not simple comma delimited text.
- You need to be doubled-double-quote sensitive when evaluating double quotes.
This User Gave Thanks to DGPickett For This Post:
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi All,
I am using sqlldr to load my csv files into the database. The code in the sh script is as follows.
sqlldr ${DBUSER}/${DBPASS}@${ORACLE_SID} \
data=myCSV.data \
bad=myCSV.bad \
control=myCSV.ctl \
... (0 Replies)
Discussion started by: rahulrathod
0 Replies
2. Shell Programming and Scripting
Hi.
I think some people have already asked this, but the answers/questions seem to be about validating the contents inside a CSV file.
I am simply after a simple variable solution (ie 0 = false, 1 = true) that I can use in my script to say that file so-and-so is actually a CSV file, or in some... (4 Replies)
Discussion started by: ElCaito
4 Replies
3. Shell Programming and Scripting
Hi
i am baby to unix shell script. how do i validate xml agaist xsd and transforms xml using xslt.
Thanks
Mohan (2 Replies)
Discussion started by: mohan.cheepu
2 Replies
4. Shell Programming and Scripting
Hi,
Please find below the xsd.
<?xml version="1.0" encoding="ISO-8859-1" ?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="fruitorder">
<xs:complexType>
<xs:sequence>
<xs:element name="orderperson"... (2 Replies)
Discussion started by: vanitham
2 Replies
5. Shell Programming and Scripting
how do i validate xml agaist xsd is ksh? (1 Reply)
Discussion started by: LiorAmitai
1 Replies
6. Programming
Hi every one,
I am new to xml data files,I have two xml files with same data but only small difference as shown below
<List>
<number>1101</number>
<Area>inner walls in a room.</Area>
<Detection>less pressure.</Detection>
<reason>
<normal>
<Component Num="15"... (1 Reply)
Discussion started by: veerubiji
1 Replies
7. Shell Programming and Scripting
Hi,
I have a xml file and a xsd file(xml schema file). Here using unix script i wanted to validate the xml file by referring to xsd file. The validation is in terms of Datatype,Field length and null values. If the data present in the xml file is not matching in terms of datatype,field length... (3 Replies)
Discussion started by: shree11
3 Replies
8. Shell Programming and Scripting
Hi all i would appreciate your help...
I am looking for a set of unix commands which i can use to
1) ingest a csv file with a known format
2) validate the filename
3) validate the data/datatypes
4) Insert into an oracle db
Can you help get me started?
yogz888 (1 Reply)
Discussion started by: yogz888
1 Replies
9. UNIX for Beginners Questions & Answers
Hi guys,
i want to validate the no.of colums in a csv file ,but if there is a comma(,) in any of the data values it should skip and count only valid (,) commas.
e.g
1.abc,pqrs,1234,567,hhh
result :4
2.abc,pqrs,1234,567,hhh,"in,valid",end12
result:6
here script should skip the comma inside... (10 Replies)
Discussion started by: harry123
10 Replies
10. Shell Programming and Scripting
Hi All;
I am struggling to write a script that validates file header.
Header file would be like below with TAB separated
TRX # TYPE REF # Source Piece Code Destination Piece Code
every time I need to check the txt file if the header was same as above fields if validation success... (6 Replies)
Discussion started by: heye18
6 Replies
LEARN ABOUT DEBIAN
mdb-export
MDBTools(1) MDBTools(1) NAME
mdb-export - Export data in an MDB database table to CSV format. SYNOPSIS
mdb-export [-H] [-d delimiter] [-R row_delim] [[-Q] | [-q quote [-X escape]]] [-I] [-D format] database table DESCRIPTION
mdb-export is a utility program distributed with MDB Tools. It produces a CSV (comma separated value) output for the given table. Such output is suitable for importation into databases or spread- sheets. OPTIONS
-H Supress header row -Q Don't wrap text-like fields (text, memo, date) in quotes. If not specified text fiels will be surrounded by " (double quote) char- acters. -d Specify an alternative column delimiter If no delimiter is specified, table names will be delimited by a , (comma) character. -R Specify a row delimiter -I INSERT statements (instead of CSV). You must specify the SQL dialect. -D Set the date format (see strftime(3) for details) -q Use to wrap text-like fields. Default is ". -X Use to escape quoted characters within a field. Default is doubling. -N namespace Prefix identifiers with namespace. NOTES
ENVIRONMENT
MDB_JET3_CHARSET Defines the charset of the input JET3 (access 97) file. Default is CP1252. See iconv(1). MDBICONV Defines the output charset to use for the SQL file. Default is UTF-8. mdbtools must have been compiled with iconv. MDBOPTS semi-column separated list of options: o use_index o no_memo o debug_like o debug_write o debug_usage o debug_ole o debug_row o debug_props o debug_all is a shortcut for all debug_* options SEE ALSO
gmdb2(1) mdb-hexdump(1) mdb-prop(1) mdb-sql(1) mdb-ver(1) mdb-array(1) mdb-header(1) mdb-parsecsv(1) mdb-schema(1) mdb-tables(1) HISTORY
mdb-export first appeared in MDB Tools 0.1. AUTHORS
The mdb-export utility was written by Brian Bruns. BUGS
Memo fields are allowed to contain a newline characters, the current program does nothing about this. 0.7 13 July 2013 MDBTools(1)