Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Script to validate header in a csv file
Top Forums Shell Programming and Scripting Script to validate header in a csv file Post 303018867 by rovf on Monday 18th of June 2018 02:53:00 AM
Old 06-18-2018
The question is incomplete:

Do you require that the header is EXACTLY like the one you posted? In this case, there is nothing CSV-specific in your question. Instead, the problem boils down to finding out, whether the first line of a file has a certain content.

Or do you require that the header is STRUCTURALLY like the one you posted? For example, the CSV-file format allows fields to be quoted; or, you might consider trailing spaces after the header names insignificant; or you might allow the fields to occur in any order. In this case, you need to specify, what exactly are the conditions to regard the header valid.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

validate csv file load

Hi All, I am using sqlldr to load my csv files into the database. The code in the sh script is as follows. sqlldr ${DBUSER}/${DBPASS}@${ORACLE_SID} \ data=myCSV.data \ bad=myCSV.bad \ control=myCSV.ctl \ ... (0 Replies)
Discussion started by: rahulrathod
0 Replies

2. Shell Programming and Scripting

How to validate a CSV file?

Hi. I think some people have already asked this, but the answers/questions seem to be about validating the contents inside a CSV file. I am simply after a simple variable solution (ie 0 = false, 1 = true) that I can use in my script to say that file so-and-so is actually a CSV file, or in some... (4 Replies)
Discussion started by: ElCaito
4 Replies

3. Shell Programming and Scripting

How can I add a header to a csv file

I have a csv file which has no header. the file has 15 fields and needs to go out with a header of 8 fields. The header content needs to have some variables and some fixed that i have set up: variable header fields OUTFILE_YEAR=`date '+%y'` DATE=`date '+%d%m%y'` TIME=`date '+%H:%M:%S'`... (6 Replies)
Discussion started by: Pablo_beezo
6 Replies

4. Shell Programming and Scripting

How to: Validate a CSV file using an XSD?

Hi All, I was wondering if there is a utility/perl library/way of validating the contents of a CSV file using an XSD. i.e. Customer csv (including Header & Trailer) Cust_num, Cust_nme, Cust_typ, Cust_act_dte, Cust_loc, 101,Joe's Pizza,Retail,10121979,Detroit, 102,Sony... (6 Replies)
Discussion started by: luinzi
6 Replies

5. UNIX for Dummies Questions & Answers

Merge all csv files in one folder considering only 1 header row and ignoring header of all others

Friends, I need help with the following in UNIX. Merge all csv files in one folder considering only 1 header row and ignoring header of all other files. FYI - All files are in same format and contains same headers. Thank you (4 Replies)
Discussion started by: Shiny_Roy
4 Replies

6. Shell Programming and Scripting

Script to validate file header and trailer

Hi, I need a script that validates a file header/detail/trailer. File layout is: Header - Rec_Type|File_name|File_Date Detail - Rec_Type|field1|field2|field3... Trailder - Rec_Type|File_name|File_Date|Record_count Sample Data: HDR|customer_data.dat|20120709... (7 Replies)
Discussion started by: ash_sh
7 Replies

7. Shell Programming and Scripting

Exclude the header row in the file to validate

Hi All, File contains header row.. we need to exclude the header row...no need to validate the first row in the file. Data in the file should take valid data(two columns)..we need to exclude the more than two columns in the file except the first line. email|firstname a|123|100 b|345... (4 Replies)
Discussion started by: bmk
4 Replies

8. Shell Programming and Scripting

Script to ingest a csv, validate data and insert into Oracle

Hi all i would appreciate your help... I am looking for a set of unix commands which i can use to 1) ingest a csv file with a known format 2) validate the filename 3) validate the data/datatypes 4) Insert into an oracle db Can you help get me started? yogz888 (1 Reply)
Discussion started by: yogz888
1 Replies

9. UNIX for Beginners Questions & Answers

Validate csv file

Hi guys, i want to validate the no.of colums in a csv file ,but if there is a comma(,) in any of the data values it should skip and count only valid (,) commas. e.g 1.abc,pqrs,1234,567,hhh result :4 2.abc,pqrs,1234,567,hhh,"in,valid",end12 result:6 here script should skip the comma inside... (10 Replies)
Discussion started by: harry123
10 Replies

10. Shell Programming and Scripting

Bash to verify and validate file header and data type

The below bash is a file validation check executed that will verify the correct header count of 10 and the correct data type in each field of the tab-delimited file. The key has the data type of each field in it. My real data has 58 headers in it but only the header and next row need to be... (6 Replies)
Discussion started by: cmccabe
6 Replies

LEARN ABOUT SUSE

distrib.pats

DISTRIB.PATS(5) 					    InterNetNews Documentation						   DISTRIB.PATS(5)

NAME

       distrib.pats - Default values for the Distribution: header

DESCRIPTION

       The file pathetc/distrib.pats is used by nnrpd to determine the default value of the Distribution: header.  Blank lines and lines beginning
       with a number sign ("#") are ignored.  All other lines consist of three fields separated by a colon:

	   <weight>:<pattern>:<value>

       The first field is the weight to assign to this match.  If a newsgroup matches multiple lines, the line with the highest weight is used.
       This should be an arbitrary integer greater than zero.  The order of lines in the file is only important if groups have equal weight (in
       which case, the first matching line will be used).

       The second field is either the name of a newsgroup or a uwildmat(3)-style pattern to specify a set of newsgroups.

       The third field is the value that should be used for the Distribution: header of a posted article, if this line was picked as the best
       match and no Distribution: header was supplied by the user.  It can be an empty string, specifying that no Distribution: header should be
       added.  If it is not empty, it is better to only use US-ASCII characters for that field; otherwise, make sure it is encoded in UTF-8.

       When a post is received by nnrpd that does not already contain a Distribution: header, each newsgroup to which an article is posted will be
       checked against this file in turn, and the matching line with the highest weight will be used as the value of the Distribution: header.	If
       no lines match, or if the matching line has an empty string for its third field, no header will be added.  In case a distribution is added
       by nnrpd, make sure it is not rejected by the newsfeeds "ME" entry.

       A list of recommended distributions can be specified and described in distributions(5).

HISTORY

       Written by Rich $alz <rsalz@uunet.uu.net> for InterNetNews.  Converted to POD by Russ Allbery <rra@stanford.edu>.

       $Id: distrib.pats.pod 8803 2009-11-15 09:29:41Z iulius $

SEE ALSO

       distributions(5), inn.conf(5), newsfeeds(5), nnrpd(8), uwildmat(3).

INN 2.5.2							    2009-11-15							   DISTRIB.PATS(5)
All times are GMT -4. The time now is 11:59 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy