08-28-2019
Flat File Validation
Hi Team
there is a requirement to do validate on Flat files using Shell Scripting.
Suppose we have two flat files ( F1, F2).
Validation
1. Row count between F1 and F2
a) Write it in a file with results of count of each file and differences if any
2. Apply checksum or any other efficient way of hashing each row in given data in both F1 and F2
a) compare each rows in F1 and F2 using hashing technique, log the exact mismatched column value in a row or entire row based on mismatches found if any
3. Have a provision to exclude columns in a file such that condition mentioned above 1 * 2 will be excluded during comparison check.
any help would be greatly appreciated.
thank you
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
My user is ftp a CSV file from window. There is possiblity to doing FTP through different mode.
This file is then picked by another program, but I want to make sure the FTP file would be always ascii format, bu releasing a commaon File <file name>
Can any one provide input , abut how to put a... (2 Replies)
Discussion started by: u263066
2 Replies
2. UNIX for Dummies Questions & Answers
Hi All,
I got a file with 3 fields delimited by hyphen "-". I have to validate & cleanse the data before i begine the processing
Requirements
1. No record should contain more than 2 delimiters
2. No record should even contain less than 2 delimiters
3. Any records that matches rule 1 &... (1 Reply)
Discussion started by: minnuverma
1 Replies
3. Shell Programming and Scripting
Hi All,
I got a file with 3 fields delimited by hyphen "-". I have to validate & cleanse the data before i begine the processing
Requirements
1. No record should contain more than 2 delimiters
2. No record should even contain less than 2 delimiters
3. Any records that matches rule 1 &... (8 Replies)
Discussion started by: minnuverma
8 Replies
4. UNIX for Dummies Questions & Answers
Hi All,
I am new to UNIX scripting.
I need to validate a file. I need to check whether the file has a header , detail records and footer.
If all the file is good I need to create a status file with the status 'Y' else 'N'.
I have pasted the an example of the file below:
... (5 Replies)
Discussion started by: kumar66
5 Replies
5. Shell Programming and Scripting
Hello,
I am working on an interface between a legacy system and an ERP system.The format of the data extracted into the staging folder from the legacy system is a follows.
One control file named ExtractDataControl.txt
Multiple entity files eg R1001.txt, R1002.txt, R1020.txt
The control... (5 Replies)
Discussion started by: Savio_Saldanha
5 Replies
6. Shell Programming and Scripting
Hi All,
I am trying to validate the file name against the naming convention mentioned in configuration file. In the configuration file, the file name convention is mentioned as:
Myfile_SQ<NN>_<NN>_YYYYMMDD_HHMMSS.xml
The actual file received is Myfile_SQ10_30_20110423_073002.xml
How do... (1 Reply)
Discussion started by: angshuman
1 Replies
7. Shell Programming and Scripting
Hello,
File contains 1,3 and 5 are required columns. it's working use this command.
awk -F\| '$1 && $3 && $5' test1.txt > test2.txt
How can use this unix programming.while using runnign this scirpt,it's raising the error.
awk: ^ syntax error
#!/usr/bin/ksh
`awk -F\| '$1 &&... (3 Replies)
Discussion started by: bammidi
3 Replies
8. Shell Programming and Scripting
I don't want HTML_CONTENT,RICH_CONTENT,TEXT_CONTENT columns data in the file and reset of data we need to extract.
Find the attached file.
Need to extract date in between DI_UX_ROW_END tag.
Can help me using unix command using AWK.
Thanks, (2 Replies)
Discussion started by: bmk
2 Replies
9. Shell Programming and Scripting
Hi there,
As a part of file validation, I needed to check for delimiter count in the file.
My aim is to find, how many records have failed to have predefined numbers of delimiters in the file.
My code looks like below
i=`awk -F '|' 'NF != 2 {print NR, $0} ' ${pinb_fldr}/${pfile}DAT |... (3 Replies)
Discussion started by: anandapani
3 Replies
10. Shell Programming and Scripting
I have a sourcefile which contains data as below.I want to check whether datatype,structure and date format looks good as mentioned.
Data is delemited by cydila .
Source file-Emp.txt
sno name phoneno dept joineddate
1 vivek 0861 CSE 2013-05-29 00:00:00
2 dinesh 123456 ECE ... (2 Replies)
Discussion started by: katakamvivek
2 Replies
LEARN ABOUT MOJAVE
glshademodel
GLSHADEMODEL(3G) GLSHADEMODEL(3G)
NAME
glShadeModel - select flat or smooth shading
C SPECIFICATION
void glShadeModel( GLenum mode )
PARAMETERS
mode Specifies a symbolic value representing a shading technique. Accepted values are GL_FLAT and GL_SMOOTH. The initial value is
GL_SMOOTH.
DESCRIPTION
GL primitives can have either flat or smooth shading. Smooth shading, the default, causes the computed colors of vertices to be interpo-
lated as the primitive is rasterized, typically assigning different colors to each resulting pixel fragment. Flat shading selects the com-
puted color of just one vertex and assigns it to all the pixel fragments generated by rasterizing a single primitive. In either case, the
computed color of a vertex is the result of lighting if lighting is enabled, or it is the current color at the time the vertex was speci-
fied if lighting is disabled.
Flat and smooth shading are indistinguishable for points. Starting when glBegin is issued and counting vertices and primitives from 1, the
GL gives each flat-shaded line segment i the computed color of vertex i + 1, its second vertex. Counting similarly from 1, the GL gives
each flat-shaded polygon the computed color of the vertex listed in the following table. This is the last vertex to specify the polygon in
all cases except single polygons, where the first vertex specifies the flat-shaded color.
Primitive Type of Polygon i Vertex
Single polygon ( i == 1) 1
Triangle strip i + 2
Triangle fan i + 2
Independent triangle 3i
Quad strip 2i + 2
Independent quad 4i
Flat and smooth shading are specified by glShadeModel with mode set to GL_FLAT and GL_SMOOTH, respectively.
ERRORS
GL_INVALID_ENUM is generated if mode is any value other than GL_FLAT or GL_SMOOTH.
GL_INVALID_OPERATION is generated if glShadeModel is executed between the execution of glBegin and the corresponding execution of glEnd.
ASSOCIATED GETS
glGet with argument GL_SHADE_MODEL
SEE ALSO
glBegin, glColor, glLight, glLightModel
GLSHADEMODEL(3G)