cd $MOUNT_DIR
for file in $(ls ${MOUNT_DIR}/Test*.txt)
do
file_name=$(basename $file)
echo $name
chmod -R 777 $MOUNT_DIR$name
match_header=awk NR==1 $file_name
echo "the header file from the input file is" $match_header
if [ comm $match_header =] ** not able the script how to compare the header columns to mentioned columns **
then
echo $name:"Header file mismatch, terminate the flow " >> $JOB_LOG
exit 1
else
echo $name:"Header file match, We can process this file " >> $JOB_LOG
fi
done
---------- Post updated at 02:09 AM ---------- Previous update was at 01:58 AM ----------
rovf, Sorry for confusion. it was txt file (I have edited the post).
Hi All,
I am using sqlldr to load my csv files into the database. The code in the sh script is as follows.
sqlldr ${DBUSER}/${DBPASS}@${ORACLE_SID} \
data=myCSV.data \
bad=myCSV.bad \
control=myCSV.ctl \
... (0 Replies)
Hi.
I think some people have already asked this, but the answers/questions seem to be about validating the contents inside a CSV file.
I am simply after a simple variable solution (ie 0 = false, 1 = true) that I can use in my script to say that file so-and-so is actually a CSV file, or in some... (4 Replies)
I have a csv file which has no header. the file has 15 fields and needs to go out with a header of 8 fields.
The header content needs to have some variables and some fixed that i have set up:
variable header fields
OUTFILE_YEAR=`date '+%y'`
DATE=`date '+%d%m%y'`
TIME=`date '+%H:%M:%S'`... (6 Replies)
Hi All,
I was wondering if there is a utility/perl library/way of validating the contents of a CSV file using an XSD.
i.e. Customer csv (including Header & Trailer)
Cust_num, Cust_nme, Cust_typ, Cust_act_dte, Cust_loc,
101,Joe's Pizza,Retail,10121979,Detroit,
102,Sony... (6 Replies)
Friends,
I need help with the following in UNIX.
Merge all csv files in one folder considering only 1 header row and ignoring header of all other files.
FYI - All files are in same format and contains same headers.
Thank you (4 Replies)
Hi,
I need a script that validates a file header/detail/trailer. File layout is:
Header - Rec_Type|File_name|File_Date
Detail - Rec_Type|field1|field2|field3...
Trailder - Rec_Type|File_name|File_Date|Record_count
Sample Data:
HDR|customer_data.dat|20120709... (7 Replies)
Hi All,
File contains header row.. we need to exclude the header row...no need to validate the first row in the file.
Data in the file should take valid data(two columns)..we need to exclude the more than two columns in the file except the first line.
email|firstname
a|123|100
b|345... (4 Replies)
Hi all i would appreciate your help...
I am looking for a set of unix commands which i can use to
1) ingest a csv file with a known format
2) validate the filename
3) validate the data/datatypes
4) Insert into an oracle db
Can you help get me started?
yogz888 (1 Reply)
Hi guys,
i want to validate the no.of colums in a csv file ,but if there is a comma(,) in any of the data values it should skip and count only valid (,) commas.
e.g
1.abc,pqrs,1234,567,hhh
result :4
2.abc,pqrs,1234,567,hhh,"in,valid",end12
result:6
here script should skip the comma inside... (10 Replies)
The below bash is a file validation check executed that will verify the correct header count of 10 and the correct data type in each field of the tab-delimited file. The key has the data type of each field in it. My real data has 58 headers in it but only the header and next row need to be... (6 Replies)
Discussion started by: cmccabe
6 Replies
LEARN ABOUT DEBIAN
cw
CW(7) Miscellaneous Information Manual CW(7)NAME
CW - the international Morse code
DESCRIPTION
CW is an abbreviation for "continuous wave", the commonly used technical term for Morse code communication. A basic knowledge or under-
standing of Morse code is a requirement for Radio Amateurs and Marine Radio Operators in many parts of the world.
MORSE CODE TIMINGS
In Morse code, a dot or dash is referred to as an element. The basic timing unit is the dot period. This is the time taken to send a dot,
not including any space before or after the dot. The lengths of all other elements are then derived from this basic unit, using the fol-
lowing rules:
The duration of a dash is three dots.
The time between each element (dot or dash) is one dot length.
The space between characters is three dot lengths.
The space between words is seven dot lengths.
The following formula calculates the dot period in microseconds from the Morse code speed in words per minute:
dot period = ( 1200000 / speed )
This formula arises from the use of the word PARIS as a 'standard' word for calibrating Morse code speed. PARIS is 50 units long when sent
in Morse code. Analysis of English plain-text indicates that the average word is 50 units, including spaces.
MORSE CODE CHARACTERS
The following list shows the IS0 8859-1 (Latin-1) characters that have commonly understood representations in Morse code:
ABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789"$()+-./:;=?_@ and space
In addition, following ISO 8859-1 and ISO 8859-2 accented characters are also part of the generally accepted international Morse code:
UACOEEANS (S with cedilla), (Z with caron/hacek),
Finally, libcw adds the following ASCII characters as extensions to single character procedural signals:
<>!&^~
MORSE CODE CHARACTER TABLES
The following table shows the Morse code equivalents for the ISO 8859-1, accented ISO 8859-1, and accented ISO 8859-2 characters above.
The ASCII portion of this table is taken from the ARRL Handbook, and the accented extensions from various other sources:
Ch Code Ch Code Ch Code Ch Code
-------------------------------------------------------
A .- B -... C -.-. D -..
E . F ..-. G --. H ....
I .. J .--- K -.- L .-..
M -- N -. O --- P .--.
Q --.- R .-. S ... T -
U ..- V ...- W .-- X -..-
Y -.-- Z --..
0 ----- 1 .---- 2 ..--- 3 ...--
4 ....- 5 ..... 6 -.... 7 --...
8 ---.. 9 ----.
" .-..-. ' .----. $ ...-..- ( -.--.
) -.--.- + .-.-. , --..-- - -....-
. .-.-.- / -..-. : ---... ; -.-.-.
= -...- ? ..--.. _ ..--.-
Ch Code Ch Code
-------------------------------------------------
U ..-- A .-.-
C -.-.. O ---.
E ..-.. A .-..-
A .--.- N --.--
S (S+cedilla) ---- (Z+caron/hacek) --..-
In addition to the above standard characters, the following characters are conventionally used for punctuation and procedural signals as
follows:
Ch Code Ch Code Ch Code Ch Code
-------------------------------------------------------
" .-..-. ' .----. $ ...-..- ( -.--.
) -.--.- + .-.-. , --..-- - -....-
. .-.-.- / -..-. : ---... ; -.-.-.
= -...- ? ..--.. _ ..--.- @ .--.-.
and the following are non-conventional extensions implemented by libcw:
Ch Code Ch Code Ch Code Ch Code
-----------------------------------------------------
< ...-.- > -...-.- ! ...-. & .-...
^ -.-.- ~ .-.-..
An alternative view of punctuation and procedural signals is as combination Morse characters:
Ch Prosig Ch Prosig Ch Prosig Ch Prosig
---------------------------------------------------------
" [AF] ' [WG] $ [SX] ( [KN]
) [KK] + [AR] , [MIM] - [DU]
. [AAA] / [DN] : [OS] ; [KR]
= [BT] ? [IMI] _ [IQ] @ [AC]
< [VA],[SK] > [BK] ! [SN] & [AS]
^ [KA] ~ [AL]
NOTES
Despite the fact that this manual page constantly and consistently refers to Morse code elements as dots and dashes, DO NOT think in these
terms when trying to learn Morse code. Always think of them as 'dit's and 'dah's.
SEE ALSO
Man pages for libcw(3,LOCAL), cw(1,LOCAL), cwgen(1,LOCAL), cwcp(1,LOCAL), and xcwcp(1,LOCAL).
CW Tutor Package CW(7)
06-18-2018
