|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
shell to find the count fields of each line
Post 302503042 by dvah on Wednesday 9th of March 2011 01:48:24 PM
03-09-2011
shell to find the count fields of each line
hi,
i've many unload files with delimiter '|'. I'm trying to load them to the specific tables from those unl's. The problem here is, some unl's are corrupted. To be exact, some files doesnt seem to have the exact number of fields as in the table. So im trying to identify the corrupted files, i cant do it manually as im dealing with hundreds of such files.
I've a file with the table name(same as the file name) with the table name and the number of columns in it.
For Ex-
table1.unl
xx|xx|xxx|xxx|xx|xxx| - no of fields 6 (nt a problem)
xx|xxxx| - no of fields is 2 (report this)
xxx|xx|xx|xxxxxx| - no of fields is 4 (report this)
ref_file.txt
table1|6|
table2|10|
...
so i need a shell to check that ref_file.txt, get the number of fields in that table (which is 6 for table1) and compare it with the unl file. It has to report error when any of the row has fewer fields that that(<6 for here).
The corrupted line can be anywhere in the file, it doesnt require to be in the start. So it has to check the whole file.
Please help!
Thanks!
i've many unload files with delimiter '|'. I'm trying to load them to the specific tables from those unl's. The problem here is, some unl's are corrupted. To be exact, some files doesnt seem to have the exact number of fields as in the table. So im trying to identify the corrupted files, i cant do it manually as im dealing with hundreds of such files.
I've a file with the table name(same as the file name) with the table name and the number of columns in it.
For Ex-
table1.unl
xx|xx|xxx|xxx|xx|xxx| - no of fields 6 (nt a problem)
xx|xxxx| - no of fields is 2 (report this)
xxx|xx|xx|xxxxxx| - no of fields is 4 (report this)
ref_file.txt
table1|6|
table2|10|
...
so i need a shell to check that ref_file.txt, get the number of fields in that table (which is 6 for table1) and compare it with the unl file. It has to report error when any of the row has fewer fields that that(<6 for here).
The corrupted line can be anywhere in the file, it doesnt require to be in the start. So it has to check the whole file.
Please help!
Thanks!
|
|
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Is there a way to count the no. of fields (columns) in a file?
Actually I need to cut some fields starting from the middle to the end. How can I specify to cut till last field?
thanks in advance
:) (4 Replies)
Discussion started by: sskb
4 Replies
2. Shell Programming and Scripting
hi
i am a new unix user
i want to check whether a file contains spacefied no of fields
if so i should delete last fields
and then insert some fields in 2nd field
please help me
Thanks Regards
babu :mad: (7 Replies)
Discussion started by: babu@shell
7 Replies
3. UNIX for Dummies Questions & Answers
I need help to find out the number of lines in a file which exists in remote machine.
I the remote machine, auto login is enabled. So I do not need to worry about the username or password. But the problem is, I do not know how I can find out the line count once I get the FTP prompt. (1 Reply)
Discussion started by: Rita_questions
1 Replies
4. Shell Programming and Scripting
I have a line of more than 3000 bytes which will contain & as fields separator..I am using following awk command ..Its working but its not accepting the line more than 3000 bytes...Anyother alternate solution even in othe shell command also fine...
awk -F '&' '{for( i=1; i<=NF; i++ ) print $i}'... (2 Replies)
Discussion started by: punithavel
2 Replies
5. Shell Programming and Scripting
I have a file a.xml
some portion of the file is given below.But the file format is same.
CTYPE available_templates SYSTEM './available_templates.dtd'>
<available_templates>
<template_file name="Approve External" path="core/approve/bin"
<command_list>
<command... (1 Reply)
Discussion started by: millan
1 Replies
6. Shell Programming and Scripting
Hi,
I have created one shell script in which it will count number of "~" tilda charactors from each line of the file.But the problem is that i need to count each line count individually, that means. if line one contains 14 "~"s and line two contains 15 "~"s then it should give an error msg.each... (3 Replies)
Discussion started by: Ganesh Khandare
3 Replies
7. Shell Programming and Scripting
Hello All,
I got a requirement when I was working with a file. Say the file has unloads of data from a table in the form
1|121|asda|434|thesi|2012|05|24|
1|343|unit|09|best|2012|11|5|
I was put into a scenario where I need the field count in all the lines in that file. It was simply... (6 Replies)
Discussion started by: PikK45
6 Replies
8. Shell Programming and Scripting
Hello All,
I am trying a one liner for finding the number of null columns in every line of my flat file.
The format of my flat file is like this
a|b|c|d||||e|f|g|
a|b|c|d||||e|f|g|
I want to count the number of fields delimited by "|" which are blank.
In above case the count should be... (6 Replies)
Discussion started by: nnani
6 Replies
9. Shell Programming and Scripting
Hello,
I have been working on Awk/sed one liner which counts the number of occurrences of '|' in pipe separated lines of file and delete the line from files if count exceeds "17".
i.e need to get records having exact 17 pipe separated fields(no more or less)
currently i have below :
awk... (1 Reply)
Discussion started by: ketanraut
1 Replies
10. UNIX for Beginners Questions & Answers
Hi,
I have a file with a list of bunch of IP addresses from different VLAN's . I am trying to find the list the number of each vlan occurence in the output
Here is how my file looks like
1.1.1.1
1.1.1.2
1.1.1.3
1.1.2.1
1.1.2.2
1.1.3.1
1.1.3.2
1.1.3.3
1.1.3.4
So what I am trying... (2 Replies)
Discussion started by: new2prog
2 Replies
LEARN ABOUT PHP
set_color
set_color(1) fish set_color(1) NAME
set_color - set_color - set the terminal color set_color - set the terminal color Synopsis set_color [-v --version] [-h --help] [-b --background COLOR] [COLOR] Description Change the foreground and/or background color of the terminal. COLOR is one of black, red, green, brown, yellow, blue, magenta, purple, cyan, white and normal. o -b, --background Set the background color o -c, --print-colors Prints a list of all valid color names o -h, --help Display help message and exit o -o, --bold Set bold or extra bright mode o -u, --underline Set underlined mode o -v, --version Display version and exit Calling set_color normal will set the terminal color to whatever is the default color of the terminal. Some terminals use the --bold escape sequence to switch to a brighter color set. On such terminals, set_color white will result in a grey font color, while set_color --bold white will result in a white font color. Not all terminal emulators support all these features. This is not a bug in set_color but a missing feature in the terminal emulator. set_color uses the terminfo database to look up how to change terminal colors on whatever terminal is in use. Some systems have old and incomplete terminfo databases, and may lack color information for terminals that support it. Download and install the latest version of ncurses and recompile fish against it in order to fix this issue. Version 1.23.1 Sun Jan 8 2012 set_color(1)