Sponsored Content
Top Forums UNIX for Dummies Questions & Answers Check for not null column in a pipe delimited file Post 302974867 by reshma15193 on Sunday 5th of June 2016 05:04:16 AM
Old 06-05-2016
Check for not null column in a pipe delimited file

Hi,

I have a requirement where I have to check whether the mandatory columns in a pipe delimited file is null and print error message.
For eg, I have to check if the 3rd,5th,6th,7th and 8th column are null and print the message "<column name> is null".
The data file will have aroung 100,000 records.
Please help!
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grep for NULL in a pipe delimited file

hi, How can I check for a field in a pipe-delimited file having a NULL value in Unix using a grep command or any other command. Please reply (5 Replies)
Discussion started by: sureshg_sampat
5 Replies

2. Shell Programming and Scripting

How to check Null values in a file column by column if columns are Not NULLs

Hi All, I have a table with 10 columns. Some columns(2nd,4th,5th,7th,8th and 10th) are Not Null columns. I'll get a tab-delimited file and want to check col by col and generate seperate error code for each col eg:102 if 2nd col value is NULL and 104 if 4th col value is NULL so on... I am a... (7 Replies)
Discussion started by: Mandab
7 Replies

3. UNIX for Dummies Questions & Answers

Need help with shell script for chekking a column in txt file - pipe delimited

Hi: I have a text file date(pipe delimited) which is loaded in to the DB using sql loader(&CTL files) after some initial validation by the shell script. Now i have a situation where the shell script needs to check a column in the text file and if it is NULL then it needs send this record/row... (12 Replies)
Discussion started by: ravi0435
12 Replies

4. Shell Programming and Scripting

count of null in pipe delimited txt file

Hi, I have a pipe delimited txt file which contains 17 fields per line/row. 16th field contains email id. I want to count the number of lines/rows that contains null in the 16th field. Plz find attached example data file. I'm looking for a command line/script which achieves this. ... (5 Replies)
Discussion started by: Sriranga
5 Replies

5. UNIX for Advanced & Expert Users

Check Whether File is Pipe Delimited

Can anybody help me how to check whether a file is Pipe delimited or not? (1 Reply)
Discussion started by: Allwin333
1 Replies

6. Homework & Coursework Questions

how to show particular column from pipe delimited file

hi, I have pipe delimited flat file as below 1|ab|4.5|9| 2|ac|3|12| 3|ac|4.5|8| i want to show (display) only 3rd field between pipes. please help (1 Reply)
Discussion started by: vai15517
1 Replies

7. Shell Programming and Scripting

Find for line with not null values at nth place in pipe delimited file

Hi, I am trying to find the lines in a pipe delimited file where 11th column has not null values. Any help is appreciated. Need help asap please. thanks in advance. (3 Replies)
Discussion started by: manikms
3 Replies

8. Shell Programming and Scripting

Replace pipe delimited column string to null

Hi All, I have a large dat file where each lines are pipe delimited values. I need to parse the file depending on the request. For example: sometimes I have told to remove all the values in the 7th column (this case remove values '3333' only from the first line and '3543' from the second line)... (4 Replies)
Discussion started by: express14
4 Replies

9. Shell Programming and Scripting

Replacing a column in a pipe delimited file

Hi, I have a pipe delimited file as below and I need to replace the 2nd column of each line with null values. 1|10/15/2011|fname1|lname1 2|10/15/2012|fname2|lname2 3|10/15/2013|fname3|lname3 Output file: 1||fname1|lname1 2||fname2|lname2 3||fname3|lname3 I tried this ... (2 Replies)
Discussion started by: member2014
2 Replies

10. Shell Programming and Scripting

Replace delimiter for a particular column in a pipe delimited file

I have an input file as below Emp1|FirstName|MiddleName|LastName|Address|Pincode|PhoneNumber 1234|FirstName1|MiddleName2|LastName3| Add1 || ADD2|123|000000000 Output : 1234|FirstName1|MiddleName2|LastName3| Add1 ,, ADD2|123|000000000 OR 1234,FirstName1,MiddleName2,LastName3, Add1 ||... (2 Replies)
Discussion started by: styris
2 Replies
DNSTOP(8)						    BSD System Manager's Manual 						 DNSTOP(8)

NAME
dnstop -- displays various tables of DNS traffic on your network SYNOPSIS
dnstop [-46apsQR] [-b expression] [-i address] [-f filter] [-r interval] [device] [savefile] DESCRIPTION
dnstop is a small tool to listen on device or to parse the file savefile and collect and print statistics on the local network's DNS traffic. You must have read access to /dev/bpf*. COMMAND LINE OPTIONS
The options are as follows: -4 count only messages with IPv4 addresses -6 count only messages with IPv6 addresses -Q count only DNS query messages -R count only DNS reply messages -a anonymize addresses -b expression BPF filter expression (default: udp port 53) -i address ignore select addresses -p Do not put the interface into promiscuous mode. -r Redraw interval (seconds). -l level keep counts on names up to level domain name levels. For example, with -l 2 (the default), dnstop will keep two tables: one with top-level domain names, and another with second-level domain names. Increasing the level provides more details, but also requires more memory and CPU. -f input filter name The "unknown-tlds" filter includes only queries for TLDs that are bogus. Useful for identifying hosts/servers that leak queries for things like "localhost" or "workgroup." The "A-for-A" filter includes only A queries for names that are already IP addresses. Certain Microsoft Windows DNS servers have a known bug that forward these queries. The "rfc1918-ptr" filter includes only PTR queries for addresses in RFC1918 space. These should never leak from inside an organiza- tion. The "refused" filter, when used with the -R option, tells dnstop to count only replies with rcode REFUSED. The "qtype-any" filter tells dnstop to count only message of type ANY. -n name Only count messages within the domain name -P Print "progress" messages on stderr when in non-interactive mode. -B buckets Use buckets hash table buckets. -X Do not tabulate the sources + query name counters. This can significantly reduce memory usage on busy servers and large savefiles. savefile a captured network trace in pcap format device ethernet device (ie fxp0) RUN TIME OPTIONS
While running, the following options are available to alter the display: s display the source address table d display the destination address table t display the breakdown of query types seen r display the breakdown of response codes seen o display the breakdown of opcodes seen 1 show 1st level query names 2 show 2nd level query names 3 show 3rd level query names 4 show 4th level query names 5 show 5th level query names 6 show 6th level query names 7 show 7th level query names 8 show 8th level query names 9 show 9th level query names ! show sources + 1st level query names @ show sources + 2nd level query names # show sources + 3rd level query names $ show sources + 4th level query names % show sources + 5th level query names ^ show sources + 6th level query names & show sources + 7th level query names * show sources + 8th level query names ( show sources + 9th level query names ^R reset the counters ^X exit the program space redraw ? help NON-INTERACTIVE MODE If stdout is not a tty, dnstop runs in non-interactive mode. In this case, you must supply a savefile for reading, instead of capturing live packets. After reading the entire savefile, dnstop prints the top 50 entries for each table. HOW MESSAGES ARE COUNTED
By default dnstop examines only query messages and ignores replies. In this case the response code table is meaningless and will likely show 100% "Noerror." If you supply (only) the -R command line option, dnstop examines replies and ignores queries. This allows you to see meaningful response code values, as well as all the other tables. In this case all the query attributes (such as type and name) are taken from the Question sec- tion of the reply. Note, however, that it is common for a stream of DNS messages to contain more queries than replies. This could happen, for example, if the server is too busy to respond to every single query, or if the server is designed to ignore malformed query messages. Therefore, you might want to examine both queries and replies by giving both -R and -Q command line options. In this case, only the response code counts are taken from the replies and all other attributes are taken from the queries. AUTHORS
Duane Wessels (wessels@measurement-factory.com) Mark Foster (mark@foster.cc) Jose Nazario (jose@monkey.org) Sam Norris <@ChangeIP.com> Max Horn <@quendi.de> John Morrissey <jwm@horde.net> Florian Forster <octo@verplant.org> Dave Plonka <plonka@cs.wisc.edu> http://dnstop.measurement-factory.com/ BUGS
Does not support TCP at this time. BSD
21 March, 2008 BSD
All times are GMT -4. The time now is 09:26 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy