Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Extract error records based on specific criteria from Unix file
Top Forums Shell Programming and Scripting Extract error records based on specific criteria from Unix file Post 302670315 by sam05121988 on Thursday 12th of July 2012 02:22:47 AM
Old 07-12-2012
you can use this perl code

Code:
 
$ cat pp.pl
#!/usr/bin/perl -w
use strict;
chomp(my @arr=<>);
my $i=0;
for (@arr)
{
        if (!/^ABC/)
        {
                my $x=$i-1;
                print "Line ".$i.":".$arr[$x]."\n";
                print "Line ".($i+1).":".$_."\n";
        }
$i++;
}

while runing this code, club it with sort -u

Code:
 
$ ./pp.pl a.txt| sort -u

output
Code:
 
Line 2:ABC 4567 678 XYZ
Line 3:xyz ght 678
Line 5:ABC 789 7890 777
Line 6:zxr hyip hyu
Line 7:mno uii 678 776

 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Select records based on search criteria on first column

Hi All, I need to select only those records having a non zero record in the first column of a comma delimited file. Suppose my input file is having data like: "0","01/08/2005 07:11:15",1,1,"Created",,"01/08/2005" "0","01/08/2005 07:12:40",1,1,"Created",,"01/08/2005"... (2 Replies)
Discussion started by: shashi_kiran_v
2 Replies

2. Shell Programming and Scripting

Append specific lines to a previous line based on sequential search criteria

I'll try explain this as best I can. Let me know if it is not clear. I have large text files that contain data as such: 143593502 09-08-20 09:02:13 xxxxxxxxxxx xxxxxxxxxxx 09-08-20 09:02:11 N line 1 test line 2 test line 3 test 143593503 09-08-20 09:02:13... (3 Replies)
Discussion started by: jesse
3 Replies

3. UNIX for Dummies Questions & Answers

Extract a specific number from an XML file based on the start and end tags

Hello People, I have the following contents in an XML file ........... ........... .......... ........... <Details = "Sample Details"> <Name>Bob</Name> <Age>34</Age> <Address>CA</Address> <ContactNumber>1234</ContactNumber> </Details> ........... ............. .............. (4 Replies)
Discussion started by: sushant172
4 Replies

4. Shell Programming and Scripting

Extract data based on specific search criteria

I have a huge file (about 2 millions records) contains data separated by “,” (comma). As part of the requirement, I can't change the format. The objective is to remove some of the records with the following condition. If the 23rd field on each line start with 302 , I need to remove that from the... (4 Replies)
Discussion started by: jaygamini
4 Replies

5. Shell Programming and Scripting

Extract file records based on some field conditions

Hello Friends, I have a file(InputFile.csv) with the following columns(the columns are pipe-delimited): ColA|ColB|ColC|ColD|ColE|ColF Now for this file, I have to get those records which fulfil the following condition: If "ColB" is NOT NULL and "ColD" has values one of the following... (9 Replies)
Discussion started by: mehimadri
9 Replies

6. Shell Programming and Scripting

Extract records from Oracle to UNIX file with headers

Hi, I have a shell script which extracts records form oracle to unix file. sqlplus -s ${WMD_DM_CONNECT} <<EOF >$tmpfile set heading off set pagesize 0 set feedback off select CD_DESC||'|'||CD_ID||'|'||'Arun'||'|'||'Montu' from WMD_SYS_CD_LKUP where CD_TYP =... (5 Replies)
Discussion started by: Arun Mishra
5 Replies

7. Shell Programming and Scripting

Extract specific lines based on another file

I have a folder containing text files. I need to extract specific lines from the files of this folder based on another file input.txt. How can I do this with awk/sed? file1 ARG 81.9 8 81.9 0 LEU 27.1 9 27.1 0 PHE .0 10 .0 0 ASP 59.8 11 59.8 0 ASN 27.6 12 27.6 0 ALA .0 13 .0 0... (5 Replies)
Discussion started by: alanmathew84
5 Replies

8. Shell Programming and Scripting

awk to print specific line in file based on criteria

In the file below I am trying to extract a specific instance of path, if the adjacent plugin": "/rundb/api/v1/plugin/49/. Thank you :). file "path": "/results/analysis/output/Home/Auto_user_S5-00580-4-Medexome_65_028/plugin_out/FileExporter_out.52", "plugin": "/rundb/api/v1/plugin/49/",... (8 Replies)
Discussion started by: cmccabe
8 Replies

9. Shell Programming and Scripting

Need a Linux command for find/replace column based on specific criteria.

I'm new to shell programming, I have a huge text file in the following format, where columns are separated by single space: ACA MEX 4O_ $98.00 $127.40 $166.60 0:00 0:00 0 ; ACA YUL TS_ $300.00 $390.00 $510.00 0:00 0:00 0 ; ACA YYZ TS_ $300.00 $390.00 $510.00 0:00 0:00 0 ; ADZ YUL TS_ $300.00... (3 Replies)
Discussion started by: transat
3 Replies

10. Shell Programming and Scripting

Awk/sed/cut to filter out records from a file based on criteria

I have two files and would need to filter out records based on certain criteria, these column are of variable lengths, but the lengths are uniform throughout all the records of the file. I have shown a sample of three records below. Line 1-9 is the item number "0227546_1" in the case of the first... (15 Replies)
Discussion started by: MIA651
15 Replies

LEARN ABOUT OSF1

named.star

named.star(4)						     Kernel Interfaces Manual						     named.star(4)

NAME

       named.star - Defines data used by named to initialize the BIND (Berkeley Internet Name Domain) name server file

SYNOPSIS

       /etc/namedb/named.*

DESCRIPTION

       The  data  files  referenced in the named.conf file can have any names, but they are generally given names of the form /etc/namedb/named.*.
       This naming convention is used for convenience in maintaining the named daemon's file.

       The records in the named data files are called resource records. Except for comments (starting with a ; (semicolon) and continuing  to  the
       end  of the line), the resource records in the data files generally follow the format of the resource records that the named daemon returns
       in response to queries from resolver routines.

       The named.conf file is the default configuration (or boot) file for the named server.  The named daemon reads the start-up  file  when  the
       named daemon starts and when receiving the signal SIGHUP.

EXAMPLES

       The following examples portray two domains on two different networks: Domain abc.aus.osf.com, Internet address 192.9.201.n

       (where n varies for each system on the network)

       Domain xyz.aus.osf.com, Internet address 128.114.100.n

       (where n varies for each system on the network)

	      In  this	sample	configuration, both the primary and the secondary name servers are in the abc.aus.osf.com domain, and host hera is
	      the gateway host.  The following are sample entries in a named.ca file: ; root name servers.
		       1	  IN	NS    relay.osf.com.  relay.osf.com.   3600000	  IN	A     129.114.1.2 The following two files are sam-
	      ple entries from the named.data files for hosts venus and allen.	(The data files can have any name you choose, as long as that name
	      is defined in the named.boot file. In this case, the names are named.abcdata and named.xyzdata.)

	      The named file for host venus is in the following file, called named.abcdata: ;OWNER	   TTL	     CLASS TYPE      RDATA  ;local
	      domain server is venus @	 IN   SOA   venus   bob.robert.abc.aus.osf.com. (
					  1.1	  ;serial
					  3600	  ;refresh
					  600	  ;retry
					  3600000 ;expire
					  86400)  ;minimum
		  IN	NS   venus
		  IN	NS   kronos
		  IN	 MX    10	venus.abc.aus.osf.com.	 ; address for local loopback localhost 	 IN    A	127.1 ; address of
	      machines in the same domain venus 	     IN    A	    192.9.201.1  venus		     IN     A	      128.114.100.1  venus
	      IN    MX	     10   venus.abc.aus.osf.com.  veabc 	     IN    CNAME    venus
				 IN    WKS	192.9.201.1 udp (tftp
						nameserver domain)
				 IN    WKS	192.9.201.1 tcp (echo telnet
						smtp discard uucp-path systat
						daytime netstat chargen ftp
						time whois finger hostnames
						domain)  ;  delimiter  for WKS kronos		  IN	A	 192.9.201.2 krabc		IN
	      CNAME    kronos hera		 IN    A	192.9.201.5
				 IN	A	  128.114.100.5  robert 	     IN     A	      192.9.201.6   ernie		 IN	 A
	      192.9.201.7
				 IN    HINFO	HP-800 OS1 robert.abc.aus.osf.com. IN	 MX 10	  venus.abc.aus.osf.com.

	      The  named  file for host allen is in the following file, called named.xyzdata: ;OWNER	     TTL       CLASS TYPE     RDATA ;local
	      domain server is venus xyz.aus.osf.com.  IN   SOA   venus.abc.aus.osf.com.  bob.robe rt.abc.aus.osf.com. (
					  1.1	  ;serial
					  3600	  ;refresh
					  600	  ;retry
					  3600000 ;expire
					  86400)  ;minimum xyz.aus.osf.com.  IN   NS   venus.abc.aus.osf.com.
				IN   NS   kronos.abc.aus.osf.com.
				IN   MX   10	  venus.abc.aus.osf.com.  ; address for local loopback localhost	 IN	A	  127.1  ;
	      address  of  machines  in  the  same  domain  allen	       IN     A 	128.114.100.3  allen		 IN    MX	10
	      venus.abc.aus.osf.com.  alxyz		IN    CNAME    allen
				IN    WKS      128.114.100.3 udp (tftp
					       nameserver domain)
				IN    WKS      128.114.100.3 tcp (echo telnet
					       smtp discard uucp-path systat
					       daytime netstat chargen ftp
					       time whois finger hostnames
					       domain) ; delimiter for WKS fred 	     IN    A	     128.114.100.10  mike		IN
	      A        128.114.100.11
				IN     HINFO	 HP-800 OS1 The following is a sample named.local file that might appear on hosts in either of the
	      sample domains: @   IN   SOA   venus.abc.aus.osf.com. gail.zeus.abc.aus.osf.com.	(
					 1.1	 ;serial
					 3600	 ;refresh
					 600	 ;retry
					 3600000 ;expire
					 86400)  ;minimum
		     IN    NS	  venus.abc.aus.osf.com.  1	 IN    PTR    localhost.  The following two files  are	sample	entries  from  the
	      named.rev files for hosts venus and allen.  For this example, the files are called named.abcrev and named.xyzrev.

	      The   reverse  file  for	host  venus  is  in  the  following  file,  called  named.abcrev:  @   IN    SOA    venus.abc.aus.osf.com.
	      bob.robert.abc.aus.osf.com.  (
					 1.1	 ;serial
					 3600	 ;refresh
					 600	 ;retry
					 3600000 ;expire
					 86400)  ;minimum 9.201.192.in-addr.arpa.   IN	  NS	 venus.abc.aus.osf.com.
					IN    NS     kronos.abc.aus.osf.com.
					IN     PTR     hera.abc.aus.osf.com.	;ABC.AUS.OSF.COM   Hosts   1.201.9.192.in-addr.arpa.   IN      PTR
	      venus.abc.aus.osf.com.	2.201.9.192.in-addr.arpa.   IN	   PTR	   kronos.abc.aus.osf.com.   5.201.9.192.in-addr.arpa.	IN     PTR
	      hera.abc.aus.osf.com.   6.201.9.192.in-addr.arpa.  IN	PTR	robert.abc.aus.osf.com.    7.201.9.192.in-addr.arpa.   IN      PTR
	      ernie.abc.aus.osf.com.

	      The   reverse  file  for	host  allen  is  in  the  following  file,  called  named.xyzrev:  @   IN    SOA    venus.abc.aus.osf.com.
	      bob.robert.abc.aus.osf.com.  (
					 1.1	 ;serial
					 3600	 ;refresh
					 600	 ;retry
					 3600000 ;expire
					 86400)  ;minimum 100.114.128.in-addr.arpa.   IN    NS	   venus.abc.aus.osf.com.
					  IN	NS     kronos.abc.aus.osf.com.
					  IN	 PTR	 hera.abc.aus.osf.com.	 ;XYZ.AUS.OSF.COM  Hosts  3.100.114.128.in-addr.arpa.  IN      PTR
	      allen.abc.aus.osf.com.   10.100.114.128.in-addr.arpa.  IN     PTR     fred.abc.aus.osf.com.   11.100.114.128.in-addr.arpa. IN    PTR
	      mike.abc.aus.osf.com.  ;ABC.AUS.OSF.COM Hosts 1.100.114.128.in-addr.arpa.  IN	PTR	venus.abc.aus.osf.com.	 5.100.114.128.in-
	      addr.arpa. IN    PTR    hera.abc.aus.osf.com.

RELATED INFORMATION

       Daemon: named(8).  delim off

																     named.star(4)
All times are GMT -4. The time now is 09:30 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy