deleting records with a missing field

Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers deleting records with a missing field
# 1  
Old 12-12-2002
deleting records with a missing field

I had to delete rows when a record was missing a field. My solution was

cut -c 202-402 ${dataFile} | awk '{if (substr($0,103,30) !~ /^ *$/) print $0} >> ${workFile}

The cut is because they came two records to a row.

Anyone want to offer a more elegant solution?
# 2  
Old 12-12-2002
oops, left out the close quote after print $0}
# 3  
Old 12-12-2002
Hi Gill,
Just out of curiosity, do you work for a company that starts with the letter Q in a city starting with the letter I? I think we may work at the same company if that is the case.
On to your issue. I am sorry I can't give a better example at the time being but I am hoping this will give you a start. I am going away for the weekend and don't have time to test it out. This is from memory so sorry if it is way off. I don't know if you can get by without the xpg4 awk, but I don't see why you shouldn't be able to.
filename=<your filename>
field=103    # from your text I assume it is field 103
/usr/xpg4/bin/awk -v field=$field -v
NF!=0 {
    $'field'!=''    <- I am not 100% sure on this part.
}' OFS=' ' $filename > $

To recap what I think it should do, it should print all records except those which field 103 equals nothing. I hope this at least gives you (or someone else) some ideas if nothing else. If you are not that familiar with some of the variable in awk (I bearly use them myself) NF is "Number of Fields in the record" and OFS is the "Output Field Separator".
Good Luck,

added code tags for readability --oombera

Last edited by oombera; 02-17-2004 at 03:14 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Finding missing records and Dups

I have a fixed width file. The records looks something similar to below: Type ID SSN NAME .....AND SOME MORE FIELDS A1 1234 ..... A1 1234 ..... B1 1234 ..... M2 4567 ..... M2 4567 ..... N2 4567 ..... N2 4567 ..... A1 9999 N2 9999 Now if A1 is present then B1 has to be present.... (2 Replies)
Discussion started by: Saanvi1
2 Replies

2. Shell Programming and Scripting

Deleting the records based on the condition

Hi, Can any one help me, in deleting the records from the database table based on the following condition: script should take a configurable parameter as input. The input is nothing but “no. of years”. For example, if I enter 2 as input parameter, then the 2 year old records should get... (2 Replies)
Discussion started by: zxcjggu708
2 Replies

3. UNIX for Dummies Questions & Answers

Deleting records from .dat file

Hi, I need to delete one row from a .dat file. error processing column PCT_USED in row 1053295 for datafile /exp/stats/ts_stats.dat ORA-01722: invalid number This is used to load records using sql loader. Please let me know the procedure to do it. Regards, VN (3 Replies)
Discussion started by: narayanv
3 Replies

4. Shell Programming and Scripting

Perl : Deleting the records in the excel sheet

I have a excel sheet with contains the records as below.. also uploaded the input excelsheet and the output excel sheet(expected output). 44.0 M Hrly Avg (IN /... (1 Reply)
Discussion started by: giridhar276
1 Replies

5. Shell Programming and Scripting

Deleting duplicate records from file 1 if records from file 2 match

I have 2 files "File 1" is delimited by ";" and "File 2" is delimited by "|". File 1 below (3 record shown): Doc1;03/01/2012;New York;6 Main Street;Mr. Smith 1;Mr. Jones Doc2;03/01/2012;Syracuse;876 Broadway;John Davis;Barbara Lull Doc3;03/01/2012;Buffalo;779 Old Windy Road;Charles... (2 Replies)
Discussion started by: vestport
2 Replies

6. Shell Programming and Scripting

Deleting Duplicate Records

Hello, I'm have a file of xy data with over 1000 records. I want to delete both x and y values for any record that has the same x value as any previous record thus removing the duplicates from my file. Can anyone help? Thanks, Dan (3 Replies)
Discussion started by: DFr0st
3 Replies

7. Shell Programming and Scripting

Deleting last records of a file

can you please give shell script for daleting the last 7 records of file... (7 Replies)
Discussion started by: vsairam
7 Replies

8. Shell Programming and Scripting

deleting multiple records from a huge file at one time

I have a very big file of 5gb size and there are about 50 million records in there. I have to delete the records based on recrord number that I know fromoutside with out opening the file. The record numbers are very random like 5000678, 7890005 etc. Can somebody let me know how i can... (5 Replies)
Discussion started by: dsravan
5 Replies

9. UNIX for Advanced & Expert Users

Urgent: How can i get the missing records from one file out of two

Hi, I have two files say A and B, Both files have some common records few records which are unique to file A and unique to file B. Can anyone please help me out to find the records which are present in only B Please consider the files are of too large size. Thanks:confused: (1 Reply)
Discussion started by: Shiv@jad
1 Replies

10. UNIX for Dummies Questions & Answers

using cat and grep to display missing records

Gentle Unix users, Can someone tell me how I can use a combination of the cat and grep command to display records that are in FileA but missing in FileB. cat FileA one line at a time and grep to see if it is in fileB. If it is ignore. If line is not in fileB display the line. Thanks in... (4 Replies)
Discussion started by: jxh461
4 Replies
Login or Register to Ask a Question

Featured Tech Videos