Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

awk to identify empty fields in line

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk to identify empty fields in line
# 1  
Old 09-03-2016
awk to identify empty fields in line
I am trying to use awk to identify and print out records in fields that are empty along with which line they are in. I hope the awk below is close, it runs but nothing results. Thank you Smilie.

awk

awk -F'\t' 'FNR==NR ~ /^[ ]*$/ { print "NR is empty" }' file


file
Code:
123    GOOD    ID    45

122    GOOD    TEST    55
123    GOOD    ID
145
145    GOOD    id    39

desired output
Code:
line2 $1 $2 $3 $4 are empty
line4 $4 is empty
line5 $2 $3 $4 are empty

Last edited by cmccabe; 09-03-2016 at 08:17 PM.. Reason: fixed format
# 2  
Old 09-03-2016
Code:
awk -F'\t'   NF==0 { print NR, " is empty"; next }
                 NF<4   { print 4-NF " missing fields}' file

Play with that cde
This User Gave Thanks to jim mcnamara For This Post:
cmccabe
# 3  
Old 09-04-2016
Hello cmccabe,

Following may also help you in same.
i- If you want to give number of fields manually into a variable then following my help you in same.
Code:
awk -vR=4 '!NF{print "Line " NR is " is completly empty.";next} {for(i=1;i<=R;i++){if(!$i){Q=Q?Q OFS "$"i:"$"i;j++}};;w=j>1?" fields are empty.":" field is empty.";if(Q){print "In Line " NR FS Q w;Q=""}}' OFS=,  Input_file

Output will be as follows.
Code:
Line 2 is completly empty.
In Line 4 $4 field is empty.
In Line 5 $2,$3,$4 fields are empty

ii- If you want to take number of fields from very first line and it is not empty then following may help you in same.(considering 1st line will have all the fields and other all lines may not have here.)
Code:
awk 'NR==1{R=NF} !NF{print "Line " NR is " is completly empty.";next} {for(i=1;i<=R;i++){if(!$i){Q=Q?Q OFS "$"i:"$"i;j++}};;w=j>1?" fields are empty.":" field is empty.";if(Q){print "In Line " NR FS Q w;Q=""}}' OFS=,   Input_file

Output will be as follows.
Code:
Line 2 is completly empty.
In Line 4 $4 field is empty.
In Line 5 $2,$3,$4 fields are empty.

iii- In case your Input_file's fields are not fixed and they could be in any number into your Input_file then you could try following.
Code:
awk 'FNR==NR{R=R>NF?R:NF;next} !NF{print "Line " FNR is " is completly empty.";next} {for(i=1;i<=R;i++){if(!$i){Q=Q?Q OFS "$"i:"$"i;j++}};;w=j>1?" fields are empty.":" field is empty.";if(Q){print "In Line " FNR FS Q w;Q=""}}' OFS=,  Input_file  Input_file

EDIT: Adding non-one liner forms of solutions now.
1st code(where we are mentioning the number of field's value in variable R by ourselves.):
Code:
awk -vR=4 '!NF{
		print "Line " NR is " is completly empty.";
		next
              } 
              {
		for(i=1;i<=R;i++){
					if(!$i){
							Q=Q?Q OFS "$"i:"$"i;
							j++
                                               }
                                 };;
                w=j>1?" fields are empty.":" field is empty.";
                if(Q){
             		print "In Line " NR FS Q w;
			Q=""
		     }
              }
          ' OFS=,   Input_file

2nd code(Where we are setting number of fields values from first line, which we are considering can't be empty and number of fields later in Input_file may vary.):
Code:
awk  'NR==1   {
		R=NF;
              }
		
	   !NF{
		print "Line " NR is " is completly empty.";
		next
              } 
              {
		for(i=1;i<=R;i++){
					if(!$i){
							Q=Q?Q OFS "$"i:"$"i;
							j++
                                               }
                                 };;
                w=j>1?" fields are empty.":" field is empty.";
                if(Q){
             		print "In Line " NR FS Q w;
			Q=""
		     }
              }
          ' OFS=,   Input_file

3rd code(Considering number of fields may vary in whole Input_file, so first taking them by reading Input_file twice. When we have highest number of fields value then checking for that for all the lines in second time of Input_file reading.):
Code:
awk 'FNR==NR{
		R=R>NF?R:NF;
		next
            } 
     !NF    {
		print "Line " FNR is " is completly empty.";
		next
            } 
            {
		for(i=1;i<=R;i++){
					if(!$i){
							Q=Q?Q OFS "$"i:"$"i;
							j++
					       }
                                 };;
                w=j>1?" fields are empty.":" field is empty.";
                if(Q){
			print "In Line " FNR FS Q w;
			Q=""
		     }
            }
     ' OFS=,   Input_file  Input_file

Thanks,
R. Singh
Last edited by RavinderSingh13; 09-04-2016 at 02:43 AM.. Reason: Adding non-one liner forms of solutions now.
This User Gave Thanks to RavinderSingh13 For This Post:
cmccabe
# 4  
Old 09-06-2016
Thank you both for your help Smilie
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk empty fields

Hello I have a file like this a,b,c,1,2,3,d,e,f,,,,g,h,i,,,,j,k,l and using awk 'FS="'"{print $9,$10,$11}' does not work as I was hoping. I would like the empty fieds, i.e. between the two comma to be interpreted as a zero. is this possible? I would like to get f 0 0 out of the above... (1 Reply)
Discussion started by: garethsays
1 Replies

2. Shell Programming and Scripting

Identify empty file with null record

Hi Team, I have a file abc.dat which is a empty file. But it has null record in first line. I need to identify this unique file and handle it separately. scenario 1: abc/dw> wc abc.dat 1 0 1 abc.dat abc/dw> cat abc.dat abc/dw> scenario 2: abc/dw> wc pqr.dat 0 0 0 pqr.dat... (3 Replies)
Discussion started by: kmanivan82
3 Replies

3. UNIX for Dummies Questions & Answers

Using awk to remove duplicate line if field is empty

Hi all, I've got a file that has 12 fields. I've merged 2 files and there will be some duplicates in the following: FILE: 1. ABC, 12345, TEST1, BILLING, GV, 20/10/2012, C, 8, 100, AA, TT, 100 2. ABC, 12345, TEST1, BILLING, GV, 20/10/2012, C, 8, 100, AA, TT, (EMPTY) 3. CDC, 54321, TEST3,... (4 Replies)
Discussion started by: tugar
4 Replies

4. Shell Programming and Scripting

awk :quick question removing empty line.

How to write in awk to remove lines starting with "#" and then process the file: This is not working: cat file|awk '{if ($0 ~ /^#/) $0="";print NF>0}' When I just give cat file|awk '{if ($0 ~ /^#/) $0="";print }' it prints the blank lines . I don't wnat the blank lines along with the... (15 Replies)
Discussion started by: rveri
15 Replies

5. Shell Programming and Scripting

awk script creates empty line

I have the following awk script to which I pass the file > 10 0 0 10 0 0 > 12.997 0 5.71132 12.9098 0.0687626 5.48855 12.7506 0.174324 5.13225 12.5913 0.262662 4.80643 12.4316 0.335652 4.50283 12.2717 0.394598 4.21542 12.1113 0.440399 3.93957 11.9506 0.473646 3.67148 11.7894... (2 Replies)
Discussion started by: kristinu
2 Replies

6. Shell Programming and Scripting

awk print last line returns empty string

hello I have a file with lines of info separated with "|" I want to amend the second field of the last line, using AWK my problem is with geting awk to return the last line this is what I am using awk 'END{ print $0 }' myFile but I get an empty result I tried the... (13 Replies)
Discussion started by: TasosARISFC
13 Replies

7. Shell Programming and Scripting

awk ignores fields with only spaces or empty

Hi, Does any one know how to avoid the scenario where awk ignores the fields having only spaces or empty fields? for instance, Data: "a","b","c","d",""," " code: awk -F, '{ print NF }' File the output I get is 4 instead of 6 do you know how to avoid this? (6 Replies)
Discussion started by: ahmedwaseem2000
6 Replies

8. Shell Programming and Scripting

use awk to replace empty fields with the latest nonempty field

Hi suppose I have a csv file like this count,1977,1978,1979 usa, , , blue japan, red, yellow,green india, , yellow,blue china, blue, yellow, green I want the output to be(replace everything, including empty data, with the most recent data): ... (1 Reply)
Discussion started by: grossgermany
1 Replies

9. Shell Programming and Scripting

awk - if field is empty, move line to new file

I have a script with this statement: /usr/xpg4/bin/awk -F"" 'NR==FNR{s=$2;next}{printf "%s\"%s\"\n", $0, s}' LOOKUP.TXT finallistnew.txt >test.txt I want to include logic or an additional step that says if there is no data in field 3, move the whole line out of test.txt into an additional... (9 Replies)
Discussion started by: scriptr2be
9 Replies

10. Shell Programming and Scripting

identify the empty directories

Hi Wrote the below script to identify the empty directories ,when executing the below showing that directory is not empty but the directories are empty.Please help to identify the empty directories 33 is not empty 33 is not empty 33 is not empty 33 is not empty for file in `find .... (5 Replies)
Discussion started by: mohan705
5 Replies
Login or Register to Ask a Question