Help on Awk


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help on Awk
# 1  
Old 03-03-2008
Error Help on Awk

File contents:
1. 4 33 45 21 1 01:25:25
2. 4 33 45 22 1 01:25:25
3. 4 33 45 23 1 01:25:25
4. 4 33 45 24 1 01:25:25
5. 4 33 45 25 1 01:25:25
6. 77 35 70 17 14 02:21:40
7. 77 35 70 18 14 02:21:40
8. 77 35 70 19 14 02:21:40
9. 77 35 70 20 14 02:21:40
10. 77 35 70 27 14 02:21:40
11. 77 35 70 17 1 02:2210
12. 77 35 70 18 14 02:2210
13. 77 35 70 19 1 02:2210
14. 77 35 70 20 1 02:2210
15. 77 35 70 27 1 02:2210
16. 87 31 109 27 99 03:35:34
17. 87 31 109 18 1 03:35:34
18. 87 31 109 19 14 03:35:34
19. 87 31 109 20 98 03:35:34
20. 87 31 109 27 1 03:35:34
21. 77 35 70 17 1 03:36:15
22. 77 35 70 18 1 03:36:15
23. 77 35 70 19 1 03:36:15
24. 77 35 70 20 1 03:36:15
25. 77 35 70 27 1 03:36:15
26. 500 29 577 11 1 03:37:59
27. 500 29 577 12 1 03:37:59
28. 500 29 577 13 1 03:37:59
29. 500 29 577 14 1 03:37:59
30. 500 29 577 15 1 03:37:59
31. 701 33 924 11 1 05:22:44
32. 701 33 924 12 1 05:22:44
33. 701 33 924 13 1 05:22:44
34. 701 33 924 14 1 05:22:44
35. 701 33 924 15 1 05:22:44
To explain the lines above, Column 1 numbered from 1. to 35. is just a column numbering to explain the rows in question. Therefore, please ignore column 1 numbered from 1 to 35 when processing the file.

Rows 1-5 is considered one point, rows 6-10 is another point, rows 11-15 is the same point as rows 6-10, rows 16-20 is another point, rows 21-25 is the same point as rows 6-10 & rows 11-15 and so on.

What I want to do is to print the output of the Point if its Column 5 shows 14, 98 or 99 and only if the same Point does not show 14 or 98 again.

To explain further, Rows 6-10 & 11-15 have 14 in Column 5 but since they are the same Point and it's repeated in rows 21-25 with no more 14 in Column 5, it is not printed.
Rows 16-20 has 14, 98 & 99 in Column 5 but since it was not repeated within the file, the expected output would be:

87 31 109 03:35:34
(without the 4th & 5th Columns).

I tried the following commands but it didn't work:

i=1
awk '
for (i=1;i<=NR;++1) {
if ($5=14 | $5=98 | $5=99);\
print NF
}' file

Any help?
# 2  
Old 03-04-2008
If I'm not missing something:

Code:
awk '{ K[$1,$2,$3]++ }
$5 ~ /^(14|9[89])$/ { 
R[$1,$2,$3] = $1 FS $2 FS $3 FS $6
} END {
for (k in K)
 if ((K[k]<6) && (k in R))
   print R[k]
}' filename

Use nawk or /usr/xpg4/bin/awk on Solaris.
# 3  
Old 03-04-2008
radoulov,

Could you please explain your script further?

Thanks!
# 4  
Old 03-05-2008
Quote:
Originally Posted by ilak1008
Could you please explain your script further?
Two arrays - the first counts the number of logical units:
given your sample it seems it's a five record set with
unique key based on the first three fields, the second is populated
with the first three fileds (as keys) and the output formated
as you want as elements but only for a records that match your criteria
(fifth field in 14,98 or 99). After reading the input it outputs
only the records that are part of a unique section and whose
fifth field matches the pattern.
# 5  
Old 03-05-2008
Quote:
Originally Posted by radoulov
Two arrays - the first counts the number of logical units:
given your sample it seems it's a five record set with
unique key based on the first three fields, the second is populated
with the first three fileds (as keys) and the output formated
as you want as elements but only for a records that match your criteria
(fifth field in 14,98 or 99). After reading the input it outputs
only the records that are part of a unique section and whose
fifth field matches the pattern.
Thank you for your explanation but I got the following error messages after running the script:

awk: syntax error near line 1
awk: illegal statement near line 1
awk: syntax error near line 3
awk: illegal statement near line 3
awk: syntax error near line 6
awk: illegal statement near line 6

Last edited by ilak1008; 03-06-2008 at 03:38 PM.. Reason: wrong grammar
# 6  
Old 03-05-2008
Quote:
Originally Posted by radoulov
If I'm not missing something:

Code:
awk '{ K[$1,$2,$3]++ }
$5 ~ /^(14|9[89])$/ { 
R[$1,$2,$3] = $1 FS $2 FS $3 FS $6
} END {
for (k in K)
 if ((K[k]<6) && (k in R))
   print R[k]
}' filename

Use nawk or /usr/xpg4/bin/awk on Solaris.
read the radoulov's reply once again!
# 7  
Old 03-06-2008
Quote:
Originally Posted by vgersh99
read the radoulov's reply once again!
Opss, sorry about that. Yup, nawk in the script worked. Thanks!

One more question, I would like to show all lines with 14, 98, and 99, too. How would I do that?
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk output yields error: awk:can't open job_name (Autosys)

Good evening, Im newbie at unix specially with awk From an scheduler program called Autosys i want to extract some data reading an inputfile that comprises jobs names, then formating the output to columns for example 1. This is the inputfile: $ more MapaRep.txt ds_extra_nikira_usuarios... (18 Replies)
Discussion started by: alexcol
18 Replies

2. Shell Programming and Scripting

Pass awk field to a command line executed within awk

Hi, I am trying to pass awk field to a command line executed within awk (need to convert a timestamp into formatted date). All my attempts failed this far. Here's an example. It works fine with timestamp hard-codded into the command echo "1381653229 something" |awk 'BEGIN{cmd="date -d... (4 Replies)
Discussion started by: tuxer
4 Replies

3. Shell Programming and Scripting

Passing awk variable argument to a script which is being called inside awk

consider the script below sh /opt/hqe/hqapi1-client-5.0.0/bin/hqapi.sh alert list --host=localhost --port=7443 --user=hqadmin --password=hqadmin --secure=true >/tmp/alerts.xml awk -F'' '{for(i=1;i<=NF;i++){ if($i=="Alert id") { if(id!="") if(dt!=""){ cmd="sh someScript.sh... (2 Replies)
Discussion started by: vivek d r
2 Replies

4. Shell Programming and Scripting

HELP with AWK one-liner. Need to employ an If condition inside AWK to check for array variable ?

Hello experts, I'm stuck with this script for three days now. Here's what i need. I need to split a large delimited (,) file into 2 files based on the value present in the last field. Samp: Something.csv bca,adc,asdf,123,12C bca,adc,asdf,123,13C def,adc,asdf,123,12A I need this split... (6 Replies)
Discussion started by: shell_boy23
6 Replies

5. Shell Programming and Scripting

awk command to compare a file with set of files in a directory using 'awk'

Hi, I have a situation to compare one file, say file1.txt with a set of files in directory.The directory contains more than 100 files. To be more precise, the requirement is to compare the first field of file1.txt with the first field in all the files in the directory.The files in the... (10 Replies)
Discussion started by: anandek
10 Replies

6. Shell Programming and Scripting

Comparison and editing of files using awk.(And also a possible bug in awk for loop?)

I have two files which I would like to compare and then manipulate in a way. File1: pictures.txt 1.1 1.3 dance.txt 1.2 1.4 treehouse.txt 1.3 1.5 File2: pictures.txt 1.5 ref2313 1.4 ref2345 1.3 ref5432 1.2 ref4244 dance.txt 1.6 ref2342 1.5 ref2352 1.4 ref0695 1.3 ref5738 1.2... (1 Reply)
Discussion started by: linuxkid
1 Replies

7. Shell Programming and Scripting

Problem with awk awk: program limit exceeded: sprintf buffer size=1020

Hi I have many problems with a script. I have a script that formats a text file but always prints the same error when i try to execute it The code is that: { if (NF==17){ print $0 }else{ fields=NF; all=$0; while... (2 Replies)
Discussion started by: fate
2 Replies

8. Shell Programming and Scripting

awk: assign variable with -v didn't work in awk filter

I want to filter 2nd column = 2 using awk $ cat t 1 2 2 4 $ VAR=2 #variable worked in print $ cat t | awk -v ID=$VAR ' { print ID}' 2 2 # but variable didn't work in awk filter $ cat t | awk -v ID=$VAR '$2~/ID/ { print $0}' (2 Replies)
Discussion started by: honglus
2 Replies

9. Shell Programming and Scripting

scripting/awk help : awk sum output is not comming in regular format. Pls advise.

Hi Experts, I am adding a column of numbers with awk , however not getting correct output: # awk '{sum+=$1} END {print sum}' datafile 2.15291e+06 How can I getthe output like : 2152910 Thank you.. # awk '{sum+=$1} END {print sum}' datafile 2.15079e+06 (3 Replies)
Discussion started by: rveri
3 Replies

10. Shell Programming and Scripting

Awk problem: How to express the single quote(') by using awk print function

Actually I got a list of file end with *.txt I want to use the same command apply to all the *.txt Thus I try to find out the fastest way to write those same command in a script and then want to let them run automatics. For example: I got the file below: file1.txt file2.txt file3.txt... (4 Replies)
Discussion started by: patrick87
4 Replies
Login or Register to Ask a Question