Sponsored Content
Top Forums Shell Programming and Scripting Nawk One Liner to Count Field Combinations Post 302772696 by he204035 on Tuesday 26th of February 2013 01:26:19 PM
Old 02-26-2013
Question Nawk One Liner to Count Field Combinations

I have text files, fields separated by commas, and there are 115 fields.
I need to use nawk to look at each line, if field $4==10, then count how many times the combination of field $5 and field $11 occur in the file.

I tried the following:
Code:
nawk -F, '{if($4==10){tg[$5]++;cd[$11]++,tgcd[$5 $11]++}}END{for(i in tgcd){print i"\t"tgcd[i]}}' *20130226093*

With the following error:

Code:
nawk: syntax error at source line 1
 context is
         >>> {if($4==10){tg[$5]++;cd[$11]++, <<< 
nawk: illegal statement at source line 1

I am way out of my depth here. Smilie

Last edited by Scrutinizer; 02-26-2013 at 03:28 PM.. Reason: extra code tags
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

append field to file(nawk)

I have two files. File A and File B. File A has two fields separated by comma 352020252365988, 652020100572356 546876543215667, 652065465654686 ... File B has many Fields separate by spaces Date Name 352020252365988 Reference Date2 Name2 546876543215667 Reference I want to... (4 Replies)
Discussion started by: axl
4 Replies

2. Shell Programming and Scripting

I need help counting the fields and field separators using Nawk

I need help counting the fields and field separators using Nawk. I have a file that has multiple lines on it and I need to read the file 1 at a time and then count the fields and field separators and then store those numbers in variables. I then need to delete the first 5 fields and the blank... (3 Replies)
Discussion started by: scrappycc
3 Replies

3. Shell Programming and Scripting

nawk-how count the number of occurances of a pattern, when don't know the pattern

I've written a script to count the total size of SAN storage LUNs, and also display the LUN sizes. From server to server, the LUNs sizes differ. What I want to do is count the occurances as they occur and change. These are the LUN sizes: 49.95 49.95 49.95 49.95 49.95 49.95 49.95 49.95... (2 Replies)
Discussion started by: cyber111
2 Replies

4. UNIX for Dummies Questions & Answers

Count of Field for Non-Empty

Hi Guys, I wanted to count the number of records for a particular field of a file. whose fields are separated by comma"," I fI use this command. cat "filename" cut -sd "," -f13 | wc -l This shows all the lines count including the blank values for the field number 13. I wanted to count... (2 Replies)
Discussion started by: Swapna173
2 Replies

5. Shell Programming and Scripting

Count number of occurences of a character in a field defined by the character in another field

Hello, I have a text file with n lines in the following format (9 column fields): Example: contig00012 149606 G C 49 68 60 18 c$cccccacccccccccc^c I need to count the number of lower-case and upper-case occurences in column 9, respectively, of the... (3 Replies)
Discussion started by: s052866
3 Replies

6. Shell Programming and Scripting

awk (nawk) field separator

Hi; i have a file and i want to get; - If the last word in line 14 is NOT equal to "Set."; then print 2nd, 3rd, 4th and 5th values of 3rd line. and my code is: nawk 'NR==14 {if ($NF!="Set.") (NR==3{print $2,$3,$4,$5}) }' file.txt but no result?? :confused::(:confused::( (4 Replies)
Discussion started by: gc_sw
4 Replies

7. Shell Programming and Scripting

Search & Replace regex Perl one liner to AWK one liner

Thanks for giving your time and effort to answer questions and helping newbies like me understand awk. I have a huge file, millions of lines, so perl takes quite a bit of time, I'd like to convert these perl one liners to awk. Basically I'd like all lines with ISA sandwiched between... (9 Replies)
Discussion started by: verge
9 Replies

8. UNIX for Dummies Questions & Answers

Generating all possible combinations of values in field 1 (awk)

Input: A|1 B|2 C|3 D|4 Output: A+B|3 A+C|4 A+D|5 B+C|5 B+D|6 C+D|7 A+B+C|6 A+B+D|7 A+C+D|8 B+C+D|9 A+B+C+D|10 I only managed to get the output for pairs of $1 values (i.e. combination of length 2): (4 Replies)
Discussion started by: beca123456
4 Replies

9. Shell Programming and Scripting

FYI - gotcha when using a nawk one liner to convert a processes RSS to MB

I used the following one liner (obtained from an old thread on this site) to look for RSS size of a process and convert it to Mb (I am using process nfsmapid as an example): ps -eo rss,args | nawk 'END { print s/1024, "Mb" } /nfsmapid/ { s += $1 }' I found that the RSS Mb displayed was always... (1 Reply)
Discussion started by: thaebich
1 Replies
SHAPELIB(1)							   User Commands						       SHAPELIB(1)

NAME
dbfdump - dump xBase DBF files as text SYNOPSIS
dbfdump [-h] [-m] [-r] file DESCRIPTION
Dumps the contents of file to standard output. The first line contains the field names appearing in file, and each of the following lines contains the field values of a record. Field names and values are padded by spaces to their field widths. Empty fields are printed as the string "(NULL)". OPTIONS
-h Prints the column field definitions before other output. Each field definition consists of a line of the form Field: index, Type=type, Title=`name', Width=width, Decimals=precision where index is the zero offset column number of the field; the type indicates the datatype of the field value and is either "Inte- ger", "Real" or "String"; name is the field's name; width is the number of bytes reserved for the field's value; and precision is the number of decimal places of precision for "Real" type fields, and is zero for "Integer" and "String" type fields. -m Prints each record in multiline format separated by empty lines. The first line of a record gives the number of the record in the form Records: record_index where record_index is the zero offset number of the record in the file, and then each field of the record appears on its own line in the format name: value -r Prints the exact bytes occurring in file for field values and suppresses printing "(NULL)" for empty values. EXIT STATUS
0 Successful program execution. 1 Missing file argument. 2 Failed to open file. 3 There are no fields in file. DIAGNOSTICS
The following diagnostics may be issued on stdout: DBFOpen(file,"r") failed. There are no fields in this table! AUTHORS
Frank Warmerdam (warmerdam@pobox.com) is the maintainer of the shapelib shapefile library. Joonas Pihlaja (jpihlaja@cc.helsinki.fi) wrote this man page. BUGS
Unless the -r option is given, values in numeric fields that overflow the int or double types of the C language are printed as plus or minus a huge number. For integer fields the huge value is HUGE_VALL from <stdlib.h> and for real fields it is HUGE_VALF. SEE ALSO
dbf_dump(1), dbfcreate(1), dbfadd(1), shpadd(1), shpcreate(1), shpdump(1), shprewind(1) shapelib OCTOBER 2004 SHAPELIB(1)
All times are GMT -4. The time now is 10:41 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy