difficulty with awk


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting difficulty with awk
# 1  
Old 12-13-2011
difficulty with awk

hello folks,

i am stuck with this awk command. i need to calculate the sum of a column of values on a flatfile and i am using the following command :
Code:
awk -F"|" '{x += $10} END {print "Sum: "x}' standard_csv_file1.out

that flatfile contains 180 fields and i am getting the following error.
Code:
awk: record `"D"||||||2449|||203|...' has too many fields
 record number 1

i tried the same command when i had few fields (may be 30 or so) it worked fine. but in order to standardise the flatfile, i have to add too many null value fields and now the total number of fields is 180 and the command doesn't work saying too many fields. any way around please. Smilie

Moderator's Comments:
Mod Comment Please use code tags!

Last edited by zaxxon; 12-13-2011 at 12:44 PM.. Reason: code tags, see PM
# 2  
Old 12-13-2011
Hi jdsony,

Try if next command works for you:
Code:
$ cut -d"|" -f10 standard_csv_file1.out | awk '{ x += $1 } END { print "Sum: " x }'

Regards,
Birei
# 3  
Old 12-13-2011
What's your OS? You may get results with nawk or gawk (gawk doesn't have a field limit, iirc).
# 4  
Old 12-13-2011
thanks for the responses guys. the cut command doesn't work as well unfortunately. i am working on solaris. it seems gawk doesn't work on it but nawk works on it. could you please tell me the equivalant nawk command for my command. i am a novice with poor unix skills. please don't mind.
# 5  
Old 12-13-2011
It should be the same syntax, just nawk instead of awk.
# 6  
Old 12-13-2011
Hi Birei, thank you.
Code:
$ cut -d"|" -f10 standard_csv_file1.out | awk '{ x += $1 } END { print "Sum: " x }'

it works mate. CarloM, thanks nawk too works. thank you both.

Last edited by Scott; 12-13-2011 at 01:30 PM.. Reason: Replaced [B] with [CODE]...
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Difficulty with CAT redirection in script

I have not been able to append the contents of many files into one file. I have executed the CAT command shown below separately substituting an actual path and file name for the array variable to verify that I have the syntax correct. The bottom line - nothing is happening with CAT. I am running... (16 Replies)
Discussion started by: demmith
16 Replies

2. UNIX for Dummies Questions & Answers

Difficulty with set - command

Hi , i have a shell script with the first two lines as #! /bin/ksh set -x when i try opening the file from unix using the command 'sh filename.sh' , i am getting the below error : invalid optionline 2: set: - Pls help Use code tags for you code and data... (1 Reply)
Discussion started by: Rajankum
1 Replies

3. Shell Programming and Scripting

Difficulty in understanding sort command

Hi, I have used the following command to get result using some program and got desired output but I am unable to understand the last part: sort -k5,5 -rn|head -n 10 grep Centre groups.dat |sort -k5,5 -rn|head -n 10 Please guide. Thanks (2 Replies)
Discussion started by: bioinfo
2 Replies

4. Shell Programming and Scripting

Difficulty embedding variable within AWK

Hi, I am working on a parsing script but cannot figure out how to accomplish this. Here is a simplified version of the script: #!/bin/bash DS=$1 DS=`expr $DS \* 2` DS=`expr $DS + 7` cat $FILENAME | awk '/<row><v> +/' | awk '{printf("%.0f %.0f\n", $6, $9)}' The problem is that I want the... (2 Replies)
Discussion started by: Nisrak
2 Replies

5. Shell Programming and Scripting

difficulty in formatting a file.

a file containing following data (part of it).... 1907594 201012 31 11 5837737 201012 41 18 257402.88 201101 31 11 7500 201101 33 1 115618.5 201101 41 11 556330 201102 31 12 481783.5 201102 41 20 2827732.13 201103 31 71 85253 201103 33 2 4479588.07 201103 41 90 7120 201104 21 1 ... (4 Replies)
Discussion started by: guptam
4 Replies

6. Shell Programming and Scripting

Loop difficulty

hi all I am new to unix and want to create a loop to repeat the loop and before that it ask me to do so.I know "while" may help but I put it in my work and getting stuk with it.any help appreciated. (13 Replies)
Discussion started by: samsami1971
13 Replies

7. Shell Programming and Scripting

Perl Difficulty

Hi, I am trying to upload a file to a SQL database table. The column type is IMAGE. I am looking for a solution to upload a word doc file. I tried 3 approaches. 1) my $fileToStore = "mytest.doc"; open IPFILE, "<", $name; binmode IPFILE; while (<IPFILE>) { $fileToStore .= $_; } close... (1 Reply)
Discussion started by: b.paramanatti
1 Replies

8. UNIX for Dummies Questions & Answers

Reverse Proxy difficulty

Hi I am trying to set up two hosts in a reverse proxy. The reverse proxy already has 8 servers running perfectly, but they are all simply mapping pure addresses, which I have registered internally and externally. The latest two I wish to add are a bit different, they are app servers, one... (1 Reply)
Discussion started by: rboekdrukker
1 Replies

9. UNIX for Dummies Questions & Answers

Having difficulty with UNIX concept. Please help!

Hi, I would be very happy if someone could help me please. I am relatively new to UNIX, and still learning. My understanding of things are: Say I have a PC running Windows. This machine has a name. If I have 10 PC's, then I have 10 names, one for each PC. Each PC is independent of the other.... (4 Replies)
Discussion started by: ALon
4 Replies
Login or Register to Ask a Question